13182 Commits

Author SHA1 Message Date
John Sully
1f958ac63d Disable async for hget commands as it is not ready 2022-05-05 20:50:44 +00:00
John Sully
e16dc2840c Merge pull request #68 from Snapchat/psync_mm_fixes
Fix PSYNC test crashes
2022-05-05 10:32:18 -04:00
John Sully
cb6831308d Ensure we force moves not copies when ingesting bulk insert files 2022-05-04 16:51:48 +00:00
John Sully
41b282803a Fix PSYNC test crashes 2022-05-04 01:37:40 +00:00
John Sully
ffa8a74d3b Merge pull request #67 from Snapchat/vsaini_psync_test_additions
Quick fix to make psync tests work
2022-05-02 23:11:56 -04:00
Vivek Saini
eaeadc5427 Quick fix to make psync tests work 2022-05-03 00:41:30 +00:00
John Sully
a1051fd435 Merge pull request #66 from Snapchat/psync_multimaster_fixes
Psync multimaster fixes
2022-05-02 20:24:28 -04:00
John Sully
cefba25d0e active-rep test reliability 2022-05-03 00:02:22 +00:00
John Sully
cfcb9df71c Merge branch 'keydbpro' into psync_multimaster_fixes 2022-05-02 22:19:22 +00:00
John Sully
15531af421 Merge branch 'psync_multimaster_fixes' of https://github.sc-corp.net/Snapchat/keydb-internal into psync_multimaster_fixes 2022-05-02 22:17:26 +00:00
John Sully
63e5507dfe Merge branch 'keydbpro' of https://github.sc-corp.net/Snapchat/keydb-internal into keydbpro 2022-05-02 22:14:31 +00:00
Vivek Saini
faf9359e10 Merge pull request #60 from Snapchat/merge_os_apr_13
Merge in changes from Open Source.

For the most part, this encompasses two changes:

- Adding partial sync capabilities to multi-master
- Adding ReadWrite locks to prevent global lock issues when forking threads, specifically with regards to the time thread.
2022-05-02 13:26:21 -04:00
Vivek Saini
c45c77b0ef Updated test replica configs so tests make sense 2022-04-28 21:58:35 +00:00
Vivek Saini
cd59462dca Cleanup test suite 2022-04-28 21:36:01 +00:00
Vivek Saini
72c033c9af Inclusive language fix 2022-04-28 21:34:10 +00:00
Vivek Saini
c0eeda86e1 Converted some existing PSYNC tests for multimaster 2022-04-28 21:30:40 +00:00
John Sully
6e4e75af9c Ensure recreated tables use the same settings as ones made at boot 2022-04-27 23:38:55 +00:00
John Sully
cfa9ba8eb1 Ensure we are responsive during storagecache clears 2022-04-27 17:32:40 +00:00
John Sully
48128dd4c7 Merge branch 'keydbpro' of https://github.sc-corp.net/Snapchat/keydb-internal into keydbpro 2022-04-27 17:00:35 +00:00
Zhaozhen Liang
6b795bf62e Merge pull request #64 from Snapchat/setup-machamp-ci
setup Machamp ci
2022-04-26 16:35:39 -06:00
John Sully
b37a68c8f1 PSYNC production fixes 2022-04-26 02:07:28 +00:00
John Sully
5ce8bcd511 Merge branch 'merge_os_apr_13' of https://github.sc-corp.net/Snapchat/keydb-internal into merge_os_apr_13 2022-04-26 02:06:43 +00:00
John Sully
1bf92015dc acceptTLS is threadsafe like the non TLS version 2022-04-26 01:55:22 +00:00
John Sully
914da1f62c With TLS throttle accepts if server is under heavy load - do not change non TLS behavior 2022-04-26 01:55:22 +00:00
John Sully
dcaca5d79c Make active client balancing a configurable option 2022-04-26 01:55:22 +00:00
Vivek Saini
54f746f99b Removed mergeReplicationId 2022-04-26 01:55:22 +00:00
Vivek Saini
78efb2f629 call aeThreadOnline() earlier 2022-04-26 01:55:22 +00:00
Vivek Saini
d441901c39 Inclusive language 2022-04-26 01:55:22 +00:00
Vivek Saini
09f216fb03 Remove asserts, RW lock can go below zero in cases of aeAcquireLock 2022-04-26 01:55:22 +00:00
Vivek Saini
b1b6d31305 placement new instead of memcpy 2022-04-26 01:55:22 +00:00
Christian Legge
0f26a14276 Save and restore master info in rdb to allow active replica partial sync (#371)
* save replid for all masters in rdb

* expanded rdbSaveInfo to hold multiple master structs

* parse repl-masters from rdb

* recover replid info from rdb in active replica mode, attempt partial sync

* save offset from rdb into correct variable

* don't change replid based on master in active rep

* save and load psync info from correct fields
2022-04-26 01:55:22 +00:00
Vivek Saini
cde7939fe1 Defensive asserts for RWLock 2022-04-26 01:55:22 +00:00
Vivek Saini
3fadb9787a Integrate readwritelock with Pro Code 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
bdfd34cf10 use atomic_load for g_pserver->mstime 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
8f6c6bb6a4 need to include stdint for uintptr_t 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
2c881b390a cannot mod a pointer 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
f189bbb4e4 remove nullptr subtraction 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
e0548b4722 check ziplist len to avoid crash on empty ziplist convert 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
60a85737e6 remove unused var in networking.cpp 2022-04-26 01:55:22 +00:00
John Sully
f7ea8bf0f1 Eliminate firewall dialogs on mac for regular and cluster tests. There are still issues with the sentinel tests but attempting to bind only to localhost causes failures 2022-04-26 01:55:22 +00:00
John Sully
f59cd18e8c Fix module test break 2022-04-26 01:55:22 +00:00
John Sully
9dad9f6ef4 Fix MALLOC=memkind build issues 2022-04-26 01:55:22 +00:00
benschermel
e0d08c62e5 update README resource links 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
78086d6293 set thread as offline when waiting for time thread lock 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
aa07287c05 time thread lock uses fastlock instead of std::mutex 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
24a586cdf1 only need to include readwritelock in ae 2022-04-26 01:55:22 +00:00
Malavan Sotheeswaran
4d4acaa155 hide forklock object in ae 2022-04-26 01:55:22 +00:00
malavan
52402c4786 fork lock for all threads, use fastlock for readwritelock 2022-04-26 01:55:21 +00:00
John Sully
84b57684b0 Update ci.yml
Change min tested version to 18.04
2022-04-26 01:55:21 +00:00
zliang
6ab1c2deec update builder image 2022-04-25 18:55:01 -06:00