gvsafronov/futriix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
12,840 Commits 1 Branch 0 Tags
Commit Graph

12840 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
malavan
8e7d88c514 add async to hget and fix bug where a command can hold a key from main db without lock 
Former-commit-id: b0b8f426fda7cdabd3898a2d0b38d0fae47d1e69
 2021-12-02 17:11:26 +00:00
malavan
c61f8822cf fix potential compilation fail on gettid in replication.cpp 
Former-commit-id: edb6b240a7785b707652a168d90f46d8744dd4c7
 2021-12-01 20:50:18 +00:00
Malavan Sotheeswaran
de40662c85 Merge branch 'async_commands' into 'keydbpro' 
async commands

See merge request external-collab/keydb-pro-6!10

Former-commit-id: 669987028af582a8561b7959c1b33b84f67c6146
 2021-11-30 17:28:17 +00:00
Malavan Sotheeswaran
7b2b5d0470 missing false for return in prefetchKeysAsync 
Former-commit-id: 174dc44acdc1a8cb37b86f27ab056e14fc42770c
 2021-11-30 12:20:13 -05:00
Malavan Sotheeswaran
6d8fe4ae50 Merge branch 'async_commands' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into async_commands 
Former-commit-id: 1afa51c4d21d695c052dbec690bf3880b243dbec
 2021-11-30 12:17:46 -05:00
Malavan Sotheeswaran
90fcba1968 Merge branch 'async_commands' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into async_commands 
Former-commit-id: 59423294524bb1d093a35084aa0d48989b426961
 2021-11-30 11:48:35 -05:00
Malavan Sotheeswaran
54f3436250 Merge branch 'keydbpro' into async_commands 
Former-commit-id: 9eaddb8ca1424ff3225dac9c144d23848228c7d2
 2021-11-30 11:47:51 -05:00
Malavan Sotheeswaran
aaf1a42a7b Merge branch 'fastsync_collab' into 'keydbpro' 
Fastsync collab

See merge request external-collab/keydb-pro-6!9

Former-commit-id: 8f410e4b814ea6ac506ab540ee1394834fd1d8a8
 2021-11-26 20:53:00 +00:00
christianEQ
e5b5099eef don't save master if host is null 
Former-commit-id: 8238d8da82c483c093f5248b9dac983bc542e20f
 2021-11-26 20:36:46 +00:00
Malavan Sotheeswaran
01d54e5e40 Merge branch 'flash-psync' into 'fastsync_collab' 
Flash Partial Sync

See merge request external-collab/keydb-pro-6!6

Former-commit-id: 2ebf2a8abd8df5c4cf3a5d759491962d050e8cc5
 2021-11-26 18:59:16 +00:00
christian
09f32f19c7 Merge branch 'fastsync_collab2' into 'fastsync_collab' 
fix dataloss on aof load with storage provider

See merge request external-collab/keydb-pro-6!7

Former-commit-id: a3aecc171b45308b68eb922947f8dd31be7e3566
 2021-11-26 18:28:08 +00:00
malavan
55cc6f797a client lock for fast sync replbuffer, delay fast sync for next replication cron 
Former-commit-id: 9fe7f8328d66f9ec57060934462ad85ef60c36aa
 2021-11-26 17:46:41 +00:00
John Sully
8bff491912 Implement the disk backed backlog functionality 
Former-commit-id: 759cc01c6ba05f9a865c11580cc4975b5f1bd1d6
 2021-11-26 03:05:23 +00:00
malavan
bbb565abb0 Merge remote-tracking branch 'origin/fastsync_collab' into fastsync_collab2 
Former-commit-id: 176c00615769e1a73eb44f8fe7a6cacfa2ae539d
 2021-11-24 22:00:18 +00:00
malavan
2ae7247ae7 remove async write from fast sync repl buffer and fix some bugs 
Former-commit-id: 6c45706f75d8322281296d9c73a3fac4f7f383a1
 2021-11-24 21:59:01 +00:00
VivekSainiEQ
91c758f153 Initialize snapshots for module thread var 
Former-commit-id: c263e0df22bab35d8417eb396d250e00e8853ab3
 2021-11-24 01:42:01 +00:00
VivekSainiEQ
f2e00755e3 Fix failing cluster test 
Former-commit-id: 960503a4710d4379d5ebbb67d7ac82705f312913
 2021-11-22 22:21:57 +00:00
malavan
ef9c1bd074 fix dataloss on aof load with storage provider 
Former-commit-id: 447c8601b5203346fdd4b956ad1ac87c4a6073c8
 2021-11-16 02:13:36 +00:00
John Sully
f9d36fb6bc Prevent GC related crash on force-exit 
Former-commit-id: e4d95f83b02786b5a170673709780700def160cb
 2021-11-13 19:44:13 +00:00
John Sully
6eae02919a Allow load at boot to be cancelled with a shutdown command 
Former-commit-id: 2897a59e59bed14a67d1d0abcec5cb6a71bbb15b
 2021-11-13 18:39:03 +00:00
John Sully
fa223f4b5a Allow fast sync even if a background save is in progress 
Former-commit-id: b98aadfb6875f366a63a9d27d47fb5ca60abaa03
 2021-11-12 00:18:32 +00:00
christianEQ
3819331e2e removed unused vars 
Former-commit-id: e2bb6242e8be53cdad6def6acdd7e90e0f7d9852
 2021-11-11 13:43:20 +00:00
christianEQ
9c75fc3e8f removed unnecessary code to check for metadata 
Former-commit-id: 69ffc89d7c27a4eef04aa5cb59ffd1c2b9b8eb20
 2021-11-11 13:43:00 +00:00
christianEQ
0dacd68163 added tests for flash psync 
Former-commit-id: 79f7376a4fea2de9bd06c06d96f3f98ee7308874
 2021-11-11 13:43:00 +00:00
christianEQ
a59b192174 save replid from storage on load 
Former-commit-id: 8e5d0cb7035db30f35ead36aab52df07ab3c9bee
 2021-11-11 13:43:00 +00:00
christianEQ
7f9ab83d24 retrieve replid from IStorage rather than at load time 
Former-commit-id: c25323439ce400ca91b2193aa2f464e7b09978fd
 2021-11-11 13:43:00 +00:00
christianEQ
ebb0e08d94 save master status to storage when masters change 
Former-commit-id: 4989926a0028aed7d7700fd1d1f4ed27c20277cc
 2021-11-11 13:42:39 +00:00
christianEQ
5219a90483 save and recognize metadata table identifier 
Former-commit-id: f06ef757c24ecc50df0e7abf5201a5499ff28c53
 2021-11-11 13:41:48 +00:00
christianEQ
39db170c4e add KEYDB_METADATA_ID to metadata tables when created 
Former-commit-id: 7fe8a184db62eab171935c20498bdb4f30ee6b1d
 2021-11-11 13:41:00 +00:00
christianEQ
aa048e2b2f added createMetadataDb to IStorageFactory + implementations 
Former-commit-id: a2acf75484d2af93aad9d03a20bd402893044860
 2021-11-11 13:41:00 +00:00
malavan
d443babbea ignore rdb specific tests when running in --flash mode 
Former-commit-id: b44ba3efb21c390c3d199ea1cdd238a57611fd85
 2021-11-10 20:46:09 +00:00
John Sully
0b607ecfc3 Fix multiple test failures 
Former-commit-id: ba99418643e7b4a12e79bb08e4a7f152da28b861
 2021-11-10 18:47:36 +00:00
John Sully
3ab09b9781 Fix compile error on some machines 
Former-commit-id: 5f491a38cb7eae63fd316c465f317005bbced385
 2021-11-10 17:39:00 +00:00
John Sully
24fbc46352 Prevent track changes from clearing out the cache and misreporting the key count 
Former-commit-id: d7ceb59f11bc714e40f208cb8c774a5b762ad41e
 2021-11-10 06:40:43 +00:00
John Sully
fcad4dfc6b Fix snapshot count mismatch due to race 
Former-commit-id: b4175c9bf82cbec047b94403e2a3700f4544b4f1
 2021-11-10 05:29:13 +00:00
John Sully
b12b48ab27 Initial implementation of snapshot fast replication. There are still a few TODOs in progress 
Former-commit-id: 0febdcdab8693af443f350968ed3d8c80106675d
 2021-11-09 19:36:07 +00:00
John Sully
553f49507d Smooth out performance fluctuations caused by variance in the rehash calibration 
Former-commit-id: 09580dedfef09deace7863bf68ba7e0f9edf3eb3
 2021-11-06 15:49:58 +00:00
John Sully
693e1f64a9 Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro_collab 
Former-commit-id: eca47e8d19defdc894b9dd09b2500d2e15e5fafa
 2021-11-02 19:39:53 +00:00
John Sully
9bd7f63ab1 This change fixes out of file descriptor issues with FLASH. 
The change does 3 things:
1. It limits RocksDB to 256 file descriptors instead of unlimited
2. It includes the fd limit in its estimation for total file descriptors needed
3. It raises the system fd limit if possible before we open rocksdb but accounting for the 256 limit we added


Former-commit-id: 1447288209c5e7daf8a1203511fc262500ebe5e1
 2021-11-02 19:31:53 +00:00
malavan
322ec31191 Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro 
Former-commit-id: 5b88af1067d344f121b2d65e34fb40e229722575
 2021-11-02 19:14:47 +00:00
malavan
755e9788ba don't delete db or snapshots on shutdown, still delete storage provider 
Former-commit-id: edb840ce10ea77ce654ba27c9eadbf98bbc13403
 2021-11-02 19:01:37 +00:00
John Sully
73215b2eeb Make the replica weighting configurable 
Former-commit-id: be6a8a7e68acb5cfbe950f13b903e6f7b98c5a39
 2021-10-29 17:59:46 +00:00
John Sully
d41aa34ba3 Fix slower performance during replication by better balancing client load on threads servicing a replica 
Former-commit-id: 496f91d3f169fcfe6d94c2ea69cee402f8eb60ca
 2021-10-22 03:16:33 +00:00
John Sully
2d0f54eb8f Merge branch 'COLLAB_RELEASE_6_4' into keydbpro_collab 
Former-commit-id: 3d43e7a022250273ee5cfb5755ed1d6ca42b9889
 2021-10-21 23:58:32 +00:00
malavan
fbe9ff6680 null check for delete override 
Former-commit-id: f5f2f5e200a5ff1b0306998624b758d5a4c10825
 2021-10-21 23:56:45 +00:00
malavan
b7b14ef19f null check for delete override 
Former-commit-id: a48b4cbdf24bfa5a1d13295c0202d1ed09115374
 2021-10-21 23:50:50 +00:00
John Sully
3f08905408 Do not dereference a nullptr if there are too many files open 
Former-commit-id: 4674eb29a261e8b046953398c94354fc3e550c2a
 2021-10-21 23:45:46 +00:00
John Sully
7b3337d244 Ensure async rehash completes before we start a new time. Degrad to sync hash if necessary to ensure this 
Former-commit-id: 0f830facc7c6bc6668af9bb2e10b6e13a13227aa
 2021-10-21 22:46:17 +00:00
John Sully
43a62493f8 Additional change to ensure FLASH storage goes through the multithread path 
Former-commit-id: 422ea0723f0b8718f28ef9c1cc4d5f56d374af46
 2021-10-20 03:13:36 +00:00
John Sully
d57883bf64 Permit prefetch for FLASH scenarios in single thread mode 
Former-commit-id: 6d0b90ed43cc9d1196903ddbc7d50cd40e439e42
 2021-10-15 16:22:42 +00:00