John Sully
8bff491912
Implement the disk backed backlog functionality
...
Former-commit-id: 759cc01c6ba05f9a865c11580cc4975b5f1bd1d6
2021-11-26 03:05:23 +00:00
malavan
bbb565abb0
Merge remote-tracking branch 'origin/fastsync_collab' into fastsync_collab2
...
Former-commit-id: 176c00615769e1a73eb44f8fe7a6cacfa2ae539d
2021-11-24 22:00:18 +00:00
malavan
2ae7247ae7
remove async write from fast sync repl buffer and fix some bugs
...
Former-commit-id: 6c45706f75d8322281296d9c73a3fac4f7f383a1
2021-11-24 21:59:01 +00:00
VivekSainiEQ
91c758f153
Initialize snapshots for module thread var
...
Former-commit-id: c263e0df22bab35d8417eb396d250e00e8853ab3
2021-11-24 01:42:01 +00:00
VivekSainiEQ
f2e00755e3
Fix failing cluster test
...
Former-commit-id: 960503a4710d4379d5ebbb67d7ac82705f312913
2021-11-22 22:21:57 +00:00
malavan
ef9c1bd074
fix dataloss on aof load with storage provider
...
Former-commit-id: 447c8601b5203346fdd4b956ad1ac87c4a6073c8
2021-11-16 02:13:36 +00:00
VivekSainiEQ
b0c0cd8f8d
Removed trial code entirely
...
Former-commit-id: 540a60eb12d01c2839228f9fdaa6233aed99dc38
2021-11-15 23:56:30 +00:00
VivekSainiEQ
1ab337d760
bump version
...
Former-commit-id: 2d25e62ece9ecaff4252197c050031737fc1f211
2021-11-15 23:45:46 +00:00
VivekSainiEQ
32336ec921
bump version
...
Former-commit-id: d6038f0e063579987874b88bf8a11b5b16dfb33a
2021-11-15 23:43:56 +00:00
VivekSainiEQ
4a093570d0
Removed KeyDB Enterprise Trial
...
Former-commit-id: 0899ede8db54db80a2cc101412e5dbcaedb706b1
2021-11-15 20:33:54 +00:00
VivekSainiEQ
147abcb3bc
Merge branch 'unstable' into RELEASE_6
...
Former-commit-id: b0b81c60d9a8457c8840b4424b18fa4851907b22
2021-11-15 18:08:01 +00:00
Vivek Saini
440c637c6c
Merge pull request #375 from VivekSainiEQ/time_thread_backport
...
Backport the time thread code from the enterprise version of KeyDB.
Also fix an issue with clustering where connections are potentially written to after being closed.
Former-commit-id: 4b6bdcbccef3c4c93d85c62281b266e452912bac
2021-11-15 12:57:15 -05:00
John Sully
f9d36fb6bc
Prevent GC related crash on force-exit
...
Former-commit-id: e4d95f83b02786b5a170673709780700def160cb
2021-11-13 19:44:13 +00:00
John Sully
6eae02919a
Allow load at boot to be cancelled with a shutdown command
...
Former-commit-id: 2897a59e59bed14a67d1d0abcec5cb6a71bbb15b
2021-11-13 18:39:03 +00:00
VivekSainiEQ
7992428583
Merge remote-tracking branch 'opensource/unstable' into PRO_RELEASE_6
...
Former-commit-id: 60da86471f68b13e2456e113ecd4aa117d95b134
2021-11-12 21:12:53 +00:00
John Sully
fa223f4b5a
Allow fast sync even if a background save is in progress
...
Former-commit-id: b98aadfb6875f366a63a9d27d47fb5ca60abaa03
2021-11-12 00:18:32 +00:00
christianEQ
3819331e2e
removed unused vars
...
Former-commit-id: e2bb6242e8be53cdad6def6acdd7e90e0f7d9852
2021-11-11 13:43:20 +00:00
christianEQ
a59b192174
save replid from storage on load
...
Former-commit-id: 8e5d0cb7035db30f35ead36aab52df07ab3c9bee
2021-11-11 13:43:00 +00:00
christianEQ
7f9ab83d24
retrieve replid from IStorage rather than at load time
...
Former-commit-id: c25323439ce400ca91b2193aa2f464e7b09978fd
2021-11-11 13:43:00 +00:00
christianEQ
ebb0e08d94
save master status to storage when masters change
...
Former-commit-id: 4989926a0028aed7d7700fd1d1f4ed27c20277cc
2021-11-11 13:42:39 +00:00
christianEQ
39db170c4e
add KEYDB_METADATA_ID to metadata tables when created
...
Former-commit-id: 7fe8a184db62eab171935c20498bdb4f30ee6b1d
2021-11-11 13:41:00 +00:00
christianEQ
aa048e2b2f
added createMetadataDb to IStorageFactory + implementations
...
Former-commit-id: a2acf75484d2af93aad9d03a20bd402893044860
2021-11-11 13:41:00 +00:00
John Sully
0b607ecfc3
Fix multiple test failures
...
Former-commit-id: ba99418643e7b4a12e79bb08e4a7f152da28b861
2021-11-10 18:47:36 +00:00
John Sully
24fbc46352
Prevent track changes from clearing out the cache and misreporting the key count
...
Former-commit-id: d7ceb59f11bc714e40f208cb8c774a5b762ad41e
2021-11-10 06:40:43 +00:00
Vivek Saini
b8136b1580
Security fixes ( #373 )
...
Fixing potential buffer overflows when using the bitop shift and cron commands, as well as comparing ACL user passwords in constant time.
Former-commit-id: 3c716ee33d2d14d517271b674dd57c8328d14522
2021-11-09 19:00:01 -05:00
John Sully
b12b48ab27
Initial implementation of snapshot fast replication. There are still a few TODOs in progress
...
Former-commit-id: 0febdcdab8693af443f350968ed3d8c80106675d
2021-11-09 19:36:07 +00:00
John Sully
553f49507d
Smooth out performance fluctuations caused by variance in the rehash calibration
...
Former-commit-id: 09580dedfef09deace7863bf68ba7e0f9edf3eb3
2021-11-06 15:49:58 +00:00
VivekSainiEQ
83b23eafd0
Backported time thread code from enterprise
...
Former-commit-id: b03eab2a0628df157c1f6b6242bb500ca826ef45
2021-11-05 00:30:34 +00:00
John Sully
693e1f64a9
Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro_collab
...
Former-commit-id: eca47e8d19defdc894b9dd09b2500d2e15e5fafa
2021-11-02 19:39:53 +00:00
John Sully
9bd7f63ab1
This change fixes out of file descriptor issues with FLASH.
...
The change does 3 things:
1. It limits RocksDB to 256 file descriptors instead of unlimited
2. It includes the fd limit in its estimation for total file descriptors needed
3. It raises the system fd limit if possible before we open rocksdb but accounting for the 256 limit we added
Former-commit-id: 1447288209c5e7daf8a1203511fc262500ebe5e1
2021-11-02 19:31:53 +00:00
malavan
322ec31191
Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro
...
Former-commit-id: 5b88af1067d344f121b2d65e34fb40e229722575
2021-11-02 19:14:47 +00:00
malavan
755e9788ba
don't delete db or snapshots on shutdown, still delete storage provider
...
Former-commit-id: edb840ce10ea77ce654ba27c9eadbf98bbc13403
2021-11-02 19:01:37 +00:00
VivekSainiEQ
591f0c77c4
Check that cluster connection is valid before setting write handler
...
Former-commit-id: 6a0a005ff2587c1c2647d3a077472b8bca38a074
2021-11-02 17:43:17 +00:00
John Sully
73215b2eeb
Make the replica weighting configurable
...
Former-commit-id: be6a8a7e68acb5cfbe950f13b903e6f7b98c5a39
2021-10-29 17:59:46 +00:00
malavan
c48a942ce4
null check for delete override
...
Former-commit-id: 51216ee433d606644f3c2953abb97753b2eae079
2021-10-29 15:59:21 +00:00
Vivek Saini
6b8e55ce06
Merge pull request #372 from VivekSainiEQ/Redis_626_Merge
...
Redis 6.2.6 merge
Former-commit-id: 5f7ca6a2f6643352296d6b2ec41dc67c99300b20
2021-10-28 17:21:14 -04:00
VivekSainiEQ
349d9d2c05
Cast pointer correctly and fixed MVCC not updating correctly
...
Former-commit-id: 79bdcf0b3d0c190a24e6b7da50ce05f4e5185d04
2021-10-27 17:08:37 +00:00
John Sully
d41aa34ba3
Fix slower performance during replication by better balancing client load on threads servicing a replica
...
Former-commit-id: 496f91d3f169fcfe6d94c2ea69cee402f8eb60ca
2021-10-22 03:16:33 +00:00
John Sully
2d0f54eb8f
Merge branch 'COLLAB_RELEASE_6_4' into keydbpro_collab
...
Former-commit-id: 3d43e7a022250273ee5cfb5755ed1d6ca42b9889
2021-10-21 23:58:32 +00:00
malavan
fbe9ff6680
null check for delete override
...
Former-commit-id: f5f2f5e200a5ff1b0306998624b758d5a4c10825
2021-10-21 23:56:45 +00:00
malavan
b7b14ef19f
null check for delete override
...
Former-commit-id: a48b4cbdf24bfa5a1d13295c0202d1ed09115374
2021-10-21 23:50:50 +00:00
John Sully
3f08905408
Do not dereference a nullptr if there are too many files open
...
Former-commit-id: 4674eb29a261e8b046953398c94354fc3e550c2a
2021-10-21 23:45:46 +00:00
John Sully
7b3337d244
Ensure async rehash completes before we start a new time. Degrad to sync hash if necessary to ensure this
...
Former-commit-id: 0f830facc7c6bc6668af9bb2e10b6e13a13227aa
2021-10-21 22:46:17 +00:00
VivekSainiEQ
a7e7540284
Resolved merge conflicts in prior commit
...
Former-commit-id: b88f06b16f3d9e58ec884c61d2d074d7a489775e
2021-10-21 22:35:15 +00:00
VivekSainiEQ
b84ee93b5d
Merge tag '6.2.6' into Redis_626_Merge
...
Former-commit-id: e6d7e01be6965110d487e12f40511fe0b3497695
2021-10-21 22:33:55 +00:00
John Sully
43a62493f8
Additional change to ensure FLASH storage goes through the multithread path
...
Former-commit-id: 422ea0723f0b8718f28ef9c1cc4d5f56d374af46
2021-10-20 03:13:36 +00:00
John Sully
d57883bf64
Permit prefetch for FLASH scenarios in single thread mode
...
Former-commit-id: 6d0b90ed43cc9d1196903ddbc7d50cd40e439e42
2021-10-15 16:22:42 +00:00
noobpwnftw
b9d171eb32
Fix incorrect counting of client connections
...
This affects later distribution of clients among threads if there had been many connection attempts during loading phase.
Former-commit-id: 889bcd1bf1adeb246af04bbeb7f9e51c0c4eff1b
2021-10-12 21:47:15 -04:00
Alexis
2e9f7b5069
Fix alignment of #ifndef USE_ALIGNED_ACCESS
...
Former-commit-id: 9637887264336fdce84519afe773ea7b1a628705
2021-10-12 14:27:53 -04:00
jsully
763b349bd2
Merge branch 'multithread_load' into 'keydbpro'
...
Multithread load
See merge request external-collab/keydb-pro-6!5
Former-commit-id: 20e712244071028b0f75ccad477308efd139261f
2021-10-08 17:55:55 +00:00