gvsafronov/futriix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
15,118 Commits 1 Branch 0 Tags
Commit Graph

1304 Commits

Author SHA1 Message Date
John Sully
d77bbee238 Fix mac build breaks and remove license checks (won't work on mac) 2022-03-07 14:50:31 -05:00
Vivek Saini
8644595efc TLS Name Validation (#48) 
Added TLS Name Validation
 2022-03-03 13:59:07 -05:00
Vivek Saini
e17865322f Added TLS rotation support 2022-02-02 14:20:19 -05:00
christianEQ
b785b03068 Merge remote-tracking branch 'opensource/RELEASE_6' into keydbpro 
Former-commit-id: 439c655a543f4d3224d90bcdeb21ba43c2ab8ab7
 2022-01-14 22:19:42 +00:00
MalavanEQAlpha
0f4268579e Merge pull request #386 from EQ-Alpha/fix_rdb_hang 
add readwrite lock for forking

Former-commit-id: dabb81960f6ccc7f62c53648127924fc2fef7cdc
 2022-01-14 13:19:33 -08:00
John Sully
373f584465 Fix partial sync corruption with FLASH 
Former-commit-id: 532f58c0539b775c040c0dd9a2ad3dc349faf87a
 2021-12-23 00:04:28 -05:00
VivekSainiEQ
bfcea943ea Merge remote-tracking branch 'mainpro/PRO_RELEASE_6' into keydbpro 
Former-commit-id: 5a32d66ee382b6d227a67073afc81ca058d605ed
 2021-12-06 20:43:23 +00:00
John Sully
5a3080dd8c Implent the force-backlog-disk-reserve flag 
Former-commit-id: d39f7f4407f8935b1540dd302be3e24ac02c5700
 2021-12-04 02:07:03 +00:00
malavan
5c84c608b2 add async to hget and fix bug where a command can hold a key from main db without lock 
Former-commit-id: b0b8f426fda7cdabd3898a2d0b38d0fae47d1e69
 2021-12-02 17:11:26 +00:00
Malavan Sotheeswaran
ac1775b8a6 Merge branch 'async_commands' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into async_commands 
Former-commit-id: 1afa51c4d21d695c052dbec690bf3880b243dbec
 2021-11-30 12:17:46 -05:00
Malavan Sotheeswaran
250e5b39a7 Merge branch 'keydbpro' into async_commands 
Former-commit-id: 9eaddb8ca1424ff3225dac9c144d23848228c7d2
 2021-11-30 11:47:51 -05:00
Malavan Sotheeswaran
9afbac8a83 Merge branch 'fastsync_collab' into 'keydbpro' 
Fastsync collab

See merge request external-collab/keydb-pro-6!9

Former-commit-id: 8f410e4b814ea6ac506ab540ee1394834fd1d8a8
 2021-11-26 20:53:00 +00:00
John Sully
2ed6d3f03a Implement the disk backed backlog functionality 
Former-commit-id: 759cc01c6ba05f9a865c11580cc4975b5f1bd1d6
 2021-11-26 03:05:23 +00:00
VivekSainiEQ
5693ce81d6 Removed trial code entirely 
Former-commit-id: 540a60eb12d01c2839228f9fdaa6233aed99dc38
 2021-11-15 23:56:30 +00:00
VivekSainiEQ
20cd658776 Removed KeyDB Enterprise Trial 
Former-commit-id: 0899ede8db54db80a2cc101412e5dbcaedb706b1
 2021-11-15 20:33:54 +00:00
VivekSainiEQ
f9a355900a Merge remote-tracking branch 'opensource/unstable' into PRO_RELEASE_6 
Former-commit-id: 60da86471f68b13e2456e113ecd4aa117d95b134
 2021-11-12 21:12:53 +00:00
christianEQ
c195ee4453 added createMetadataDb to IStorageFactory + implementations 
Former-commit-id: a2acf75484d2af93aad9d03a20bd402893044860
 2021-11-11 13:41:00 +00:00
John Sully
1ebf62da26 Initial implementation of snapshot fast replication. There are still a few TODOs in progress 
Former-commit-id: 0febdcdab8693af443f350968ed3d8c80106675d
 2021-11-09 19:36:07 +00:00
VivekSainiEQ
e7cdadb5f7 Backported time thread code from enterprise 
Former-commit-id: b03eab2a0628df157c1f6b6242bb500ca826ef45
 2021-11-05 00:30:34 +00:00
malavan
4bb05e4685 Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro 
Former-commit-id: 5b88af1067d344f121b2d65e34fb40e229722575
 2021-11-02 19:14:47 +00:00
malavan
519ba51343 don't delete db or snapshots on shutdown, still delete storage provider 
Former-commit-id: edb840ce10ea77ce654ba27c9eadbf98bbc13403
 2021-11-02 19:01:37 +00:00
John Sully
bdff0121eb Make the replica weighting configurable 
Former-commit-id: be6a8a7e68acb5cfbe950f13b903e6f7b98c5a39
 2021-10-29 17:59:46 +00:00
John Sully
b4eda0ef34 Fix slower performance during replication by better balancing client load on threads servicing a replica 
Former-commit-id: 496f91d3f169fcfe6d94c2ea69cee402f8eb60ca
 2021-10-22 03:16:33 +00:00
VivekSainiEQ
93b0482376 Resolved merge conflicts in prior commit 
Former-commit-id: b88f06b16f3d9e58ec884c61d2d074d7a489775e
 2021-10-21 22:35:15 +00:00
VivekSainiEQ
1d882b5ddd Merge tag '6.2.6' into Redis_626_Merge 
Former-commit-id: e6d7e01be6965110d487e12f40511fe0b3497695
 2021-10-21 22:33:55 +00:00
jsully
5e4dec1a16 Merge branch 'multithread_load' into 'keydbpro' 
Multithread load

See merge request external-collab/keydb-pro-6!5

Former-commit-id: 20e712244071028b0f75ccad477308efd139261f
 2021-10-08 17:55:55 +00:00
DarrenJiang13
1ed0f049fe [BUGFIX] Add some missed error statistics (#9328) 
add error counting for some missed behaviors.

(cherry picked from commit 43eb0ce3bf76a5d287b93a767bead9ad6230a1ad)
 2021-10-04 13:59:40 +03:00
Oran Agra
4b04ca0b18 Improvements to corrupt payload sanitization (#9321) 
Recently we found two issues in the fuzzer tester: #9302 #9285
After fixing them, more problems surfaced and this PR (as well as #9297) aims to fix them.

Here's a list of the fixes
- Prevent an overflow when allocating a dict hashtable
- Prevent OOM when attempting to allocate a huge string
- Prevent a few invalid accesses in listpack
- Improve sanitization of listpack first entry
- Validate integrity of stream consumer groups PEL
- Validate integrity of stream listpack entry IDs
- Validate ziplist tail followed by extra data which start with 0xff

Co-authored-by: sundb <sundbcn@gmail.com>
(cherry picked from commit 0c90370e6d71cc68e4d9cc79a0d8b1e768712a5b)
 2021-10-04 13:59:40 +03:00
menwen
e34f06ae5d Add latency monitor sample when key is deleted via lazy expire (#9317) 
Fix that there is no sample latency after the key expires via expireIfNeeded().
Some refactoring for shared code.

(cherry picked from commit ca559819f7dcd97ba9ef667bf38360a9527d62f6)
 2021-10-04 13:59:40 +03:00
Oran Agra
2775a3526e Fix ziplist and listpack overflows and truncations (CVE-2021-32627, CVE-2021-32628) 
- fix possible heap corruption in ziplist and listpack resulting by trying to
  allocate more than the maximum size of 4GB.
- prevent ziplist (hash and zset) from reaching size of above 1GB, will be
  converted to HT encoding, that's not a useful size.
- prevent listpack (stream) from reaching size of above 1GB.
- XADD will start a new listpack if the new record may cause the previous
  listpack to grow over 1GB.
- XADD will respond with an error if a single stream record is over 1GB
- List type (ziplist in quicklist) was truncating strings that were over 4GB,
  now it'll respond with an error.
 2021-10-04 13:59:40 +03:00
Oran Agra
757f8f771e Prevent unauthenticated client from easily consuming lots of memory (CVE-2021-32675) 
This change sets a low limit for multibulk and bulk length in the
protocol for unauthenticated connections, so that they can't easily
cause redis to allocate massive amounts of memory by sending just a few
characters on the network.
The new limits are 10 arguments of 16kb each (instead of 1m of 512mb)
 2021-10-04 13:59:40 +03:00
John Sully
db351b697a Handle the case where the key cache exceeds maxmemory 
Former-commit-id: 01febf902267fec7fe87e6437b0b81fd08b50963
 2021-10-04 07:34:05 +00:00
John Sully
4650e051bd Use the concurrentqueue for multithread load instead of mutex and cvs 
Former-commit-id: d5a59113dbfedaf7b62a650cff58a2e8ec01826f
 2021-10-04 07:33:03 +00:00
jsully
7cf8433745 Merge branch 'improve_overwrite_performance' into 'keydbpro' 
Improve overwrite performance

See merge request external-collab/keydb-pro-6!4

Former-commit-id: 7e59e889f28e30fca409dfb951c31f8cb47effbd
 2021-09-28 18:13:12 +00:00
John Sully
617519e021 Revert "Don't zero out potentially long buffers" - It has no benefit above the noise floor and potentially is the cause of a multithread slowdown 
This reverts commit 711c08c62491d0670b329fa7760c6938689910f1 [formerly 91e76ab4a00546278100baf6dfe61c13e802b40e].


Former-commit-id: f651cf67d731a10c3a52e30261c8d8b9d291576c
 2021-09-28 18:08:15 +00:00
malavan
d502437cf3 Merge branch 'async_commands' of https://gitlab.eqalpha.com/keydb-dev/KeyDB-Pro into async_commands 
Former-commit-id: a19112ec839da4684aeb1a9d1b41906f4c698944
 2021-09-23 17:48:33 +00:00
John Sully
154c9d1f79 Rework the tuning to be better for mixed read/write workloads 
Former-commit-id: a4fdd3e3cb41160b20e92e1b1f4f4ebd2ee86a4a
 2021-09-23 17:46:56 +00:00
John Sully
3294e4f788 Move the snapshot stale threshold to a named constant 
Former-commit-id: 46d2aaf17abb0fb021aa6d7b393ffc143493d339
 2021-09-23 17:45:49 +00:00
malavan
4297a3fb32 prev_error_count needs to be thread local 
Former-commit-id: 4abede1c40db1dfb4235b9aa1e3177678c5304b1
 2021-09-23 17:41:28 +00:00
John Sully
af1c51dc53 Make async commands runtime configurable 
Former-commit-id: 23bafb5f7c3c9805581f4bf09d9d5136898c2883
 2021-09-21 20:49:44 +00:00
John Sully
59855278e0 Initial implementation of async commands 
Former-commit-id: 0d3a4ce7e60c42b2d81962f13100bd1789bf64a8
 2021-09-21 20:43:16 +00:00
malavan
51fe42b10e improve overwrite key performance 
Former-commit-id: 56f9d5528385ea78074a308c6d3987b920d6cc35
 2021-09-14 17:06:04 +00:00
John Sully
711c08c624 Don't zero out potentially long buffers 
Former-commit-id: 91e76ab4a00546278100baf6dfe61c13e802b40e
 2021-09-10 00:40:08 +00:00
John Sully
5eda1c5b42 Don't zero out potentially long buffers 
Former-commit-id: 99eb47e129a3cd555914d4816febb02f0058253a
 2021-09-10 00:38:49 +00:00
jsully
91ec5dffa2 Merge branch 'async_mget' into 'keydbpro' 
add async mget

See merge request keydb-dev/KeyDB-Pro!38

Former-commit-id: e315b39f4779d530f5ab93e1f15915211e6706e2
 2021-09-08 19:08:23 +00:00
malavan
26aa8f0828 updates from comments 
Former-commit-id: 852885f09e7df1d9570408546baffa8545707335
 2021-09-01 21:00:27 +00:00
malavan
3239f678d5 refactor asyncCommand 
Former-commit-id: 6af5775e01872f130bc18791fdb4c0b22507b37f
 2021-09-01 20:18:41 +00:00
John Sully
40d5a2db44 Don't be in tracking mode during load as processChangesAsync works outside the normal system 
Former-commit-id: 8d31ce6eafea1cea2f9f4ea25e44306efef28fa3
 2021-09-01 04:15:28 +00:00
malavan
ee879d04ee add method to get client args as list 
Former-commit-id: 576b8cd2153c48c0ca4dfc9ed7d12f77d6f76f7e
 2021-08-30 21:09:22 +00:00
malavan
59ba007812 add stats for storage provider reads 
Former-commit-id: 612393ffba43cda31443605de924dc8dcf77ef52
 2021-08-26 19:45:33 +00:00