gvsafronov/futriix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
13,106 Commits 1 Branch 0 Tags
Commit Graph

148 Commits

Author SHA1 Message Date
John Sully
c9d70ca62d Do not send updates to servers overly frequently during load 2022-04-13 12:51:00 -04:00
John Sully
52b8c153f8 Make multithread load configurable and disabled by default (#57) 
Co-authored-by: John Sully <john@csquare.ca>
 2022-04-07 13:20:38 -04:00
John Sully
0d917c8580 Fix mac build breaks and remove license checks (won't work on mac) 2022-03-07 14:50:31 -05:00
VivekSainiEQ
45e7b87548 Merge remote-tracking branch 'mainpro/PRO_RELEASE_6' into keydbpro 
Former-commit-id: 5a32d66ee382b6d227a67073afc81ca058d605ed
 2021-12-06 20:43:23 +00:00
John Sully
6eae02919a Allow load at boot to be cancelled with a shutdown command 
Former-commit-id: 2897a59e59bed14a67d1d0abcec5cb6a71bbb15b
 2021-11-13 18:39:03 +00:00
VivekSainiEQ
7992428583 Merge remote-tracking branch 'opensource/unstable' into PRO_RELEASE_6 
Former-commit-id: 60da86471f68b13e2456e113ecd4aa117d95b134
 2021-11-12 21:12:53 +00:00
VivekSainiEQ
349d9d2c05 Cast pointer correctly and fixed MVCC not updating correctly 
Former-commit-id: 79bdcf0b3d0c190a24e6b7da50ce05f4e5185d04
 2021-10-27 17:08:37 +00:00
VivekSainiEQ
a7e7540284 Resolved merge conflicts in prior commit 
Former-commit-id: b88f06b16f3d9e58ec884c61d2d074d7a489775e
 2021-10-21 22:35:15 +00:00
VivekSainiEQ
b84ee93b5d Merge tag '6.2.6' into Redis_626_Merge 
Former-commit-id: e6d7e01be6965110d487e12f40511fe0b3497695
 2021-10-21 22:33:55 +00:00
John Sully
ac22f3c60f disable key cache during load if necessary 
Former-commit-id: 68dcf66909e2138da4902bdec98985f4fcd737cf
 2021-10-04 07:35:36 +00:00
John Sully
86ec032e2c Don't expand the dictionary if a storage provider is set as we won't use the whole thing 
Former-commit-id: 1f07b01144397cec59ec2d94f41c85eceb7248e2
 2021-10-04 07:33:38 +00:00
John Sully
d29df021b1 Use the concurrentqueue for multithread load instead of mutex and cvs 
Former-commit-id: d5a59113dbfedaf7b62a650cff58a2e8ec01826f
 2021-10-04 07:33:03 +00:00
John Sully
4d605bea02 Unify job types so everything is processed in order 
Former-commit-id: 625aa97e4cf16337e8b052b7a27491a0ab09110f
 2021-09-17 17:27:19 +00:00
John Sully
6e7c4cbf17 We need to send keepalives to masters while waiting to prevent disconnects 
Former-commit-id: 7cbd6758b1042198c14ca9e8da0f1f7bc05df93d
 2021-09-01 04:15:59 +00:00
John Sully
f3fb4e3209 Don't be in tracking mode during load as processChangesAsync works outside the normal system 
Former-commit-id: 8d31ce6eafea1cea2f9f4ea25e44306efef28fa3
 2021-09-01 04:15:28 +00:00
MalavanEQAlpha
fd5f0b8ebe Merge pull request #313 from MalavanEQAlpha/fixissue295 
Resolve Issue #295 by speeding up keyIsExpired and setting timeout on subkey expires.

Former-commit-id: 9e5e6c2f86548b18ae27b4e1ac20c72517392b07
 2021-08-18 17:34:18 -04:00
John Sully
c6a0c7b04f Fix crash in load with storage provider set 
Former-commit-id: 6990818b7ca647819b50ae04224778e6f8f12a1a
 2021-08-11 01:19:39 +00:00
John Sully
c77ce968c5 Merge branch 'keydbpro_collab' into multithread_load 
Former-commit-id: 8016c20f1f9a648e658c816e2f6777c5718d5e19
 2021-08-09 20:20:34 +00:00
John Sully
88f5bf1d90 We need to periodically flush the GC or we'll end up blocking with a huge backlog at the end of load 
Former-commit-id: 29c0bf79ad1a810e808790de2f7db24f3cc603e8
 2021-07-19 16:50:48 +00:00
malavan
bfefd8a11b use INVALID_EXPIRE instead of -1 
Former-commit-id: 9e45984a97a293d87474f87612204a24c831a343
 2021-07-14 22:13:29 +00:00
John Sully
0f41d34ba2 Fix collab issue #26 
Former-commit-id: 2392879772a77fc30c856488b9911d194ced827b
 2021-06-03 04:43:38 +00:00
John Sully
eef508736d Merge branch 'keydbpro_collab' into multithread_load 
Former-commit-id: b580a5561220bc6dc7bc073135f3045ba0cdda51
 2021-06-02 04:24:49 +00:00
John Sully
af81622bfc We need to refactor to gurantee the key is visible when loading subexpires. Keys may be temporarily invisible while waiting to be added to the storage 
Former-commit-id: 222eecb95925f7c60e28a5717d73163ad64b522b
 2021-06-01 23:59:22 +00:00
John Sully
d0e69e4c47 Reduce lock contention when loading to a storage provider 
Former-commit-id: 58bc777f2215918043325753b6e2bf89dc3108f7
 2021-06-01 20:01:41 +00:00
John Sully
702bfaee9b Merge branch 'unstable' into keydbpro 
Former-commit-id: 4fd95b064648ee3d02097a1c2dabf306978b44f9
 2021-05-30 04:28:09 +00:00
John Sully
f1ba462df6 Delete pipe on the right thread so event handlers are cleaned up 
Former-commit-id: 9742c44db52929b755d6ecce16f91bee07f495ff
 2021-05-30 02:07:31 +00:00
John Sully
f4151f0d6b Merge branch 'unstable' into keydbpro 
Former-commit-id: 205d8f18d2bb8df5253bab40578b006b7aa73fd5
 2021-05-28 23:32:46 +00:00
John Sully
ea6a0f214b Merge tag '6.2.2' into unstable 
Former-commit-id: 93ebb31b17adec5d406d2e30a5b9ea71c07fce5c
 2021-05-21 05:54:39 +00:00
John Sully
f49d8f9adb Merge tag '6.2.1' into unstable 
Former-commit-id: bfed57e3e0edaa724b9d060a6bb8edc5a6de65fa
 2021-05-19 02:59:48 +00:00
VivekSainiEQ
501a065759 Changed branding in various locations 
Former-commit-id: 96bca72bb4528a0789354ee4fd6bf3ab66d82bf7
 2021-05-06 20:13:45 -04:00
John Sully
442aa5bbd9 Pause execution during rdbLoadProgressCallback as its too risky to let it run 
Former-commit-id: e70c01cb3e756d1e02ed190b76c73b7b7010c0d3
 2021-05-06 00:42:49 +00:00
John Sully
40fdb3ce05 Add endurance testing to better detect threading bugs 
Former-commit-id: 945e428aa110968479fdcdfc2d5c5308a99eadc3
 2021-05-06 00:09:07 +00:00
John Sully
0c5585e5de Ensure multithread load works with FLASH storage 
Former-commit-id: 24e2991c7aa2cef90a89b1640f7095235c5d34ed
 2021-05-03 20:18:45 +00:00
John Sully
eaaff16cca Don't sync too often it hurts perf 
Former-commit-id: a20e89a457a0a682483c22f0f1cdb5c93c574d28
 2021-05-03 04:15:46 +00:00
John Sully
5583fbb838 Fix remaining test failures 
Former-commit-id: 37e607f9b13b6601ff52e74e613fb369cab22b56
 2021-05-03 02:37:02 +00:00
John Sully
4677c62428 Fix issue where async load thread misses work 
Former-commit-id: a24a7b093295c5f5d69feee9fbc37c64cfa8aa03
 2021-04-30 18:48:23 +00:00
John Sully
7352e4a45f Fix majority of test issues with multithread load 
Former-commit-id: 4db88176e33e3615ffb90852b49e76b12d5b4622
 2021-04-30 18:45:37 +00:00
John Sully
556f394ed9 Initial implementation of multithread load 
Former-commit-id: 87b0657c3acd7a3c89964afe1702851b44467c9a
 2021-04-30 17:32:54 +00:00
John Sully
15e1ee620f Fix TSAN errors in tests 
Former-commit-id: 30207d2ab34f175b94f430f97581191343d23f1e
 2021-03-16 02:29:24 +00:00
John Sully
7636676988 When we add a delay to rdb save for test purposes we still need to check for aborts 
Former-commit-id: b057b4d05aae6c08b855bfc9ae48d41ad0e881f8
 2021-03-10 02:53:15 +00:00
John Sully
902264efb7 Load perf fixes with a storage provider set 
Former-commit-id: 861b19de00c75c9167cc25031292284ad1c21893
 2021-03-04 07:41:06 +00:00
christian
53b7b83af6 Offload updating cached time to dedicated thread 
Former-commit-id: 9bfc8a43952481b5b54a7b051d44b8bece4a18dd
 2021-02-26 00:50:22 +00:00
John Sully
52c1d17127 Update test to handle forkless bgsave 
Former-commit-id: fc8c6de8252e6b802688413050f1a823093d0a1d
 2021-02-07 21:41:19 +00:00
christianEQ
c69b2845fd Merge remote-tracking branch 'opensource/unstable' into keydbpro 
Former-commit-id: 5bad058733de2c217340bb9ee48f02b07d754808
 2021-02-03 18:10:27 +00:00
christianEQ
c068f2cd3d Merge tag 'tags/6.0.10' into redismerge_2021-01-20 
Former-commit-id: dadce055f897cee83946c2d3e5cbb76341b94230
 2021-01-26 21:43:09 +00:00
christianEQ
464a08226d renamed loaded key counter to be more clear 
Former-commit-id: 8dc238efae8f6ba6b4ddc9b169e7195bcb43920b
 2021-01-14 13:06:57 -05:00
christianEQ
327c44f8eb ping replicas during key load 
Former-commit-id: 2747d1a1a99d3415d5486a472fe0e39135b79bc5
 2021-01-14 13:06:57 -05:00
christianEQ
28a0cdc572 added config option for loading callback interval keys 
Former-commit-id: 9f7ed0b2327924563668105ead09f52833902d0b
 2021-01-14 13:06:57 -05:00
John Sully
5c832c5ad0 Merge branch 'unstable' into keydbpro 
Former-commit-id: b7a1e16c0f04e8aeb3764e3681fa14fc0f97f6a3
 2020-12-10 02:37:28 +00:00
John Sully
50c2a8524c Fix issue where active replication doesn't replicate RDB data 
Former-commit-id: 527b7eb0742567302e0343e3acbed9814c0cbb95
 2020-11-23 02:01:40 +00:00