John Sully
fa9f1b4f95
Merge branch 'keydbpro_collab' into multithread_load
...
Former-commit-id: 31ddf772cd89344017042a18547ae83a60ce02b9
2021-06-01 19:18:19 +00:00
John Sully
44db4746cb
Merge branch 'keydbpro' into keydbpro_collab
...
Former-commit-id: 0f2132505470ca63375f53b54cb6751b604d92f9
2021-06-01 19:17:54 +00:00
John Sully
e2000a6d3d
Implement bulkInsert for rocksdb
...
Former-commit-id: e9abae77d6ae18e21d7dac0cbdd563f572ac3d03
2021-06-01 19:17:40 +00:00
John Sully
c0c3d7542f
Initial bulkInsert implementation
...
Former-commit-id: 2a721d4dff3c9f78ec4ba1c7b490ea1f5d216a89
2021-06-01 19:15:01 +00:00
John Sully
721e572275
Merge remote-tracking branch 'collab/keydbpro' into multithread_load
...
Former-commit-id: a09454b3a4b295b2d04bdb7d742db7f9a3e17be7
2021-05-31 01:16:01 +00:00
John Sully
7af5eb2ee3
Merge branch 'keydbpro' into keydbpro_collab
...
Former-commit-id: 40187ebd4cc479fa86a3ee5cca9bedef7d488ee7
2021-05-31 01:15:30 +00:00
John Sully
ac49c7158c
Eliminate unnecessary global locks
...
Former-commit-id: 8f924ed0979f3cf7cd290395d1b1eec358979325
2021-05-31 01:14:28 +00:00
John Sully
a2010f17b8
Fix deadlock in async work queue
...
Former-commit-id: 3265f2908e8d3aa567b3b9e6b141a7881c795053
2021-05-31 01:14:11 +00:00
John Sully
a8d177e758
Pause execution during rdbLoadProgressCallback as its too risky to let it run
...
Former-commit-id: e70c01cb3e756d1e02ed190b76c73b7b7010c0d3
2021-05-06 00:42:49 +00:00
John Sully
10383a8234
Add endurance testing to better detect threading bugs
...
Former-commit-id: 945e428aa110968479fdcdfc2d5c5308a99eadc3
2021-05-06 00:09:07 +00:00
John Sully
f41b79cea6
Merge branch 'keydbpro' into keydbpro_collab
...
Former-commit-id: 446daf8f4c33005096372ad9e29ae9b3d465c64e
2021-05-03 22:58:56 +00:00
jsully
fe9f276f95
Merge branch 'cluster_bugfix' into 'keydbpro'
...
Set repl_down_since in freeClientAsync
See merge request keydb-dev/KeyDB-Pro!12
Former-commit-id: bd7591fe50b1e5565da2fa521438b88058d4da07
2021-05-03 21:41:05 +00:00
christian
12044bab09
Set repl_down_since in freeClientAsync
...
Former-commit-id: fb4bd2984651837fadd1dbbbb56327e8452b4a2a
2021-05-03 21:41:04 +00:00
John Sully
443f3511a9
Ensure multithread load works with FLASH storage
...
Former-commit-id: 24e2991c7aa2cef90a89b1640f7095235c5d34ed
2021-05-03 20:18:45 +00:00
John Sully
c83c3f1f8e
Respect replica output buffer limits when adding large commands to the ring buffer
...
Former-commit-id: 37ec01cfd8a8da1e895c7cdc358d382d35ad59dd
2021-05-03 16:33:16 +00:00
John Sully
f106327e4e
Don't sync too often it hurts perf
...
Former-commit-id: a20e89a457a0a682483c22f0f1cdb5c93c574d28
2021-05-03 04:15:46 +00:00
John Sully
3469890ac4
Fix remaining test failures
...
Former-commit-id: 37e607f9b13b6601ff52e74e613fb369cab22b56
2021-05-03 02:37:02 +00:00
John Sully
915ab02c5d
Fix issue where async load thread misses work
...
Former-commit-id: a24a7b093295c5f5d69feee9fbc37c64cfa8aa03
2021-04-30 18:48:23 +00:00
John Sully
f4159146c8
Fix majority of test issues with multithread load
...
Former-commit-id: 4db88176e33e3615ffb90852b49e76b12d5b4622
2021-04-30 18:45:37 +00:00
John Sully
3023bf4e6e
Initial implementation of multithread load
...
Former-commit-id: 87b0657c3acd7a3c89964afe1702851b44467c9a
2021-04-30 17:32:54 +00:00
John Sully
0c7589580d
Optimize freeMemory by lazy freeing objects
...
Former-commit-id: cca31ed5ee2f42975f0051cfabf1e88720b3d678
2021-04-21 01:20:13 +00:00
John Sully
0adcb82652
Better RocksDB perf tuning
...
Former-commit-id: cbe1e0a7c1b5dc49c1adff07b7c32042e673acf4
2021-04-21 01:19:44 +00:00
John Sully
da1360383c
Fix issue where we reply a dangling pointer
...
Former-commit-id: fd11e490c39fe876d979eace5eaec56c645cdfcf
2021-04-21 01:19:29 +00:00
John Sully
0441c4c1fa
_dictExpandIfNeeded is called too late to be useful
...
Former-commit-id: 7f75ca5d3a9ed47465bceb22f5f74fd6f0760008
2021-04-21 01:18:38 +00:00
John Sully
b2ffe82640
Allow prefetch even with a single thread
...
Former-commit-id: 2e68821b330a6bae8a352e37c3da643d504b2ce3
2021-04-12 04:44:52 +00:00
John Sully
211b0e5f80
Avoid posting unnecessary async tasks
...
Former-commit-id: 1661d2a05943f96992be195f5dc32dd9a67c0e68
2021-04-12 03:44:29 +00:00
John Sully
ea2bbfb5c1
Fix issue where GC is not free'd until a BGSAVE
...
Former-commit-id: 38523e6b508cf5f4b40c178dfe98554abea8f6bd
2021-04-12 03:44:15 +00:00
John Sully
14250faddd
Make prefetch more aggressive
...
Former-commit-id: 25a5cfefcf7fa3451e92500f5d310290c4b6bbde
2021-04-12 03:42:05 +00:00
John Sully
1b121723e2
Don't prefetch when lock contention is low, it increases latency
...
Former-commit-id: 0d21614e0e5aba28acd364231823d51a3073081f
2021-04-12 03:41:53 +00:00
John Sully
e6782d8f1b
Reduce P99 latency with async rehash
...
Former-commit-id: 7ea4c26fd82c0cdfa377183083f38a43336e480b
2021-04-12 03:39:13 +00:00
John Sully
df66c598e9
Make prefetch configurable
...
Former-commit-id: 3b660347d70cc25d57119080bd43fb4671e36488
2021-04-12 03:38:57 +00:00
John Sully
e541d82e1f
Make prefetch more aggressive
...
Former-commit-id: 9cb0be197fb96d7fb3cb697c19b5be313b01337a
2021-04-12 03:24:05 +00:00
John Sully
c070f6ece2
Don't prefetch when lock contention is low, it increases latency
...
Former-commit-id: 9b2629f6a20368cec8e55f0d006f3a67c8b770b7
2021-04-12 03:23:49 +00:00
John Sully
5b53c8e88e
Reduce P99 latency with async rehash
...
Former-commit-id: 6c045837c7cf92dc92be35465229b482e09e46d2
2021-04-12 03:22:22 +00:00
John Sully
d58a415e29
DO not set the timethread as high priority, it can starve the server threads
...
Former-commit-id: faeac65371af9d6b6effe0886bcbdefaec24ad6d
2021-04-09 01:06:24 +00:00
John Sully
9d0001ae7c
Make prefetch configurable
...
Former-commit-id: 16996c048042bd3799c8051645bbe7c54137d54c
2021-04-08 19:52:38 +00:00
John Sully
5d924bf16a
Avoid posting unnecessary async tasks
...
Former-commit-id: 08f63fdfd6c78388bba093ec2edda7d77fc9173e
2021-04-07 17:41:20 +00:00
John Sully
c0e80ffcda
Fix issue where GC is not free'd until a BGSAVE
...
Former-commit-id: e19350005b571591876e49219bfca75e905604a5
2021-04-07 17:30:59 +00:00
John Sully
86a5b2fbc7
Reduce connection latency for cluster clients
...
Former-commit-id: f1acee99bdaee4faf9e18cdf4734d51a73e78a41
2021-04-07 15:49:58 +00:00
John Sully
1bf5477602
Fix build break from merge conflicts
...
Former-commit-id: 5052388bd43b0e42430fd741fb2b403544684246
2021-04-07 15:25:22 +00:00
John Sully
d832ebb221
Merge branch 'keydbpro' of https://gitlab.eqalpha.com/external-collab/keydb-pro-6 into keydbpro_collab
...
Former-commit-id: e077756b140855cb5a7e60567abf845dbfbc162d
2021-04-07 15:14:59 +00:00
jsully
59a9e93abb
Merge branch 'flash_read_perf' into 'keydbpro'
...
Flash read perf
See merge request external-collab/keydb-pro-6!1
Former-commit-id: f6d7277f307b78f079dd99bf532cd26a7b62018d
2021-04-07 06:12:55 +00:00
Cloud User
6684f150d6
Make high pri time thread configurable
...
Former-commit-id: 7e94207765d2166f46792aea0919786f3f30d7b3
2021-04-06 22:39:20 +00:00
John Sully
f8cf5d3e88
Don't ensure if we don't have to
...
Former-commit-id: b7b678a3ada531890e67313c867b7b49b01fe41e
2021-04-01 18:17:05 +00:00
jsully
c6cea9d84f
Merge branch 'keydbpro' into 'flash_read_perf'
...
# Conflicts:
# src/db.cpp
# src/networking.cpp
Former-commit-id: e16c846b2b9e70f20981172287b19e585f81d73d
2021-04-01 17:25:31 +00:00
John Sully
57b242a5ba
Fix issue #300
...
Former-commit-id: bee7f398c9c3b4c01b687d26194913bf215dca36
2021-03-30 23:44:34 +00:00
John Sully
98f27709c6
Fix crash in RDB save
...
Former-commit-id: b032809b3e978fe571b791179d32ecdc9c067045
2021-03-30 20:49:33 +00:00
John Sully
e684e8707a
Merge branch 'keydbpro' of https://gitlab.eqalpha.com/keydb-dev/KeyDB-Pro into keydbpro
...
Former-commit-id: c4eefb1345209790e31b41401d1870473a401676
2021-03-30 20:44:36 +00:00
John Sully
32926467aa
Fix crash in RDB save
...
Former-commit-id: ef1e122fcb039d25f60752ca27c9feb5e8cfbb31
2021-03-30 20:44:22 +00:00
jsully
c8d4779375
Merge branch 'jesse/update-readme-build-instructions-default-branch' into 'keydbpro'
...
Add additional libraries that need to be installed for building pro
See merge request keydb-dev/KeyDB-Pro!17
Former-commit-id: d42c70048d4e4b7dd0ecc802742ff45f7c959b1c
2021-03-30 20:20:45 +00:00