gvsafronov/futriix
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
futriix/src
History
zhaozhao.zz 78bef6e1fe
optimize(remove) usage of client's pending_querybuf (#10413) 
To remove `pending_querybuf`, the key point is reusing `querybuf`, it means master client's `querybuf` is not only used to parse command, but also proxy to sub-replicas.

1. add a new variable `repl_applied` for master client to record how many data applied (propagated via `replicationFeedStreamFromMasterStream()`) but not trimmed in `querybuf`.

2. don't sdsrange `querybuf` in `commandProcessed()`, we trim it to `repl_applied` after the whole replication pipeline processed to avoid fragmented `sdsrange`. And here are some scenarios we cannot trim to `qb_pos`:
    * we don't receive complete command from master
    * master client blocked because of client pause
    * IO threads operate read, master client flagged with CLIENT_PENDING_COMMAND

    In these scenarios, `qb_pos` points to the part of the current command or the beginning of next command, and the current command is not applied yet, so the `repl_applied` is not equal to `qb_pos`.

Some other notes:
* Do not do big arg optimization on master client, since we can only sdsrange `querybuf` after data sent to replicas.
* Set `qb_pos` and `repl_applied` to 0 when `freeClient` in `replicationCacheMaster`.
* Rewrite `processPendingCommandsAndResetClient` to `processPendingCommandAndInputBuffer`, let `processInputBuffer` to be called successively after `processCommandAndResetClient`.
2022-03-25 10:45:40 +08:00
..
commands
Add new cluster shards command (#10293)
2022-03-15 18:24:40 -07:00
modules
Add 'Available since' to module API function docs (#10229)
2022-02-03 10:25:37 +02:00
.gitignore
…
acl.c
Add new RM_Call flags for script mode, no writes, and error replies. (#10372)
2022-03-22 14:13:28 +02:00
adlist.c
Free value if dup succeed but listAddNodeTail failed. (#8901)
2021-05-03 13:39:07 +03:00
adlist.h
Speedup: unblock clients on keys in O(1).
2020-04-08 12:55:57 +02:00
ae_epoll.c
Fail fast when systemic error occurs in poll (#8749)
2021-04-26 15:52:06 +03:00
ae_evport.c
Fix cluster bus extensions backwards compatibility (#10206)
2022-01-30 19:43:37 +02:00
ae_kqueue.c
Fix the timing of read and write events under kqueue (#9416)
2021-09-02 11:07:51 +03:00
ae_select.c
Fail fast when systemic error occurs in poll (#8749)
2021-04-26 15:52:06 +03:00
ae.c
Add event loop support to the module API (#10001)
2022-01-18 13:10:07 +02:00
ae.h
Add event loop support to the module API (#10001)
2022-01-18 13:10:07 +02:00
anet.c
Fix some nonsense came from LGTM (#9962)
2021-12-19 17:52:23 +02:00
anet.h
Implement anetPipe() to combine creating pipe and setting flags (#9511)
2021-10-06 16:08:13 +03:00
aof.c
Add stream consumer group lag tracking and reporting (#9127)
2022-02-23 22:34:58 +02:00
asciilogo.h
Changes http to https in texts (#8495)
2021-03-10 19:11:16 +02:00
atomicvar.h
Several (mostly Solaris-related) cleanups (#8171)
2020-12-13 17:09:54 +02:00
bio.c
Delete unused 'time' fields from struct bio_job (#9622)
2021-10-10 08:17:54 +03:00
bio.h
Delete some unimplemented prototype. (#8882)
2021-04-29 08:25:10 +03:00
bitops.c
BITSET and BITFIELD SET should propagate even if just length changed (#10459)
2022-03-21 11:33:27 +02:00
blocked.c
optimize(remove) usage of client's pending_querybuf (#10413)
2022-03-25 10:45:40 +08:00
call_reply.c
Add new RM_Call flags for script mode, no writes, and error replies. (#10372)
2022-03-22 14:13:28 +02:00
call_reply.h
Add new RM_Call flags for script mode, no writes, and error replies. (#10372)
2022-03-22 14:13:28 +02:00
childinfo.c
Implement anetPipe() to combine creating pipe and setting flags (#9511)
2021-10-06 16:08:13 +03:00
cli_common.c
Fix typo "the the" (#10399)
2022-03-09 13:55:17 +02:00
cli_common.h
redis-cli: Better --json Unicode support and --quoted-json (#10286)
2022-03-05 21:25:52 +02:00
cluster.c
Fix timing issue in shards test and fix displayed TLS port (#10450)
2022-03-20 22:08:40 -07:00
cluster.h
Add new cluster shards command (#10293)
2022-03-15 18:24:40 -07:00
commands.c
Add new cluster shards command (#10293)
2022-03-15 18:24:40 -07:00
config.c
config rewrite enhancement, in case of line longer than 1024 (#8009)
2022-03-22 16:34:01 +08:00
config.h
Check somaxconn system settings on macOS, FreeBSD and OpenBSD. (#9972)
2021-12-28 09:20:10 +02:00
connection.c
Reduce system calls of write for client->reply by introducing writev (#9934)
2022-02-22 14:00:37 +02:00
connection.h
Reduce system calls of write for client->reply by introducing writev (#9934)
2022-02-22 14:00:37 +02:00
connhelpers.h
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
crc16_slottable.h
…
crc16.c
…
crc64.c
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
crc64.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
crcspeed.c
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
crcspeed.h
Added crcspeed library
2020-04-24 17:11:21 -07:00
db.c
XREADGROUP: Unblock client if stream is deleted (#10306)
2022-03-08 17:10:36 +02:00
debug.c
crash log, print killer pid only when si_code is SI_USER (#10454)
2022-03-22 17:37:34 +02:00
debugmacro.h
Supplement define guards to prevent multiple inclusion (#10246)
2022-02-06 20:13:34 -08:00
defrag.c
fix typos (#10402)
2022-03-09 13:58:23 +02:00
dict.c
Fix some nonsense came from LGTM (#9962)
2021-12-19 17:52:23 +02:00
dict.h
Fix possible int overflow when hashing an sds. (#9916)
2021-12-13 21:16:25 +02:00
endianconv.c
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
endianconv.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
eval.c
Sort out the mess around Lua error messages and error stats (#10329)
2022-02-27 13:40:57 +02:00
evict.c
use startEvictionTimeProc() in config set maxmemory (#10019)
2022-01-04 13:08:10 +02:00
expire.c
sub-command support for ACL CAT and COMMAND LIST. redisCommand always stores fullname (#10127)
2022-01-23 10:05:06 +02:00
fmacros.h
Fix failed tests on Linux Alpine and add a CI job. (#8532)
2021-02-23 12:57:45 +02:00
function_lua.c
Sort out the mess around Lua error messages and error stats (#10329)
2022-02-27 13:40:57 +02:00
functions.c
update function help message, changed DESC->DESCRIPTION. (#10228)
2022-02-02 15:50:41 +02:00
functions.h
Function Flags support (no-writes, no-cluster, allow-state, allow-oom) (#10066)
2022-01-14 14:02:02 +02:00
geo.c
Fix some nonsense came from LGTM (#9962)
2021-12-19 17:52:23 +02:00
geo.h
…
geohash_helper.c
Fix geo search bounding box check causing missing results (#10018)
2022-02-21 08:06:58 +02:00
geohash_helper.h
Delete some unimplemented prototype. (#8882)
2021-04-29 08:25:10 +03:00
geohash.c
FIX: truncate max/min longitude,latitude related geo_point (ex: {180, 85.05112878} )
2020-04-09 17:48:29 +08:00
geohash.h
Remove duplicate header file include (#10264)
2022-02-08 16:49:47 +02:00
help.h
update redis-cli help.h (#10352)
2022-02-28 10:59:16 +02:00
hyperloglog.c
Sort out the mess around writable replicas and lookupKeyRead/Write (#9572)
2021-11-28 11:26:28 +02:00
intset.c
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
intset.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
latency.c
sub-command support for ACL CAT and COMMAND LIST. redisCommand always stores fullname (#10127)
2022-01-23 10:05:06 +02:00
latency.h
Disable THP if enabled (#7381)
2020-10-27 15:04:18 +02:00
lazyfree.c
Redis Function Libraries (#10004)
2022-01-06 13:39:38 +02:00
listpack_malloc.h
Optimize listpack for stream usage to avoid repeated reallocs (#6281)
2021-02-16 16:17:38 +02:00
listpack.c
fix typos (#10402)
2022-03-09 13:58:23 +02:00
listpack.h
Replace ziplist with listpack in quicklist (#9740)
2021-11-24 13:34:13 +02:00
localtime.c
fix typos (#10402)
2022-03-09 13:58:23 +02:00
lolwut5.c
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
lolwut6.c
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
lolwut.c
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
lolwut.h
add include guard for lolwut.h
2020-05-05 23:35:08 -04:00
lzf_c.c
Change lzf to handle values larger than UINT32_MAX (#9776)
2021-11-16 13:12:25 +02:00
lzf_d.c
Change lzf to handle values larger than UINT32_MAX (#9776)
2021-11-16 13:12:25 +02:00
lzf.h
Change lzf to handle values larger than UINT32_MAX (#9776)
2021-11-16 13:12:25 +02:00
lzfP.h
Change lzf to handle values larger than UINT32_MAX (#9776)
2021-11-16 13:12:25 +02:00
Makefile
Build commands.c in Makefile (#10039)
2022-01-06 17:59:37 +02:00
memtest.c
Add sanitizer support and clean up sanitizer findings (#9601)
2021-11-11 13:51:33 +02:00
mkreleasehdr.sh
Update mkreleasehdr.sh
2019-11-19 17:23:47 +08:00
module.c
Add new RM_Call flags for script mode, no writes, and error replies. (#10372)
2022-03-22 14:13:28 +02:00
monotonic.c
Use H/W Monotonic clock and updates to AE (#7644)
2020-08-28 11:54:10 +03:00
monotonic.h
Use H/W Monotonic clock and updates to AE (#7644)
2020-08-28 11:54:10 +03:00
mt19937-64.c
Fix random element selection for large hash tables. (#8133)
2020-12-23 15:52:07 +02:00
mt19937-64.h
Fix random element selection for large hash tables. (#8133)
2020-12-23 15:52:07 +02:00
multi.c
Sort out the mess around Lua error messages and error stats (#10329)
2022-02-27 13:40:57 +02:00
networking.c
optimize(remove) usage of client's pending_querybuf (#10413)
2022-03-25 10:45:40 +08:00
notify.c
Fixed some typos, add a spell check ci and others minor fix (#8890)
2021-06-10 15:39:33 +03:00
object.c
Implement Multi Part AOF mechanism to avoid AOFRW overheads. (#9788)
2022-01-03 19:14:13 +02:00
pqsort.c
…
pqsort.h
…
pubsub.c
Sharded pubsub implementation (#8621)
2022-01-02 16:54:47 -08:00
quicklist.c
Fix quicklist node not being recompressed correctly after inserting a new node before or after it (#10120)
2022-01-16 08:54:40 +02:00
quicklist.h
Fix recent daily CI test failures (#9966)
2021-12-20 12:31:13 +02:00
rand.c
…
rand.h
…
rax_malloc.h
…
rax.c
fix typos (#10402)
2022-03-09 13:58:23 +02:00
rax.h
Squash merging 125 typo/grammar/comment/doc PRs (#7773)
2020-09-10 13:43:38 +03:00
rdb.c
Add stream consumer group lag tracking and reporting (#9127)
2022-02-23 22:34:58 +02:00
rdb.h
Add stream consumer group lag tracking and reporting (#9127)
2022-02-23 22:34:58 +02:00
redis-benchmark.c
Fix redis-benchmark --cluster with IPv6. (#10393)
2022-03-08 13:10:24 +02:00
redis-check-aof.c
Fix path copy error and add more logs. (#10324)
2022-02-22 10:09:34 +02:00
redis-check-rdb.c
Added functions support to redis-check-rdb (#10154)
2022-01-20 11:10:33 +02:00
redis-cli.c
Use exit code 1 if redis-cli fails to connect (#10438)
2022-03-21 13:40:02 +02:00
redis-trib.rb
…
redisassert.c
Add sanitizer support and clean up sanitizer findings (#9601)
2021-11-11 13:51:33 +02:00
redisassert.h
Sanitize dump payload: performance optimizations and tuning
2020-12-06 14:54:34 +02:00
redismodule.h
Add module API for redacting command arguments (#10425)
2022-03-15 18:21:13 -07:00
release.c
Speedup INFO server section.
2019-10-02 11:30:20 +02:00
replication.c
optimize(remove) usage of client's pending_querybuf (#10413)
2022-03-25 10:45:40 +08:00
resp_parser.c
Unified Lua and modules reply parsing and added RESP3 support to RM_Call (#9202)
2021-08-04 16:28:07 +03:00
resp_parser.h
Unified Lua and modules reply parsing and added RESP3 support to RM_Call (#9202)
2021-08-04 16:28:07 +03:00
rio.c
Fix when the master connection is disconnected, replication retry read indefinitely (#10032)
2021-12-31 14:08:04 +02:00
rio.h
diskless replication rdb transfer uses pipe, and writes to sockets form the parent process.
2019-10-07 21:06:30 +03:00
script_lua.c
Sort out the mess around Lua error messages and error stats (#10329)
2022-02-27 13:40:57 +02:00
script_lua.h
Sort out the mess around Lua error messages and error stats (#10329)
2022-02-27 13:40:57 +02:00
script.c
Add new RM_Call flags for script mode, no writes, and error replies. (#10372)
2022-03-22 14:13:28 +02:00
script.h
Support function flags in script EVAL via shebang header (#10126)
2022-01-24 16:50:02 +02:00
sds.c
Fix additional AOF filename issues. (#10110)
2022-01-18 12:52:27 +02:00
sds.h
Fix additional AOF filename issues. (#10110)
2022-01-18 12:52:27 +02:00
sdsalloc.h
Sanitize dump payload: fail RESTORE if memory allocation fails
2020-12-06 14:54:34 +02:00
sentinel.c
Sentinel: update command json files (#10374)
2022-03-15 18:38:07 +02:00
server.c
optimize(remove) usage of client's pending_querybuf (#10413)
2022-03-25 10:45:40 +08:00
server.h
optimize(remove) usage of client's pending_querybuf (#10413)
2022-03-25 10:45:40 +08:00
setcpuaffinity.c
cpu affinity: DragonFlyBSD support (#7956)
2020-10-25 14:14:05 +02:00
setproctitle.c
Fix failed tests on Linux Alpine and add a CI job. (#8532)
2021-02-23 12:57:45 +02:00
sha1.c
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
sha1.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
sha256.c
Add sanitizer support and clean up sanitizer findings (#9601)
2021-11-11 13:51:33 +02:00
sha256.h
fix explanation of sha256 (#9220)
2021-07-10 10:04:54 -05:00
siphash.c
Add sanitizer support and clean up sanitizer findings (#9601)
2021-11-11 13:51:33 +02:00
slowlog.c
slowlog get command supports passing in -1 to get all logs. (#9018)
2021-06-14 16:46:45 +03:00
slowlog.h
Auto-generate the command table from JSON files (#9656)
2021-12-15 21:23:15 +02:00
solarisfixes.h
…
sort.c
make sort/ro commands validate external keys access patterns (#10106) (#10340)
2022-03-15 17:14:53 +02:00
sparkline.c
Squash merging 125 typo/grammar/comment/doc PRs (#7773)
2020-09-10 13:43:38 +03:00
sparkline.h
…
stream.h
Add stream consumer group lag tracking and reporting (#9127)
2022-02-23 22:34:58 +02:00
syncio.c
…
t_hash.c
sub-command support for ACL CAT and COMMAND LIST. redisCommand always stores fullname (#10127)
2022-01-23 10:05:06 +02:00
t_list.c
sub-command support for ACL CAT and COMMAND LIST. redisCommand always stores fullname (#10127)
2022-01-23 10:05:06 +02:00
t_set.c
Sort out the mess around writable replicas and lookupKeyRead/Write (#9572)
2021-11-28 11:26:28 +02:00
t_stream.c
Fix XGROUP HELP message missing a newline (#10339)
2022-02-24 08:31:39 +02:00
t_string.c
sub-command support for ACL CAT and COMMAND LIST. redisCommand always stores fullname (#10127)
2022-01-23 10:05:06 +02:00
t_zset.c
Fix an off by one error in zzlStrtod (#10465)
2022-03-22 10:46:16 +02:00
testhelp.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
timeout.c
Add missing calls to raxStop (#7532)
2020-07-21 08:13:05 +03:00
tls.c
Reduce system calls of write for client->reply by introducing writev (#9934)
2022-02-22 14:00:37 +02:00
tracking.c
ACL V2 - Selectors and key based permissions (#9974)
2022-01-20 13:05:27 -08:00
util.c
improve string2ll() to avoid extra conversion for long integer string. (#10408)
2022-03-14 08:22:57 +02:00
util.h
improve string2ll() to avoid extra conversion for long integer string. (#10408)
2022-03-14 08:22:57 +02:00
valgrind.sup
Sanitize dump payload: fuzz tester and fixes for segfaults and leaks it exposed
2020-12-06 14:54:34 +02:00
version.h
Add Module API for version and compatibility checks (#7865)
2020-10-11 17:21:58 +03:00
ziplist.c
fix typos (#10402)
2022-03-09 13:58:23 +02:00
ziplist.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
zipmap.c
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
zipmap.h
Add --large-memory flag for REDIS_TEST to enable tests that consume more than 100mb (#9784)
2021-11-16 08:55:10 +02:00
zmalloc.c
zmalloc_get_rss openbsd implementation (#10149)
2022-01-19 20:56:12 +02:00
zmalloc.h
Added INFO LATENCYSTATS section: latency by percentile distribution/latency by cumulative distribution of latencies (#9462)
2022-01-05 14:01:05 +02:00