3f21705a6c
As discussed in PR #336. We have different types of resources like CPU, memory, network, etc. The `slowlog` can only record commands eat lots of CPU during the processing phase (doesn't include read/write network time), but can not record commands eat too many memory and network. For example: 1. run "SET key value(10 megabytes)" command would not be recored in slowlog, since when processing it the SET command only insert the value's pointer into db dict. But that command eats huge memory in query buffer and bandwidth from network. In this case, just 1000 tps can cause 10GB/s network flow. 2. run "GET key" command and the key's value length is 10 megabytes. The get command can eat huge memory in output buffer and bandwidth to network. This PR introduces a new command `COMMANDLOG`, to log commands that consume significant network bandwidth, including both input and output. Users can retrieve the results using `COMMANDLOG get <count> large-request` and `COMMANDLOG get <count> large-reply`, all subcommands for `COMMANDLOG` are: * `COMMANDLOG HELP` * `COMMANDLOG GET <count> <slow|large-request|large-reply>` * `COMMANDLOG LEN <slow|large-request|large-reply>` * `COMMANDLOG RESET <slow|large-request|large-reply>` And the slowlog is also incorporated into the commandlog. For each of these three types, additional configs have been added for control: * `commandlog-request-larger-than` and `commandlog-large-request-max-len` represent the threshold for large requests(the unit is Bytes) and the maximum number of commands that can be recorded. * `commandlog-reply-larger-than` and `commandlog-large-reply-max-len` represent the threshold for large replies(the unit is Bytes) and the maximum number of commands that can be recorded. * `commandlog-execution-slower-than` and `commandlog-slow-execution-max-len` represent the threshold for slow executions(the unit is microseconds) and the maximum number of commands that can be recorded. * Additionally, `slowlog-log-slower-than` and `slowlog-max-len` are now set as aliases for these two new configs. --------- Signed-off-by: zhaozhao.zz <zhaozhao.zz@alibaba-inc.com> Co-authored-by: Madelyn Olson <madelyneolson@gmail.com> Co-authored-by: Ping Xie <pingxie@outlook.com>
32 lines
823 B
JSON
32 lines
823 B
JSON
{
|
|
"LEN": {
|
|
"summary": "Returns the number of entries in the slow log.",
|
|
"complexity": "O(1)",
|
|
"group": "server",
|
|
"since": "2.2.12",
|
|
"arity": 2,
|
|
"container": "SLOWLOG",
|
|
"function": "slowlogCommand",
|
|
"deprecated_since": "8.1.0",
|
|
"replaced_by": "`COMMANDLOG LEN SLOW`",
|
|
"doc_flags": [
|
|
"DEPRECATED"
|
|
],
|
|
"command_flags": [
|
|
"ADMIN",
|
|
"LOADING",
|
|
"STALE"
|
|
],
|
|
"command_tips": [
|
|
"REQUEST_POLICY:ALL_NODES",
|
|
"RESPONSE_POLICY:AGG_SUM",
|
|
"NONDETERMINISTIC_OUTPUT"
|
|
],
|
|
"reply_schema": {
|
|
"type": "integer",
|
|
"description": "Number of entries in the slow log.",
|
|
"minimum": 0
|
|
}
|
|
}
|
|
}
|