27437 Commits

Author SHA1 Message Date
Karthick Ariyaratnam
57f4a2e8b1
Fix a bug where flash CF options are being reset to default after flushall. (#718)
Co-authored-by: Karthick Ariyaratnam (A) <k00809413@china.huawei.com>
Co-authored-by: Malavan Sotheeswaran <105669860+msotheeswaran-sc@users.noreply.github.com>
2023-09-28 21:00:28 -04:00
Malavan Sotheeswaran
38169682f0
Merge latest internal to OSS (#720)
* add docker build

* fix the working dir in Dockerfile

* add release publish docker image

* address intentation and use default release

* migrate keydb_modstatsd to keydb-internal

* rm

* add submodule cpp-statsd-client

* include trigger keydb_modstatsd Makefile in modules Makefile

* update

* have clean also trigger keydb_modstatsd clean

* move cpp-statsd-client to deps

* checkout to a06a5b9359f31d946fe163b9038586982971ae49

* update relative path in compilation

* remove submodule instead use the source

* include building keydb statsd module

* fix check in Dockerfile docker-entrypoint.sh

* fix

* fix the comment caused stuck docker build

* use commit hash as tag template

* fix

* test tag

* Revert "test tag"

This reverts commit 9cbc57137d57aab4fdd5a9283bae07391b3c7f8b.

* make docker build independent

* add new build to ci

* emit system free metrics with '/proc/meminfo'

* have emit system free memory within metrics_time_taken_us and also add metric time taken for it

* Remove Expireset (#217)

Major refactor to place expiry information directly in the object struct.

* update MemFree to MemAvailable in keydb statsd

* add metric emit for non-empty primary with less than 2 connected replicas

* address comments

* Multiply CPU percent metric by 100

* Fix memory leaks

* Fix slow to free when low lock contention

* fix nodename metricsname

* fix unnecessary replace

* Make propagating before freeing module context optional (#225)

* don't propogate on module context free for rdb load

* default in wrong place

* Flash expiration (#197)

Design Doc: https://docs.google.com/document/d/1NmnYGnHLdZp-KOUCUatX5iXpF-L3YK4VUc9Lm3Tqxpo/edit?usp=sharing

* Emit more aggregate metrics in modstatsd (#223)

* Permit keys of differing slots as long as they are served by this cluster and we are not migrating

* Fix over pessimistic checks that prevent replicas from serving mget

* Fix logic bug

* async rehash is preventing rehashing during RDB load after a db flush.  Ensure it can't interefere after a flush

* make async rehash configurable

* only use internal locks when multithreaded (#205)

* Fix crossslot error migrating batches of keys

* Fix bug where we erroneously answer queries belonging to another shard

* fix mac compile

* enable level_compaction_dynamic_level_bytes after flush, and flush expires for FLASH (#229)

* enable level_compaction_dynamic_level_bytes after flush, and flush expires

* update debug reload for flash

* update debug reload for flash complete

* missing forward declare

* commit existing changes then track changes for debug reload

* missing args

* commitChanges is conditional

Co-authored-by: John Sully <jsully@snapchat.com>

---------

Co-authored-by: zliang <zliang@snapchat.com>
Co-authored-by: John Sully <jsully@snapchat.com>
Co-authored-by: Alex Cope <acope@snapchat.com>
Co-authored-by: John Sully <john@csquare.ca>
2023-09-28 18:13:27 -04:00
a00817524
5f5753ae53 build failure 2023-09-17 19:06:00 -04:00
a00817524
e42d83d208 build failure 2023-09-17 19:06:00 -04:00
a00817524
9c32d4c1c8 removed proc call 2023-09-17 19:06:00 -04:00
a00817524
337eb297a1 review rework 2023-09-17 19:06:00 -04:00
a00817524
cf13e7b594 Async FLASH Design: AE event loop changes to understand StorageToken 2023-09-17 19:06:00 -04:00
Malavan Sotheeswaran
441b74a936 Merge remote-tracking branch 'origin/main' 2023-07-25 21:44:27 -07:00
Alex Cope
ce70e8cd0c revert 2023-07-25 21:35:17 -07:00
Alex Cope
e3a1ea3928 with config 2023-07-25 21:34:50 -07:00
Rolf Ahrenberg
a464a7173d Use tini in Alpine-based Docker image (#682) 2023-07-25 21:33:30 -07:00
Karthick Ariyaratnam (A)
806175df99 Fix a fug where repl-backlog-size config was modifed in keydb.conf with the runtime value during config rewrite. 2023-07-25 21:33:30 -07:00
Karthick Ariyaratnam
bcb542128a Fix a bug where a temp rdb file with zero bytes is generated in flash mode. (#696)
Co-authored-by: Karthick Ariyaratnam (A) <k00809413@china.huawei.com>
2023-07-25 21:33:30 -07:00
Ikko Eltociear Ashimine
870b0db23d Fix typo in module.cpp (#686)
comparision -> comparison
2023-07-25 21:33:30 -07:00
Philipp Trulson
a4c19e3430 Enable KeyDB FLASH in Docker images (#687) 2023-07-25 21:33:30 -07:00
Pim van den Broek
9a8a36e8ee Fix redis-cli symlink (#689) 2023-07-25 21:33:30 -07:00
John Sully
aef01878a5 Build break fix 2023-07-25 21:32:52 -07:00
John Sully
bd6eb379d5 Prevent crash on free when using repl-disk-buffer-reserve (#207) 2023-07-25 21:32:52 -07:00
John Sully
06a49a6179 Fix OOM issues during full sync when fork bgsave is used (#209) 2023-07-25 21:32:52 -07:00
John Sully
9ab1278cf1 Prevent a deadlock when running CLIENT KILL with large numbers of clients (#206) 2023-07-25 21:32:52 -07:00
Alex Cope
cc8ed88577 nullptr 2023-07-25 21:32:52 -07:00
Alex Cope
0d2f98d6e1 fix compile error 2023-07-25 21:32:52 -07:00
Alex Cope
872c60566f use enum class 2023-07-25 21:32:52 -07:00
Alex Cope
b5a20a4f91 modify 2023-07-25 21:32:52 -07:00
Alex Cope
cf4735b61e ok 2023-07-25 21:32:52 -07:00
Alex Cope
b2ecf2c856 fix 2023-07-25 21:32:52 -07:00
Alex Cope
e80aba694c fix 2023-07-25 21:32:52 -07:00
Alex Cope
f774a17d8a fix 2023-07-25 21:32:52 -07:00
Alex Cope
329bf17e97 fix 2023-07-25 21:32:52 -07:00
Alex Cope
4da21dd328 clean 2023-07-25 21:32:52 -07:00
Alex Cope
3792ffb580 fix 2023-07-25 21:32:52 -07:00
Alex Cope
271c2cb92c meminfo 2023-07-25 21:32:52 -07:00
Alex Cope
4c0cf9e5cd fix 2023-07-25 21:32:52 -07:00
Alex Cope
e3cdc765a1 fix 2023-07-25 21:32:52 -07:00
Alex Cope
60d74262dc fixes 2023-07-25 21:32:52 -07:00
Alex Cope
65b7fafd29 llu 2023-07-25 21:32:52 -07:00
Alex Cope
ac7e6c0691 fix compiler errors 2023-07-25 21:32:52 -07:00
Alex Cope
87012bf98e update sys free 2023-07-25 21:32:52 -07:00
Alex Cope
1dc5ea40f3 update 2023-07-25 21:32:51 -07:00
Alex Cope
22d5ce41f3 update 2023-07-25 21:32:51 -07:00
Alex Cope
c9d63c50c0 update 2023-07-25 21:32:51 -07:00
Alex Cope
39e3141a0a revert 2023-07-25 21:32:51 -07:00
Alex Cope
1f2c179124 with config 2023-07-25 21:32:24 -07:00
Alex Cope
4c3d9341fd port changes to 6.3 2023-07-25 21:31:42 -07:00
Rolf Ahrenberg
821b39acac
Use tini in Alpine-based Docker image (#682) 2023-07-26 00:20:41 -04:00
John Sully
c2c831dc53 Build break fix 2023-07-14 19:49:46 +00:00
John Sully
bef77862e7 Prevent crash on free when using repl-disk-buffer-reserve (#207) 2023-07-14 14:39:23 -04:00
John Sully
d552fd01e1 Fix OOM issues during full sync when fork bgsave is used (#209) 2023-07-14 14:39:09 -04:00
John Sully
c0177198a8 Prevent a deadlock when running CLIENT KILL with large numbers of clients (#206) 2023-07-14 14:38:39 -04:00
Karthick Ariyaratnam (A)
0d01b810c3 Fix a fug where repl-backlog-size config was modifed in keydb.conf with the runtime value during config rewrite. 2023-07-14 13:12:16 -04:00