gvsafronov/futriix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
27,435 Commits 1 Branch 0 Tags
Commit Graph

27 Commits

Author SHA1 Message Date
Malavan Sotheeswaran
3336c4f43e
Flash slot to key (#653) 
* add hash prefixing to rocksdb

* don't need to offset internal keys

* remove hashslot prefix when loading from rocksdb

* don't prefix internal keys

* implement slot to keys with rocksdb

* fix compile

* add hashslot enum to test storage provider

* add --flash option for tests

* forgot return statement in getKeysInSlot

* check for count mismatch

* forgot ;

* add assert to ensure correctness

* fix warnings

* add option to show logs of 1 server at a time

* add fixed length prefix extractor

* add machamp

* switch machamp to main branch

* add machamp script
 2023-05-30 01:01:40 -04:00
Malavan Sotheeswaran
d7c34a8ced
Properly handle case where we delete a key that doesn't exist while a write batch is active (#550) 2023-01-23 16:21:27 -05:00
John Sully
a6ab09cf7b Ensure we force moves not copies when ingesting bulk insert files 2022-05-04 16:51:48 +00:00
John Sully
343c47a935 Ensure recreated tables use the same settings as ones made at boot 2022-04-27 23:38:55 +00:00
John Sully
c10f6d9b51 Fix compile error on some machines 
Former-commit-id: 5f491a38cb7eae63fd316c465f317005bbced385
 2021-11-10 17:39:00 +00:00
John Sully
ce2c49899d Fix snapshot count mismatch due to race 
Former-commit-id: b4175c9bf82cbec047b94403e2a3700f4544b4f1
 2021-11-10 05:29:13 +00:00
John Sully
1ebf62da26 Initial implementation of snapshot fast replication. There are still a few TODOs in progress 
Former-commit-id: 0febdcdab8693af443f350968ed3d8c80106675d
 2021-11-09 19:36:07 +00:00
John Sully
e2000a6d3d Implement bulkInsert for rocksdb 
Former-commit-id: e9abae77d6ae18e21d7dac0cbdd563f572ac3d03
 2021-06-01 19:17:40 +00:00
John Sully
649745924b RocksDB Read Performance Improvements 
Former-commit-id: 80cca4869888e048e10e11f1f20796c482c3e5b3
 2020-08-09 23:36:20 +00:00
John Sully
17661f2382 Implement storage key cache, and writeback memory model 
Former-commit-id: 732bd9c153459f1174475ad67de36c399ddbe359
 2020-07-11 21:23:48 +00:00
John Sully
d2a29bf343 Fix race when we free an item before we finish writing to disk making it temporarily unavailable 
Former-commit-id: 6139cfee295261d0210f2af6217c2a23eeaf52b8
 2020-06-04 22:18:03 -04:00
John Sully
bb3314c0d9 Fix incorrect prefix comparison 
Former-commit-id: 1ef167546be0678edd457d65a5368e8706fde0a3
 2020-03-23 22:51:46 -04:00
John Sully
0381e728ab Fix incorrect count when loading FLASH 
Former-commit-id: 38ee9c0df144621f7ca750527e9efb16e754ef40
 2020-03-23 19:47:48 -04:00
John Sully
82e1ed482a Prevent bookkeeping keys from leaking through 
Former-commit-id: 1a5af28e115fc123bf250b4a80ac69232bb3add0
 2020-03-23 18:06:47 -04:00
John Sully
ebe0b918bc Cache count of keys in database 
Former-commit-id: 7cd266030ad82b5fddd4668d666adc95e1bed475
 2020-03-17 17:11:41 -04:00
John Sully
003bfb6a04 Tune rocksdb 
Former-commit-id: 95d91b1ff8c8080dfcbf59e51d3eff73d27dcfb5
 2020-02-17 21:50:45 -05:00
John Sully
a086023407 Fix race condition with IStorage batches 
Former-commit-id: a2eabd044c9048662a63ff0f980ed947dc145912
 2020-02-17 19:00:31 -05:00
John Sully
2f46f18c35 Perf remove extra lookup in rocksdb 
Former-commit-id: 8074472c7a25572a53f1166911920c2cb168c141
 2019-12-23 23:32:04 -05:00
John Sully
033eda6016 Key count is innacurate after overwrite 
Former-commit-id: 180c5a8e401415cede36548ab8d01f3e4ff8fb7f
 2019-12-22 19:41:36 -05:00
John Sully
b43dda66e7 Fix FLASH eviction issue, the algo relies on correct key count 
Former-commit-id: dc260a7f44fe197b9b0022d044d559be88bf91be
 2019-12-22 18:38:10 -05:00
John Sully
232cc7c566 Fix issue where DELETE always returns 1 when using FLASH 
Former-commit-id: 0574db59fdc740255388ae77d2ece8622898bb49
 2019-12-22 17:30:15 -05:00
John Sully
6a77ceaa4a Evicted flash no longer keeps the key around 
Former-commit-id: 908b303d1a8dd032c092f0bc035361a09c0291a5
 2019-12-20 17:45:07 -05:00
John Sully
ac8450b332 FLASH storage no longer keeps evicted keys in memory 
Former-commit-id: 65c2b47c895d57231bbd3f451ecf1f6d9871f5f7
 2019-12-19 17:30:31 -05:00
John Sully
c55904d9f4 Add support for multiple databases with rocksdb 
Former-commit-id: cfa3b760b00776876134692d42e25a60fcd8dea9
 2019-12-09 20:45:58 -05:00
John Sully
8f8f9b7a46 Flash running well 
Former-commit-id: 9cf393eb9fb69bcc7550cd8b83e1568b3f360310
 2019-12-08 20:06:22 -05:00
John Sully
5f481a206d Initial RocksDB integration 
Former-commit-id: 0de9e5b692c02e779e538ddd0a56d10215e501bb
 2019-12-06 20:39:32 -05:00
John Sully
0f5d2ccfe5 Initial standup of RocksDB dependency 
Former-commit-id: 19bb40ffdc794cf9cafa9f4132a0facf1e074101
 2019-12-06 17:33:18 -05:00