SlateDB Files

What's Changed

• cache l0 SSTs on write by @rodesai in https://github.com/slatedb/slatedb/pull/528
• fix: clippy error type too large by @KrishnaSindhur in https://github.com/slatedb/slatedb/pull/556
• [bug] db_options.flush_interval=None broken by @sush-abc in https://github.com/slatedb/slatedb/pull/548
• fix(compaction): filter tombstones out when compacting into the last sorted run by @KaguraMilet in https://github.com/slatedb/slatedb/pull/307
• chore: Remove unnecessary clones by @caicancai in https://github.com/slatedb/slatedb/pull/560
• Verify that compression works without panics by @criccomini in https://github.com/slatedb/slatedb/pull/561
• chore: Remove duplicate references by @caicancai in https://github.com/slatedb/slatedb/pull/562
• refactor(snapshot): add max_seq in scan by @flaneur2020 in https://github.com/slatedb/slatedb/pull/536
• chore: Fix typo by @caicancai in https://github.com/slatedb/slatedb/pull/563
• RFC: Settings vs components by @calavera in https://github.com/slatedb/slatedb/pull/559
• chore: housekeeping by @ben1009 in https://github.com/slatedb/slatedb/pull/557
• chore: add comment about last_wal_id and wal_id_last_compacted by @flaneur2020 in https://github.com/slatedb/slatedb/pull/565
• chore: Add memtable track last_seq test by @caicancai in https://github.com/slatedb/slatedb/pull/568
• Separate WAL RFC by @taburet in https://github.com/slatedb/slatedb/pull/533
• Retry writer/compactor epoch bump on ManifestVersionExists errors by @hachikuji in https://github.com/slatedb/slatedb/pull/570
• feat: Db builder API. by @calavera in https://github.com/slatedb/slatedb/pull/567
• Make shutdown manifest conflict logs less scary by @criccomini in https://github.com/slatedb/slatedb/pull/572
• refactor: Extract bencher, cli, and bytes-generator to independent crates by @calavera in https://github.com/slatedb/slatedb/pull/554
• Decompress block bytes before decoding by @criccomini in https://github.com/slatedb/slatedb/pull/575
• refactor(wal): skip entries with seq that lower than last_l0_seq on replaying by @flaneur2020 in https://github.com/slatedb/slatedb/pull/569
• Fixing nightly perf tests by @criccomini in https://github.com/slatedb/slatedb/pull/578
• chore(deps): upgrade foyer to v0.17.2 by @MrCroxx in https://github.com/slatedb/slatedb/pull/580
• Initial support for separate WAL object store by @taburet in https://github.com/slatedb/slatedb/pull/558
• doc: fix contributing guide nextest script by @MrCroxx in https://github.com/slatedb/slatedb/pull/581
• fix(gc): Reimplement the garbage collector without crossbeam. by @calavera in https://github.com/slatedb/slatedb/pull/579
• fix(gc): Check the cancellation token before starting any gc tasks. by @calavera in https://github.com/slatedb/slatedb/pull/583
• fix(foyer): bump to foyer v0.17.3 to fix recovery by @MrCroxx in https://github.com/slatedb/slatedb/pull/584
• Centralize RNG logic and add deterministic seeding support by @criccomini in https://github.com/slatedb/slatedb/pull/585
• Add Clippy checks for rand RNGs by @criccomini in https://github.com/slatedb/slatedb/pull/587
• [hotfix] Remove statement discouraging production use. by @dmvk in https://github.com/slatedb/slatedb/pull/588
• Add timeout for Manifest updates by @pragmaticanon in https://github.com/slatedb/slatedb/pull/590
• feat(checkpoint): always force flush on creating a Checkpoint by @flaneur2020 in https://github.com/slatedb/slatedb/pull/589
• support patch releases after main has advanced by @rodesai in https://github.com/slatedb/slatedb/pull/582
• Track last_key in DbIterator by @pragmaticanon in https://github.com/slatedb/slatedb/pull/594
• fix docstrings about manifest poll interval by @rodesai in https://github.com/slatedb/slatedb/pull/598
• Fix flaky test_compactor_compacts_l0 by @criccomini in https://github.com/slatedb/slatedb/pull/597
• Fix race condition in compaction executor by @criccomini in https://github.com/slatedb/slatedb/pull/599
• Add LogicalClock and SystemClock clocks by @criccomini in https://github.com/slatedb/slatedb/pull/601
• Use SystemClock instead of std::time by @criccomini in https://github.com/slatedb/slatedb/pull/603
• Add binary search to SstIterator::seek by @meox3259 in https://github.com/slatedb/slatedb/pull/545
• Add Admin and AdminBuilder by @criccomini in https://github.com/slatedb/slatedb/pull/610
• Add DbRand to allow injectable randomness by @criccomini in https://github.com/slatedb/slatedb/pull/611
• Update benchmark-db.sh location by @emmanuel-ferdman in https://github.com/slatedb/slatedb/pull/612
• Configurable block size by @Barre in https://github.com/slatedb/slatedb/pull/605
• Clean up SST file if writer is fenced by @pragmaticanon in https://github.com/slatedb/slatedb/pull/608
• Fix test_memtable_flush_cleanup_when_fenced so it doesn't fail by @criccomini in https://github.com/slatedb/slatedb/pull/614
• Log async backtraces after test timeouts by @benesch in https://github.com/slatedb/slatedb/pull/363
• Support projections in the manifest by @dmvk in https://github.com/slatedb/slatedb/pull/593
• Fix clippy and compile failures on main by @criccomini in https://github.com/slatedb/slatedb/pull/615
• Add GarbageCollectorBuilder and make GarbageCollector non-static by @criccomini in https://github.com/slatedb/slatedb/pull/613
• Move GC tokio_handle to start_in_bg_thread by @criccomini in https://github.com/slatedb/slatedb/pull/616
• [hotfix] Fix flaky test test_seek_fast_forwards_iterator. by @dmvk in https://github.com/slatedb/slatedb/pull/617
• disable the db compactor for the compactor state tests by @rodesai in https://github.com/slatedb/slatedb/pull/619
• feat(wal): add a wal buffer manager; support dirty read semantics in RFC-008 by @flaneur2020 in https://github.com/slatedb/slatedb/pull/519
• Add python binding by @jiaoew1991 in https://github.com/slatedb/slatedb/pull/621
• Add Python binding to CI and add a README.md by @criccomini in https://github.com/slatedb/slatedb/pull/622
• Only add the pyo3/extension-module feature for non-Mac arch's by @criccomini in https://github.com/slatedb/slatedb/pull/624
• Add manifest::projected and manifest::union methods. by @dmvk in https://github.com/slatedb/slatedb/pull/618
• Make CheckpointScope::All visible to the users. by @dmvk in https://github.com/slatedb/slatedb/pull/625
• fix: set Memory as the default of ReadOptions.durability_filter by @flaneur2020 in https://github.com/slatedb/slatedb/pull/626
• fix(wal): flaky test case test_should_recover_imm_from_wal_after_flush_error by @flaneur2020 in https://github.com/slatedb/slatedb/pull/629
• Add CompactorBuilder and make Compactor async by @criccomini in https://github.com/slatedb/slatedb/pull/620
• fix(wal): track db fatal when wal flusher got unrecoverable error by @flaneur2020 in https://github.com/slatedb/slatedb/pull/631
• Add more functions to the Python binding by @jiaoew1991 in https://github.com/slatedb/slatedb/pull/627
• Fix random test_apply_wal_memory_backpressure failures by @criccomini in https://github.com/slatedb/slatedb/pull/637
• Use DbRand to generate UUIDs and ULIDs by @criccomini in https://github.com/slatedb/slatedb/pull/633
• Remove race conditions from maybe_apply_backpressure by @criccomini in https://github.com/slatedb/slatedb/pull/640
• Add SlateDBReader and SlateDBAdmin classes to Python bindings by @jiaoew1991 in https://github.com/slatedb/slatedb/pull/642
• Use DB's fatal error state if it's set when a channel send fails by @criccomini in https://github.com/slatedb/slatedb/pull/628
• chore: add an estimated wal bytes & flushes stats about wal buffer by @flaneur2020 in https://github.com/slatedb/slatedb/pull/643
• Insulate compactor from executor async runtimes by @criccomini in https://github.com/slatedb/slatedb/pull/641
• Remove GarbageCollector::start_in_bg_thread by @criccomini in https://github.com/slatedb/slatedb/pull/632
• Disable cache for WAL replay iterator by @criccomini in https://github.com/slatedb/slatedb/pull/644
• Fix sporadic failure by @criccomini in https://github.com/slatedb/slatedb/pull/649
• test: let test_get_after_put to use explicit options instead of defaults by @flaneur2020 in https://github.com/slatedb/slatedb/pull/652
• Default to Foyer cache and 256MiB max_sst_size by @criccomini in https://github.com/slatedb/slatedb/pull/655
• Replace broken toml-editor action with sed by @criccomini in https://github.com/slatedb/slatedb/pull/656

New Contributors

• @KrishnaSindhur made their first contribution in https://github.com/slatedb/slatedb/pull/556
• @caicancai made their first contribution in https://github.com/slatedb/slatedb/pull/560
• @ben1009 made their first contribution in https://github.com/slatedb/slatedb/pull/557
• @meox3259 made their first contribution in https://github.com/slatedb/slatedb/pull/545
• @emmanuel-ferdman made their first contribution in https://github.com/slatedb/slatedb/pull/612
• @Barre made their first contribution in https://github.com/slatedb/slatedb/pull/605
• @jiaoew1991 made their first contribution in https://github.com/slatedb/slatedb/pull/621

Full Changelog: https://github.com/slatedb/slatedb/compare/v0.6.1...v0.7.0