SlateDB Files

What's Changed

• add distributed compaction blog post by @agavra in https://github.com/slatedb/slatedb/pull/1929
• [rfc-30 2/N]: add traits for WAL iteration and update replay paths by @rodesai in https://github.com/slatedb/slatedb/pull/1976
• disallow clone with projection when WAL must be copied by @rodesai in https://github.com/slatedb/slatedb/pull/1984
• Clarify TTL millisecond units by @criccomini in https://github.com/slatedb/slatedb/pull/1989
• remove notifiers from WalBuffer by @rodesai in https://github.com/slatedb/slatedb/pull/1987
• Remove await_durable from WriteOptions by @criccomini in https://github.com/slatedb/slatedb/pull/1985
• test(dst): vary scan options by @bowenli86 in https://github.com/slatedb/slatedb/pull/1952
• Add cooperative yield points to SST build and compaction merge loops by @sorenbs in https://github.com/slatedb/slatedb/pull/1964
• Increase default GC interval to 10 minutes by @criccomini in https://github.com/slatedb/slatedb/pull/1993
• Remove unnecessary SR clones in scan APIs by @nomiero in https://github.com/slatedb/slatedb/pull/1994
• Disable descending scan checks in DST by @criccomini in https://github.com/slatedb/slatedb/pull/1996
• Deflake object store cache metrics test by @criccomini in https://github.com/slatedb/slatedb/pull/1997
• Allow closing a DB without flushing the active memtable by @Aetherance in https://github.com/slatedb/slatedb/pull/1948
• site: add Prisma to adopter listings by @criccomini in https://github.com/slatedb/slatedb/pull/1999
• Add consume_budget in hot loops to help Tokio by @criccomini in https://github.com/slatedb/slatedb/pull/1998
• [rfc-30 3/N]: add trait and native implementation for wal gc by @rodesai in https://github.com/slatedb/slatedb/pull/2000
• fix(compactor): prevent terminal compaction resurrection by @criccomini in https://github.com/slatedb/slatedb/pull/2002
• Add cleanup_db admin fn and cli command for clone teardown by @bit2swaz in https://github.com/slatedb/slatedb/pull/2001
• Run nightly pprof on a Warp ARM runner by @criccomini in https://github.com/slatedb/slatedb/pull/2008
• [1972] Expose manifest version count as a metric by @1996fanrui in https://github.com/slatedb/slatedb/pull/1974
• [rfc-30 4/N]: move max wal file flush check to wal trait by @rodesai in https://github.com/slatedb/slatedb/pull/2007
• Actually skip the WAL at DbReader open when skip_wal_replay is set (helps [#2003]) by @Ten0 in https://github.com/slatedb/slatedb/pull/2005
• make close flush mode more explicit by using explicit flush type by @rodesai in https://github.com/slatedb/slatedb/pull/2011
• Replace nightly bencher work with benchmark.slatedb.io by @criccomini in https://github.com/slatedb/slatedb/pull/2009
• Run nightly microbenchmarks on Warp ARM by @criccomini in https://github.com/slatedb/slatedb/pull/2016
• Select previous release tag dynamically by @criccomini in https://github.com/slatedb/slatedb/pull/2017
• [rfc-30 5/N]: add WalAdmin trait for administrative wal operations by @rodesai in https://github.com/slatedb/slatedb/pull/2014
• [2004] Do not invoke user metrics callbacks under the db.state write lock by @1996fanrui in https://github.com/slatedb/slatedb/pull/2006
• Expose SstFile::index as an opaque view instead of copying data. by @FiV0 in https://github.com/slatedb/slatedb/pull/2019
• [rfc-30 6/N]: wire custom WAL into builders by @rodesai in https://github.com/slatedb/slatedb/pull/2015
• test(wal_replay): fix write_wal helper to respect max_entries by @codeAnqiang-ma in https://github.com/slatedb/slatedb/pull/2023
• Enable unused_qualifications and drop redundant path prefixes by @1996fanrui in https://github.com/slatedb/slatedb/pull/2020
• example: Add a rescaling example by @rockwotj in https://github.com/slatedb/slatedb/pull/2028
• Add benchmark.slatedb.io blog post by @criccomini in https://github.com/slatedb/slatedb/pull/2026
• [rfc-30 7/N]: move all wal implementation types under the wal module by @rodesai in https://github.com/slatedb/slatedb/pull/2029
• union: validate non-overlapping key ranges per segment by @rockwotj in https://github.com/slatedb/slatedb/pull/2030
• [rfc-30 8/N]: support live streaming from SlateDbWalIterator and use for CDC by @rodesai in https://github.com/slatedb/slatedb/pull/2032
• configure sst iterator read ahead using bytes by @rodesai in https://github.com/slatedb/slatedb/pull/2037
• perf(wal): read a whole WAL SST per request during replay (#2003) by @bit2swaz in https://github.com/slatedb/slatedb/pull/2042
• Remove SQLync from Adopters by @mdwaud in https://github.com/slatedb/slatedb/pull/2045
• Tolerate manifests GCed during admin.list_manifests by @Efrat19 in https://github.com/slatedb/slatedb/pull/2047
• add lixray as adopter by @samuelstroschein in https://github.com/slatedb/slatedb/pull/2050
• Propose tracing instrumentation for read path by @cadonna in https://github.com/slatedb/slatedb/pull/2035
• add tracing options to read path by @cadonna in https://github.com/slatedb/slatedb/pull/2046
• fix: preserve sequence tracker interval after deserialization by @criccomini in https://github.com/slatedb/slatedb/pull/2053
• manifest: write ManifestV2 universally (#2055) by @rkhachatryan in https://github.com/slatedb/slatedb/pull/2056
• move wal read/write paths to their own types under wal module by @rodesai in https://github.com/slatedb/slatedb/pull/2052
• docs: fix typo wihtout -> without by @vaibhav8a in https://github.com/slatedb/slatedb/pull/2057

New Contributors

• @bowenli86 made their first contribution in https://github.com/slatedb/slatedb/pull/1952
• @sorenbs made their first contribution in https://github.com/slatedb/slatedb/pull/1964
• @Aetherance made their first contribution in https://github.com/slatedb/slatedb/pull/1948
• @bit2swaz made their first contribution in https://github.com/slatedb/slatedb/pull/2001
• @Ten0 made their first contribution in https://github.com/slatedb/slatedb/pull/2005
• @codeAnqiang-ma made their first contribution in https://github.com/slatedb/slatedb/pull/2023
• @Efrat19 made their first contribution in https://github.com/slatedb/slatedb/pull/2047
• @samuelstroschein made their first contribution in https://github.com/slatedb/slatedb/pull/2050
• @vaibhav8a made their first contribution in https://github.com/slatedb/slatedb/pull/2057

Full Changelog: https://github.com/slatedb/slatedb/compare/v0.15.0...v0.16.0