SlateDB Files

What's Changed

• Add CompactionScheduler::generate to convert requests to specs by @criccomini in https://github.com/slatedb/slatedb/pull/1190
• Create slatedb-txn-obj and slatedb-common by @criccomini in https://github.com/slatedb/slatedb/pull/1195
• Use clippy.toml in slatedb-common and slatedb-txn-obj by @criccomini in https://github.com/slatedb/slatedb/pull/1196
• Fix non-determinism in dispatcher.rs test by @criccomini in https://github.com/slatedb/slatedb/pull/1199
• Revise CONTRIBUTING.md for AI-generated contributions by @criccomini in https://github.com/slatedb/slatedb/pull/1200
• Add s2-lite as adopter in the README by @shikhar in https://github.com/slatedb/slatedb/pull/1201
• Remove LogicalClock by @criccomini in https://github.com/slatedb/slatedb/pull/1203
• added the benchmark for the transactions with concurrency by @KrishnaSindhur in https://github.com/slatedb/slatedb/pull/1108
• add s2 logo to slatedb.io by @shikhar in https://github.com/slatedb/slatedb/pull/1204
• Make CompactorState::merge_remote_compactions more paranoid by @criccomini in https://github.com/slatedb/slatedb/pull/1197
• Updates to RFC-0003 by @agavra in https://github.com/slatedb/slatedb/pull/1208
• update design overview by @marvin-j97 in https://github.com/slatedb/slatedb/pull/1211
• Add memory store type to load_object_store_from_env by @criccomini in https://github.com/slatedb/slatedb/pull/1213
• Resume compactions on restart by @criccomini in https://github.com/slatedb/slatedb/pull/1212
• introduce new WAL SSTs by @cadonna in https://github.com/slatedb/slatedb/pull/1193
• [slatedb_go] fix type of ObjectStoreCacheOptions.PreloadDiskCacheOnStartup field by @vitoordaz in https://github.com/slatedb/slatedb/pull/1219
• Fix first_key -> first_entry rename by @criccomini in https://github.com/slatedb/slatedb/pull/1224
• Add skip_wal_replay setting for DbReaderOptions by @jeromegn in https://github.com/slatedb/slatedb/pull/1218
• Update RFC13 data model by @criccomini in https://github.com/slatedb/slatedb/pull/1221
• Verify compaction inputs exist by @criccomini in https://github.com/slatedb/slatedb/pull/1222
• add deadlock detector for next time deadlock happens in test_should_read_compacted_db by @agavra in https://github.com/slatedb/slatedb/pull/1226
• Remove unnecessary clones by @el-yawd in https://github.com/slatedb/slatedb/pull/1227
• Add all feature to give all features to py/go bindings by @criccomini in https://github.com/slatedb/slatedb/pull/1231
• Don't retry NotFound in RetryingObjectStore by @criccomini in https://github.com/slatedb/slatedb/pull/1230
• Add db.status() for health checks by @criccomini in https://github.com/slatedb/slatedb/pull/1234
• updated nightly to run benchmark-transaction.sh by @KrishnaSindhur in https://github.com/slatedb/slatedb/pull/1232
• docs: RFC for Compaction Filters by @nomiero in https://github.com/slatedb/slatedb/pull/1198
• introduce a module for the sst format by @cadonna in https://github.com/slatedb/slatedb/pull/1207
• Eliminate unused warnings during DST by @criccomini in https://github.com/slatedb/slatedb/pull/1236
• Make db.close() trigger a db.flush() if it's in a clean state by @criccomini in https://github.com/slatedb/slatedb/pull/1238
• Add Block V2 format with RocksDB-style prefix compression by @agavra in https://github.com/slatedb/slatedb/pull/1237
• fix test_basic_restore by @cadonna in https://github.com/slatedb/slatedb/pull/1242
• Add commonhaus to websdite footer by @criccomini in https://github.com/slatedb/slatedb/pull/1243
• Translate RFC links when building MDX files for website by @criccomini in https://github.com/slatedb/slatedb/pull/1244
• Move C bindings to slatedb-c by @criccomini in https://github.com/slatedb/slatedb/pull/1241
• Add status check for flushes by @criccomini in https://github.com/slatedb/slatedb/pull/1239
• Implementation for compaction filters by @nomiero in https://github.com/slatedb/slatedb/pull/1233
• don't assert in BlockBuilder by @cxljs in https://github.com/slatedb/slatedb/pull/1246
• add instructions to install flatc by @cadonna in https://github.com/slatedb/slatedb/pull/1214
• introduce the WAL buffer by @cadonna in https://github.com/slatedb/slatedb/pull/1209
• fix test_size_based_flush_triggering by @cadonna in https://github.com/slatedb/slatedb/pull/1251
• Add RFC-0014 new WAL persistence format by @cadonna in https://github.com/slatedb/slatedb/pull/1128
• Add read-path support for SST V2 with prefix compression by @agavra in https://github.com/slatedb/slatedb/pull/1248
• [slatedb-c] improve builder error handling by @vitoordaz in https://github.com/slatedb/slatedb/pull/1256
• Add FFI Java 24 slatedb-java bindings by @criccomini in https://github.com/slatedb/slatedb/pull/1253
• remove pub(crate) from WalBuffer by @cadonna in https://github.com/slatedb/slatedb/pull/1259
• Add talk to README.md by @criccomini in https://github.com/slatedb/slatedb/pull/1260
• Add DbTransaction::unmark_write to skip conflict checks on write by @criccomini in https://github.com/slatedb/slatedb/pull/1261
• Serialize Tigris-based benchmarks by @criccomini in https://github.com/slatedb/slatedb/pull/1264
• default to v2 of sst version on the write path by @agavra in https://github.com/slatedb/slatedb/pull/1258
• Add .NET community bindings by @mnemonic-seed in https://github.com/slatedb/slatedb/pull/1268
• Add compaction filter supplier to the Admin API by @nomiero in https://github.com/slatedb/slatedb/pull/1272
• Speed up Db::open and DbBuilder::build functions by @criccomini in https://github.com/slatedb/slatedb/pull/1274
• fix dependabot alerts by @agavra in https://github.com/slatedb/slatedb/pull/1275
• docs: RFC for Expose Key Metadata by @marsevilspirit in https://github.com/slatedb/slatedb/pull/1247
• Add RFC for CDC by @criccomini in https://github.com/slatedb/slatedb/pull/634
• [slatedb-c] add none field to CSdbResult by @vitoordaz in https://github.com/slatedb/slatedb/pull/1277
• fix(cache): skip write cache if backpressure by @flaneur2020 in https://github.com/slatedb/slatedb/pull/1269
• [slatedb-java] use checkResult for all FFI calls by @vitoordaz in https://github.com/slatedb/slatedb/pull/1278
• expose metric type alongisde value in ReadableStat by @agavra in https://github.com/slatedb/slatedb/pull/1283
• Rewrite slatedb-c by @criccomini in https://github.com/slatedb/slatedb/pull/1282
• Update CONTRIBUTING.md with CLA link by @criccomini in https://github.com/slatedb/slatedb/pull/1286
• Update go errors by @criccomini in https://github.com/slatedb/slatedb/pull/1287
• Use jextract to generate Java bindings by @criccomini in https://github.com/slatedb/slatedb/pull/1289
• feat: return WriteHandle from write operations by @marsevilspirit in https://github.com/slatedb/slatedb/pull/1284
• Add WalReader for WAL-based change data capture by @criccomini in https://github.com/slatedb/slatedb/pull/1255
• [slatedb-java] add @Nullable to arguments that could be null by @vitoordaz in https://github.com/slatedb/slatedb/pull/1291
• Add ci-cross profile to timeout tests by @criccomini in https://github.com/slatedb/slatedb/pull/1294
• Update CDC status and move Infrastructure Sponsors section by @criccomini in https://github.com/slatedb/slatedb/pull/1295
• Add disk cache support to DbReader by @hawkaa in https://github.com/slatedb/slatedb/pull/1297
• Raise NotFound error in WalFile when files are missing by @criccomini in https://github.com/slatedb/slatedb/pull/1300
• Make WriteHandle::create_ts required by @criccomini in https://github.com/slatedb/slatedb/pull/1292
• RFC: Range size approximation and key count estimation by @FiV0 in https://github.com/slatedb/slatedb/pull/1220
• Change stats RFC status from Draft to Accepted by @criccomini in https://github.com/slatedb/slatedb/pull/1306
• Use SplitCache as default for DbReader by @hawkaa in https://github.com/slatedb/slatedb/pull/1305
• feat: flush L0 after N WAL entries accumulate by @dantop114 in https://github.com/slatedb/slatedb/pull/1293
• Override get_range/get_ranges in RetryingObjectStore by @Barre in https://github.com/slatedb/slatedb/pull/1314
• [slatedb-c] change type of slatedb_bound_t.data to be *void by @vitoordaz in https://github.com/slatedb/slatedb/pull/1316
• Assign transaction seqnums inside lock by @criccomini in https://github.com/slatedb/slatedb/pull/1301
• Add DbReaderBuilder for builder-style DbReader creation by @Aliexe-code in https://github.com/slatedb/slatedb/pull/1308
• Increase cache preload parallelism from 5 to 32 by @hawkaa in https://github.com/slatedb/slatedb/pull/1325
• Fix DbReader to respect preload_disk_cache_on_startup and DRY preload… by @hawkaa in https://github.com/slatedb/slatedb/pull/1309
• Update WriteBatchEventHandler::is_first_write when writing by @criccomini in https://github.com/slatedb/slatedb/pull/1323
• Expose Db::manifest function by @criccomini in https://github.com/slatedb/slatedb/pull/1324
• Add WAL reader bindings for Go and Java by @vitoordaz in https://github.com/slatedb/slatedb/pull/1320
• Backward order iteration : SstIterator changes by @vigneshc-dd in https://github.com/slatedb/slatedb/pull/1265
• Consolidate compaction config in DbBuilder into CompactorConfig by @ryandielhenn in https://github.com/slatedb/slatedb/pull/1317
• add SstType (Compacted/WAL) to SsTableInfo by @agavra in https://github.com/slatedb/slatedb/pull/1333
• Include libslatedb_c in slatedb-java JAR by @criccomini in https://github.com/slatedb/slatedb/pull/1329
• Add merge operator support to slatedb-java by @criccomini in https://github.com/slatedb/slatedb/pull/1338
• Store last_key in SST metadata by @Barre in https://github.com/slatedb/slatedb/pull/1328
• Add per-block record counts to block index in RFC 0020 by @hachikuji in https://github.com/slatedb/slatedb/pull/1336
• support disabling the block cache from DbBuilder by @rodesai in https://github.com/slatedb/slatedb/pull/1339
• Include sst format version in manifest/SsTableHandle by @rodesai in https://github.com/slatedb/slatedb/pull/1341
• expose db.subscribe() method to allow users to subscribe to operational events by @agavra in https://github.com/slatedb/slatedb/pull/1288
• Set up maven publication for slatedb-java by @criccomini in https://github.com/slatedb/slatedb/pull/1340
• Add with_wal_object_store to DbReaderBuilder by @Barre in https://github.com/slatedb/slatedb/pull/1344
• Make InvalidClockTick log debug by @Barre in https://github.com/slatedb/slatedb/pull/1345
• Refactor KeyValueIterator to expose RowEntry instead of KeyValue by @marsevilspirit in https://github.com/slatedb/slatedb/pull/1337
• Rename KeyValueIterator To RowEntryIterator by @marsevilspirit in https://github.com/slatedb/slatedb/pull/1346
• Warn if user updates both settings and compactor options by @criccomini in https://github.com/slatedb/slatedb/pull/1349
• Enable GC in DbBuilder by default by @criccomini in https://github.com/slatedb/slatedb/pull/1348
• use sync io from object store cache by @rodesai in https://github.com/slatedb/slatedb/pull/1342
• Add batch scan iterator to reduce FFI overhead by @maxweber in https://github.com/slatedb/slatedb/pull/1343
• Add WalStoreReconfigurationError check in DbReaderBuilder by @criccomini in https://github.com/slatedb/slatedb/pull/1351
• Publish txn-obj and common by @criccomini in https://github.com/slatedb/slatedb/pull/1355
• Don't depend on so/dylib/dll for source sets by @criccomini in https://github.com/slatedb/slatedb/pull/1356
• Build Java releases against main not tags by @criccomini in https://github.com/slatedb/slatedb/pull/1357
• Add explicit depenency for javadoc publication by @criccomini in https://github.com/slatedb/slatedb/pull/1358
• Remove javadoc jar from regular build to prevent duplicates by @criccomini in https://github.com/slatedb/slatedb/pull/1359
• Add Storrito link to adopters list by @criccomini in https://github.com/slatedb/slatedb/pull/1361
• Flush all writes to single SST in test_compactor_compacts_l0 by @criccomini in https://github.com/slatedb/slatedb/pull/1360
• Fix flaky test_should_read_from_compacted_db test by @criccomini in https://github.com/slatedb/slatedb/pull/1363
• Add TypeScript binding link to README by @criccomini in https://github.com/slatedb/slatedb/pull/1364
• Add Gadget to the list of users by @criccomini in https://github.com/slatedb/slatedb/pull/1365
• Prevent same key straddling multiple SSTs in sorted runs by @criccomini in https://github.com/slatedb/slatedb/pull/1372

New Contributors

• @marvin-j97 made their first contribution in https://github.com/slatedb/slatedb/pull/1211
• @el-yawd made their first contribution in https://github.com/slatedb/slatedb/pull/1227
• @cxljs made their first contribution in https://github.com/slatedb/slatedb/pull/1246
• @mnemonic-seed made their first contribution in https://github.com/slatedb/slatedb/pull/1268
• @hawkaa made their first contribution in https://github.com/slatedb/slatedb/pull/1297
• @FiV0 made their first contribution in https://github.com/slatedb/slatedb/pull/1220
• @dantop114 made their first contribution in https://github.com/slatedb/slatedb/pull/1293
• @Aliexe-code made their first contribution in https://github.com/slatedb/slatedb/pull/1308
• @vigneshc-dd made their first contribution in https://github.com/slatedb/slatedb/pull/1265
• @ryandielhenn made their first contribution in https://github.com/slatedb/slatedb/pull/1317
• @maxweber made their first contribution in https://github.com/slatedb/slatedb/pull/1343

Full Changelog: https://github.com/slatedb/slatedb/compare/v0.10.1...v0.11.1