Vortex Files

What's Changed

• ALP decoding plugin by @a10y in https://github.com/vortex-data/vortex/pull/7370
• fix(cuda): handle validity in GPU kernels by @0ax1 in https://github.com/vortex-data/vortex/pull/7372
• Fix AGENTS.md sccache by @connortsui20 in https://github.com/vortex-data/vortex/pull/7377
• Replace &PrimitiveArray with ArrayView in a bunch of places by @connortsui20 in https://github.com/vortex-data/vortex/pull/7378
• Remove MaskMut and unused functions from BitBufferMut by @robert3005 in https://github.com/vortex-data/vortex/pull/7379
• AllInvalid arrays have non empty distinct info by @robert3005 in https://github.com/vortex-data/vortex/pull/7369
• duckdb: Reset validity instead of filling by @myrrc in https://github.com/vortex-data/vortex/pull/7365
• use expect over allow in clippy by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7373
• Remove portable_simd take implementation and remove unused cargo flags by @robert3005 in https://github.com/vortex-data/vortex/pull/7388
• Decompose TurboQuant into 2 ScalarFnArrays and DictArray by @connortsui20 in https://github.com/vortex-data/vortex/pull/7374
• add vector similarity benchmark by @connortsui20 in https://github.com/vortex-data/vortex/pull/7391
• perf: Arc::ptr_eq short-circuit to DType eq comparisons by @0ax1 in https://github.com/vortex-data/vortex/pull/7398
• Update dependency io.netty:netty-bom to v4.2.12.Final by @renovate[bot] in https://github.com/vortex-data/vortex/pull/7403
• Update react monorepo to v19.2.5 by @renovate[bot] in https://github.com/vortex-data/vortex/pull/7404
• Update rust-wasm-bindgen monorepo by @renovate[bot] in https://github.com/vortex-data/vortex/pull/7406
• bump rand to 0.10.1 by @connortsui20 in https://github.com/vortex-data/vortex/pull/7405
• Update all patch updates by @renovate[bot] in https://github.com/vortex-data/vortex/pull/7402
• chore[vortex-array]: add integer casting benchmark by @asubiotto in https://github.com/vortex-data/vortex/pull/7400
• Ignore dead_code warnings on scalar bit transpose code by @robert3005 in https://github.com/vortex-data/vortex/pull/7408
• support multiple globs in DuckDB and MultiFileDataSource by @a10y in https://github.com/vortex-data/vortex/pull/7390
• Optimize maths expressions with Constant children by @connortsui20 in https://github.com/vortex-data/vortex/pull/7394
• TurboQuant InnerProduct optimizations by @connortsui20 in https://github.com/vortex-data/vortex/pull/7396
• duckdb: Exit earlier on Validity::AllFalse by @myrrc in https://github.com/vortex-data/vortex/pull/7411
• perf: Arc::ptr_eq short-circuit for List & FixedSizeList DType eq by @0ax1 in https://github.com/vortex-data/vortex/pull/7410
• feat: implement IsNotNull expression in vortex expression library by @xiaoxuandev in https://github.com/vortex-data/vortex/pull/6969
• More robust types in the compressor by @connortsui20 in https://github.com/vortex-data/vortex/pull/7415
• fix[ci]: bench no fail-fast random access and compress bench by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7418
• Remove getrandom feature flag overrides by @robert3005 in https://github.com/vortex-data/vortex/pull/7421
• perf[vortex-array]: use from_trusted_len_iter in primitive casts by @asubiotto in https://github.com/vortex-data/vortex/pull/7401
• Update dependency pytest to v9 [SECURITY] by @renovate[bot] in https://github.com/vortex-data/vortex/pull/7419
• chore[vortex-layout]: allow specifying a set of stats on CompressingStrategy by @asubiotto in https://github.com/vortex-data/vortex/pull/7422
• fix[vortex-array]: avoid unnecessary checks in check_listview_constant by @asubiotto in https://github.com/vortex-data/vortex/pull/7423
• Lower days before stale to 14 from 30 by @robert3005 in https://github.com/vortex-data/vortex/pull/7425
• fix check for ArrayPlugin encoding ID on deserialize by @a10y in https://github.com/vortex-data/vortex/pull/7427
• chore: benchmark with execution context input by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7429
• fix ALP patch plugin by @a10y in https://github.com/vortex-data/vortex/pull/7430
• add unstable encodings and patches to benchmarks by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7426
• Add benchmarks for take on a FilterArray by @robert3005 in https://github.com/vortex-data/vortex/pull/7420
• Optimize inner product, update boilerplate, remove bad benchmarks by @connortsui20 in https://github.com/vortex-data/vortex/pull/7428
• ScalarFns as Arrays by @gatesn in https://github.com/vortex-data/vortex/pull/7361
• Fix lockfiles by @connortsui20 in https://github.com/vortex-data/vortex/pull/7433
• perf: intern identifiers (array, layout, etc). by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7412
• binstall for vortex-tui by @a10y in https://github.com/vortex-data/vortex/pull/7434
• Remove metadata from DynArray by @connortsui20 in https://github.com/vortex-data/vortex/pull/7435
• Remove ListViewBuilder scalar_at by @gatesn in https://github.com/vortex-data/vortex/pull/7438
• Support serializion tensor scalar fns by @connortsui20 in https://github.com/vortex-data/vortex/pull/7437
• chore[gpu]: don't inline bitunpack lane impls by @0ax1 in https://github.com/vortex-data/vortex/pull/7441
• add BtrBlocksCompressorBuilder::empty() by @connortsui20 in https://github.com/vortex-data/vortex/pull/7443
• Update locked rustls-webpki to address sec advisory by @AdamGS in https://github.com/vortex-data/vortex/pull/7444
• chore[gpu]: trim Criterion CUDA benchmarks by @0ax1 in https://github.com/vortex-data/vortex/pull/7445
• Add spark value writers for Date/Timestamp/TimestampNTZ and Struct types by @robert3005 in https://github.com/vortex-data/vortex/pull/7424
• Gate scalar fn array plugin for tensor exprs by @connortsui20 in https://github.com/vortex-data/vortex/pull/7447
• chore(ci): workflow cleanup and fixes by @0ax1 in https://github.com/vortex-data/vortex/pull/7448
• Vector datasets catalog and downloader by @connortsui20 in https://github.com/vortex-data/vortex/pull/7446
• fix(ci): restore vortex-compact file size tracking for PR clickbench by @0ax1 in https://github.com/vortex-data/vortex/pull/7452
• expose execution context for validity::to_bool and remove validity mask from array vtable by @joseph-isaacs in https://github.com/vortex-data/vortex/pull/7432
• chore: dedup formats in sql engine runner by @0ax1 in https://github.com/vortex-data/vortex/pull/7459
• chore: bump duckdb to 1.5.2 by @0ax1 in https://github.com/vortex-data/vortex/pull/7461
• chore: unify ci timeouts to 4 tiers by @0ax1 in https://github.com/vortex-data/vortex/pull/7460
• Correct rust version channel by @robert3005 in https://github.com/vortex-data/vortex/pull/7463
• fix: wipe duckdb archive as part of cargo clean by @0ax1 in https://github.com/vortex-data/vortex/pull/7465
• Unify benchmark file download logic by @robert3005 in https://github.com/vortex-data/vortex/pull/7462
• Fix web deployment github action by @robert3005 in https://github.com/vortex-data/vortex/pull/7467
• Unify all runtime env var access to functions wrapping LazyLock by @AdamGS in https://github.com/vortex-data/vortex/pull/7468
• Deprecate scalar_at for execute_scalar by @gatesn in https://github.com/vortex-data/vortex/pull/7457
• Demo TurboQuant basic search with serialization by @connortsui20 in https://github.com/vortex-data/vortex/pull/7451
• vortex-array: Attempt casting inner array to target for extensions by @brancz in https://github.com/vortex-data/vortex/pull/7469
• Fix scalar_at in example by @connortsui20 in https://github.com/vortex-data/vortex/pull/7471
• Split up the monster ci.yml workflow by @AdamGS in https://github.com/vortex-data/vortex/pull/7472

New Contributors

• @xiaoxuandev made their first contribution in https://github.com/vortex-data/vortex/pull/6969

Full Changelog: https://github.com/vortex-data/vortex/compare/0.68.0...0.69.0