Download Latest Version v4.9.10 source code.zip (233.8 MB) Google Add to Preferred Sources
Home / v4.9.8
Name Modified Size InfoDownloads / Week
Parent folder
README.md 2025-03-12 523 Bytes
v4.9.8 source code.tar.gz 2025-03-12 211.8 MB
v4.9.8 source code.zip 2025-03-12 233.7 MB
Totals: 3 Items   445.4 MB 1

Added

  • New Beam writer NoShuffleBeamWriter that doesn't shuffle, which speeds up dataset generation significantly, but does not have deterministic order guarantees. Can be enabled with the flag --nondeterministic_order.
  • CroissantBuilder now supports Croissant files that define splits; and new feature types: feature dictionaries and multidimensional arrays.
  • New datasets.

Changed

Deprecated

Removed

Fixed

  • Various small bug fixes.
  • Various performance improvements.

Security

Source: README.md, updated 2025-03-12