| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| README.md | 2025-03-12 | 523 Bytes | |
| v4.9.8 source code.tar.gz | 2025-03-12 | 211.8 MB | |
| v4.9.8 source code.zip | 2025-03-12 | 233.7 MB | |
| Totals: 3 Items | 445.4 MB | 1 | |
Added
- New Beam writer
NoShuffleBeamWriterthat doesn't shuffle, which speeds up dataset generation significantly, but does not have deterministic order guarantees. Can be enabled with the flag--nondeterministic_order. - CroissantBuilder now supports Croissant files that define splits; and new feature types: feature dictionaries and multidimensional arrays.
- New datasets.
Changed
Deprecated
Removed
Fixed
- Various small bug fixes.
- Various performance improvements.