Skip to content

v4.9.8

Latest
Compare
Choose a tag to compare
@github-actions github-actions released this 12 Mar 16:04

Added

  • New Beam writer NoShuffleBeamWriter that doesn't shuffle, which speeds up
    dataset generation significantly, but does not have deterministic order
    guarantees. Can be enabled with the flag --nondeterministic_order.
  • CroissantBuilder now supports Croissant files that define splits; and new
    feature types: feature dictionaries and multidimensional arrays.
  • New datasets.

Changed

Deprecated

Removed

Fixed

  • Various small bug fixes.
  • Various performance improvements.

Security