Skip to content
Permalink

Comparing changes

Choose two branches to see what’s changed or to start a new pull request. If you need to, you can also or learn more about diff comparisons.

Open a pull request

Create a new pull request by comparing changes across two branches. If you need to, you can also . Learn more about diff comparisons here.
base repository: tensorflow/datasets
Failed to load repositories. Confirm that selected base ref is valid, then try again.
Loading
base: master
Choose a base ref
...
head repository: tensorflow/datasets
Failed to load repositories. Confirm that selected head ref is valid, then try again.
Loading
compare: test_726377778
Choose a head ref
  • 1 commit
  • 7 files changed
  • 1 contributor

Commits on Mar 12, 2025

  1. Use the max size of serialized examples to find a safe number of shards 

    If we know the max size of serialized examples, then we can account for the worst case scenario where one shard would get only examples of the max size. This hopefully should prevent users running into problems with having too big shards.

PiperOrigin-RevId: 726377778
    @tomvdw
    tomvdw authored and The TensorFlow Datasets Authors committed Mar 12, 2025
    Configuration menu
    Copy the full SHA
    b947eaf View commit details
    Browse the repository at this point in the history
Loading