Release 0.2.13

What's Changed

• Update README with config for MinIO by @bhimrazy in #174
• Bump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 by @dependabot in #177
• Fix: error while splitting dataset with splits=[0.1, 0.2, 0.7] and support split of 0.0 by @deependujha in #187
• Feat: Append data to pre-optimize dataset by @deependujha in #184
• Fix: Resolve the default weights of the combined dataset by @tchaton in #188
• Bump version 0.2.13 by @tchaton in #189

Full Changelog: v0.2.12...v0.2.13

Release v0.2.12

What's Changed

• Resolve num_workers when the user provides 0 by @tchaton in #173
• Add feature to slice, subsample and split dataset by @deependujha in #161
• Release version 0.2.12 by @tchaton in #176

New Contributors

• @deependujha made their first contribution in #161

Full Changelog: v0.2.11...v0.2.12

Release v0.2.11

What's Changed

• fix typo : aws cli url in readme by @bhimrazy in #169
• Remove crt by @tchaton in #171

New Contributors

• @bhimrazy made their first contribution in #169

Full Changelog: v0.2.10...v0.2.11

Release v0.2.10

What's Changed

• Fix litdata on colab by @tchaton in #166
• Add first draft for multi modal model training text & image by @rakro101 in #160
• Bump coverage from 7.5.0 to 7.5.3 by @dependabot in #149
• Bump lightning-cloud from 0.5.68 to 0.5.69 by @dependabot in #150
• Bump version 0.2.10 by @tchaton in #167

New Contributors

• @rakro101 made their first contribution in #160

Full Changelog: v0.2.9...v0.2.10

Release v0.2.9

What's Changed

• compatibility with downloading data from gcp by @dangthatsright in #154
• Flexibility to set device number < total device count by @yhl48 in #155
• Remove DataLoader example in README by @tchaton in #162
• Add support for custom collate with the StreamingDataLoader by @tchaton in #163
• (fix) CombinedDataset with more than 2 streaming datasets by @tchaton in #164
• Bump version 0.2.9 by @tchaton in #165

New Contributors

• @dangthatsright made their first contribution in #154

Full Changelog: v0.2.8...v0.2.9

Release v0.2.8

What's Changed

• Update README.md by @tchaton in #143
• Performance improvement for processing by @sritterginkgo in #146
• Fix: Resolve drop_last not passed down from the StreamingDataLoader to the datasets by @tchaton in #147
• Bump pytest from 8.2.0 to 8.2.1 by @dependabot in #148
• LitData release version bump 0.2.8 by @tchaton in #153

New Contributors

• @sritterginkgo made their first contribution in #146

Full Changelog: v0.2.7...v0.2.8

Release v0.2.7

What's Changed

• Fix the NoHeaderTensorSerializer for 1D tensors (other than tokens) by @enrico-stauss in #124
• Fix infinite sleep when loading local compressed dataset. by @wzf03 in #127
• Fix configuration of a custom serializers for one of the predefined types by @enrico-stauss in #125
• Add dist env detection via env vars by @gkroiz in #95
• Fix empty tensor deserialization by @enrico-stauss in #131
• Bump JamesIves/github-pages-deploy-action from 4.5.0 to 4.6.1 by @dependabot in #132
• Prevent race deletion by @tchaton in #136
• Add support for exact iteration by @tchaton in #139
• Bump LitData version 0.2.7 by @tchaton in #142

New Contributors

• @enrico-stauss made their first contribution in #124
• @wzf03 made their first contribution in #127
• @gkroiz made their first contribution in #95

Full Changelog: v0.2.6...v0.2.7

Release 0.2.6

What's Changed

• Bump pytest from 8.0.2 to 8.2.0 by @dependabot in #115
• Bump coverage from 7.4.4 to 7.5.0 by @dependabot in #117
• Bump pytest-cov from 4.1.0 to 5.0.0 by @dependabot in #116
• Resolve some bugs by @tchaton in #121
• Add support for iterate_over_all for the CombinedDataset by @tchaton in #122
• Update version 0.2.6 by @tchaton in #123

Full Changelog: v0.2.5...v0.2.6

Release 0.2.5

What's Changed

• Remove condition on torch installation by @tchaton in #110
• Bump version 0.2.5 by @tchaton in #111

Full Changelog: v0.2.4...v0.2.5

Release 0.2.4

What's Changed

• Update LitGPT references in README.md by @rasbt in #90
• Don't raise a runtimeError if the downloader doesn't exist. by @tchaton in #98
• Added call to setup function of serializer class to set data format by @vgurev in #96
• Fix map() failing to create dataset when input_dir is None by @awaelchli in #100
• Streamingdataset torch compatibility by @yhl48 in #108
• Move to version 0.2.4 by @tchaton in #109

New Contributors

• @rasbt made their first contribution in #90
• @vgurev made their first contribution in #96
• @awaelchli made their first contribution in #100
• @yhl48 made their first contribution in #108

Full Changelog: v0.2.3...v0.2.4