Skip to content

Issues: Lightning-AI/litdata

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
34 Open 84 Closed
34 Open 84 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

training hangs with lightning ddp and cloud dir? bug Something isn't working help wanted Extra attention is needed
#408 opened Nov 1, 2024 by rxqy
1
incorrect dataloader length when drop_last=False bug Something isn't working help wanted Extra attention is needed
#402 opened Oct 28, 2024 by grez72
1
The config isn't consistent between chunks bug Something isn't working help wanted Extra attention is needed
#370 opened Sep 17, 2024 by AugustDev
5
Failed to Resume Training w/ CombinedStreamingDataset bug Something isn't working duplicate This issue or pull request already exists help wanted Extra attention is needed
#363 opened Sep 5, 2024 by schopra8
1
CombinedStreamingDataset causes NCCL timeout when using multiple nodes bug Something isn't working help wanted Extra attention is needed
#340 opened Aug 26, 2024 by hubenjm
14
StreamingDataset intermittently fails due to lack of index.json bug Something isn't working help wanted Extra attention is needed
#337 opened Aug 20, 2024 by plra
2
Bug: Inconsistent Behavior with StreamingDataloader loading states (specific to CombinedStreamingDataset) bug Something isn't working help wanted Extra attention is needed
#331 opened Aug 14, 2024 by bhimrazy
1
@bhimrazy
Use different batch sizes in CombinedStreamingDataset enhancement New feature or request help wanted Extra attention is needed
#327 opened Aug 10, 2024 by schopra8
1
Add support for multi sample item in optimize and yielding from the _getitem_ of the StreamingDataset enhancement New feature or request help wanted Extra attention is needed
#317 opened Aug 8, 2024 by tchaton
Explore about integrating homomorphic encryption enhancement New feature or request help wanted Extra attention is needed
#313 opened Aug 7, 2024 by bhimrazy
Investigate keeping the content of the downloaded chunks in RAM instead of writing it to file. enhancement New feature or request help wanted Extra attention is needed
#291 opened Aug 1, 2024 by tchaton
Add training mode compression for zstd enhancement New feature or request help wanted Extra attention is needed
#283 opened Jul 31, 2024 by tchaton
Add support for sample windowing enhancement New feature or request help wanted Extra attention is needed
#282 opened Jul 31, 2024 by tchaton
RuntimeError: Can't start new thread bug Something isn't working help wanted Extra attention is needed
#280 opened Jul 31, 2024 by cgebbe
10
If data samples contain a Python list with a variable number of elements, type inference will fail bug Something isn't working help wanted Extra attention is needed
#260 opened Jul 23, 2024 by senarvi
8
Profiler patches torch without reverting it bug Something isn't working help wanted Extra attention is needed
#240 opened Jul 17, 2024 by awaelchli
1
Integration with DAG framework Prefect enhancement New feature or request help wanted Extra attention is needed
#226 opened Jul 12, 2024 by tchaton
@deependujha
1
Add support for the reduce operator enhancement New feature or request help wanted Extra attention is needed
#225 opened Jul 12, 2024 by tchaton
1
Using a streaming dataloader with an unbalanced dataset yields unexpected batch sizes. bug Something isn't working help wanted Extra attention is needed
#199 opened Jun 29, 2024 by esivonxay-cognitiv
7
Add support for parquet files for storing the chunks enhancement New feature or request help wanted Extra attention is needed
#191 opened Jun 27, 2024 by tchaton
3
LitData doesn't support s3 bucket connection outside server enhancement New feature or request help wanted Extra attention is needed
#183 opened Jun 25, 2024 by sanyalsunny111
11
Using fsspec to download files enhancement New feature or request help wanted Extra attention is needed
#181 opened Jun 23, 2024 by samsja
1
5
Batch size beginning to vary half way through epoch bug Something isn't working help wanted Extra attention is needed
#179 opened Jun 21, 2024 by MarcoForte
7
Data shard delation with multi GPU does not work bug Something isn't working help wanted Extra attention is needed
#140 opened May 24, 2024 by rakro101
4
Adding breakpoint in random_images function crashes pdb bug Something isn't working help wanted Extra attention is needed
#134 opened May 21, 2024 by cgebbe
4
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.