Skip to content

Issues: bigcode-project/Megatron-LM

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

21 Open 20 Closed
21 Open 20 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Saved model checkpoint in different precision ?
#88 opened May 9, 2024 by Ankush2k
1
IndexError: too many indices for tensor of dimension 2
#87 opened Jan 3, 2024 by YFeather
LM Head FLOPs
#78 opened Sep 28, 2023 by Muennighoff
2
How to use my dataset to finetune
#77 opened Aug 26, 2023 by zxyscz
How to generate several result with num_beams
#75 opened Jul 27, 2023 by Eggwardhan
RuntimeError: Error building extension 'scaled_upper_triang_masked_softmax_cuda'
#61 opened Jun 14, 2023 by KOVVURISATYANARAYANAREDDY
how to prepare the training data to train starcoder?
#60 opened Jun 6, 2023 by wwngh1233
2
ValueError: Invalid attention arguments: AttnType.self_attn, None
#59 opened Jun 6, 2023 by chen-lee-li
1
Incomplete humaneval evaluation code
#57 opened May 30, 2023 by huybery
Support interleaved pipeline schedules in checkpoint merging tools enhancement New feature or request
#45 opened Mar 29, 2023 by RaymondLi0
Improve loading of the data-paths enhancement New feature or request
#38 opened Mar 21, 2023 by RaymondLi0
OOM on preprocessing dataset with large number of documents bug Something isn't working
#34 opened Mar 10, 2023 by RaymondLi0
Lower throughput with UL2 training
#28 opened Feb 20, 2023 by RaymondLi0
Wandb init error bug Something isn't working
#27 opened Feb 17, 2023 by RaymondLi0
Create data composition
#25 opened Feb 7, 2023 by RaymondLi0 Train final model
1
Literature review on scaling laws help wanted Extra attention is needed
#21 opened Jan 26, 2023 by RaymondLi0 Scaling laws for HumanEval
@keyboardAnt
3
Benchmarking Memory Consumption of Optimizers Adam v.s. Adan
#20 opened Jan 25, 2023 by SivilTaram
Conversion of Huggingface bigcode/santacoder to Nvidia Triton Inference server
#17 opened Jan 24, 2023 by michaelfeil
Timeout on creating the index mappings bug Something isn't working
#15 opened Jan 4, 2023 by RaymondLi0
Fine tuning and Pre training scripts
#14 opened Jan 3, 2023 by shaileshj2803
Selection of LLMs architecture
#7 opened Sep 27, 2022 by maoquan-ms
ProTip! Find all open issues with in progress development work with linked:pr.