Search results

Have you backed up the Megatron-LM version you use?

Status: Open.

#7 In MoFHeka/LLaMA-Megatron;

· EthanLI24 opened on Dec 11, 2023

MegatronLM 微信讨论组

Status: Open.

#6 In MoFHeka/LLaMA-Megatron;

· anxiangsir opened on Sep 10, 2023

关于LLAMA pretrain相关问题。谢谢～

Status: Open.

#5 In MoFHeka/LLaMA-Megatron;

· zhangbin1997 opened on Jul 22, 2023

关于基于megatron的LLAMA 推理相关代码

Status: Open.

#4 In MoFHeka/LLaMA-Megatron;

· zhangbin1997 opened on Jul 19, 2023

请问 output = torch.matmul(total_input, weight.t()) 此处报错！！！

Status: Open.

#3 In MoFHeka/LLaMA-Megatron;

· zhangbin1997 opened on Jul 16, 2023

Could you please provide some details about tokenizer between Megatron-lm and HF tokenizer?

Status: Open.

#2 In MoFHeka/LLaMA-Megatron;

· yeyunhu opened on Jun 29, 2023

With model parallel still OOM on A100-40G

Status: Open.

#1 In MoFHeka/LLaMA-Megatron;

· LZY-the-boys opened on Jun 28, 2023