Search results

Multimodal MoE

help wantedExtra attention is neededExtra attention is needed

High Priority

Status: Open.

#61 In xrsrke/pipegoose;

· xrsrke opened on Dec 11, 2023

Distributed CLIP

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#60 In xrsrke/pipegoose;

· xrsrke opened on Dec 10, 2023

DiLoCo replication (DiLoCo: Distributed Low-Communication Training of Language Models)

help wantedExtra attention is neededExtra attention is needed

High Priority

Status: Open.

#59 In xrsrke/pipegoose;

· xrsrke opened on Dec 10, 2023

Making pipeline parallelism compatible with transformers

Status: Open.

#52 In xrsrke/pipegoose;

· xrsrke opened on Dec 1, 2023

End-to-end FP8 training

help wantedExtra attention is neededExtra attention is needed

High Priority

Status: Open.

#45 In xrsrke/pipegoose;

· xrsrke opened on Nov 26, 2023

Automatic module mapping using torch.fx

good first issueGood for newcomersGood for newcomers

Status: Open.

#40 In xrsrke/pipegoose;

· xrsrke opened on Nov 22, 2023

 ·  

v1

Tensor Parallelism

Status: Open.

#37 In xrsrke/pipegoose;

· 3outeille opened on Nov 20, 2023

Distributed Logger

good first issueGood for newcomersGood for newcomers

Status: Open.

#33 In xrsrke/pipegoose;

· xrsrke opened on Nov 14, 2023

Save and load checkpoints

good first issueGood for newcomersGood for newcomers

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#29 In xrsrke/pipegoose;

· xrsrke opened on Nov 8, 2023

Lazy initialization of massive models

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#25 In xrsrke/pipegoose;

· xrsrke opened on Oct 27, 2023

Sequence Parallelism

Status: Open.

#22 In xrsrke/pipegoose;

· xrsrke opened on Oct 25, 2023

Mixture of Experts

Status: Open.

#19 In xrsrke/pipegoose;

· xrsrke opened on Oct 25, 2023