megatron_v0.5.0_baseline

octave:
spack load gcc@13.2.0
spack load cuda@12.1.1

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.github		.github
dist		dist
docs		docs
examples		examples
images		images
megatron		megatron
puzzle		puzzle
tasks		tasks
tests		tests
tools		tools
.coveragerc		.coveragerc
.gitignore		.gitignore
.gitlab-ci.yml		.gitlab-ci.yml
CODEOWNERS		CODEOWNERS
CONTRIBUTING.md		CONTRIBUTING.md
Dockerfile.ci		Dockerfile.ci
Dockerfile.test		Dockerfile.test
LICENSE		LICENSE
MANIFEST.in		MANIFEST.in
README.md		README.md
jet-tests.yml		jet-tests.yml
mgt.yaml		mgt.yaml
pretrain_bert.py		pretrain_bert.py
pretrain_gpt.py		pretrain_gpt.py
pretrain_ict.py		pretrain_ict.py
pretrain_llama.py		pretrain_llama.py
pretrain_retro.py		pretrain_retro.py
pretrain_t5.py		pretrain_t5.py
pretrain_vision_classify.py		pretrain_vision_classify.py
pretrain_vision_dino.py		pretrain_vision_dino.py
pretrain_vision_inpaint.py		pretrain_vision_inpaint.py
pretrain_vlm.py		pretrain_vlm.py
pyproject.toml		pyproject.toml
report_theoretical_memory.py		report_theoretical_memory.py
setup.py		setup.py

Provide feedback