Skip to content

Commit

Permalink
Update job_example.slurm
Browse files Browse the repository at this point in the history
  • Loading branch information
marcopoli authored Sep 11, 2024
1 parent f0af4ce commit 1c477f6
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions model_adaptation/job_example.slurm
Original file line number Diff line number Diff line change
Expand Up @@ -34,3 +34,5 @@ export CUDA_LAUNCH_BLOCKING=1
export ACCELERATE_USE_FSDP=0

python3 finetune_llama3.py
#srun torchrun --nnodes 3 --nproc-per-node 4 --rdzv_id $RANDOM --rdzv_backend c10d --rdzv_endpoint $head_node_ip:29500 finetune_llama3.py

0 comments on commit 1c477f6

Please sign in to comment.