Skip to content

Commit

Permalink
Clarify override comment
Browse files Browse the repository at this point in the history
  • Loading branch information
callumm-graphcore committed Oct 26, 2023
1 parent 6832a09 commit cc6adba
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions graphium/cli/train_finetune_test.py
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,7 @@ def get_replication_factor(cfg):
def get_gradient_accumulation_factor(cfg):
"""
WARNING: This MUST be called after accelerator overrides have been applied
(i.e. after `load_accelerator` has been called)
"""
try:
# Navigate through the nested dictionaries and get the gradient accumulation factor
Expand All @@ -89,6 +90,7 @@ def get_gradient_accumulation_factor(cfg):
def get_training_batch_size(cfg):
"""
WARNING: This MUST be called after accelerator overrides have been applied
(i.e. after `load_accelerator` has been called)
"""
try:
# Navigate through the nested dictionaries and get the training batch size
Expand Down

0 comments on commit cc6adba

Please sign in to comment.