Fix typo in BERT pretraining script (#6175)

A misplaced `}` meant that the `'enable_adasum'` option was interpreted incorrectly, causing the test to fail.
microsoft · Dec 19, 2020 · 11b0a54 · 11b0a54
1 parent bbb52e9
commit 11b0a54
Showing 1 changed file with 2 additions and 2 deletions.
diff --git a/orttraining/orttraining/test/python/orttraining_run_bert_pretrain.py b/orttraining/orttraining/test/python/orttraining_run_bert_pretrain.py
@@ -437,8 +437,8 @@ def prepare_model(args, device):
                                                 'world_size': args.world_size,
                                                 'local_rank': max(0, args.local_rank),
                                                 'allreduce_post_accumulation': args.allreduce_post_accumulation,
-                                                'deepspeed_zero_optimization': {'stage': args.deepspeed_zero_stage}},
-                                                'enable_adasum': False,
+                                                'deepspeed_zero_optimization': {'stage': args.deepspeed_zero_stage},
+                                                'enable_adasum': False},
                                             'lr_scheduler': lr_scheduler
                                             })