Merge branch 'sc21' into 'main'

scripts for sc21

See merge request ADLR/megatron-lm!298

Merge branch 'TOC-fix' into 'main'

TOC fix

See merge request ADLR/megatron-lm!208

Merge branch 'readme_update' into 'main'

Update scaling numbers in README and other small tweaks.

See merge request ADLR/megatron-lm!130

Updated with minor fix to l2 norm computation.

Merge branch 'torchddp' into 'master'

Use DDP command line argument instead of source flag in pretrain_bert.py.

See merge request ADLR/megatron-lm!2

initial commit