We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
Updated with minor fix to l2 norm computation.
Merge branch 'torchddp' into 'master' Use DDP command line argument instead of source flag in pretrain_bert.py. See merge request ADLR/megatron-lm!2
initial commit