Code

bert run_pretraining sh#170

Code

Draft

ouyangyu wants to merge 12 commits intomasterOneflow-Inc/OneFlow-Benchmark:masterfrom dev_of_bert_run_pretrainingOneflow-Inc/OneFlow-Benchmark:dev_of_bert_run_pretrainingCopy head branch name to clipboard

+932-5

Commits

Commits on Jan 12, 2021

• bert pretraining adam squad sh

  ouyangyu

  committed
  05ddf09

  Copy full SHA for 05ddf09

Commits on Jan 14, 2021

• args num_accumulation_steps

  ouyangyu

  committed
  de98fac

  Copy full SHA for de98fac

• fix args

  ouyangyu

  committed
  89b4e05

  Copy full SHA for 89b4e05

Commits on Jan 19, 2021

• fix batch_size

  ouyangyu

  committed
  ed66b48

  Copy full SHA for ed66b48

Commits on Jan 20, 2021

• bert lamb

  ouyangyu

  committed
  0e4d46b

  Copy full SHA for 0e4d46b

• lamb weight decay

  ouyangyu

  committed
  52adf9f

  Copy full SHA for 52adf9f

Commits on May 19, 2021

• run_pretraining.py Add some parameters.

  Show description for 647dbd6
  luqiang-guo

  committed
  647dbd6

  Copy full SHA for 647dbd6

• Revert "run_pretraining.py Add some parameters."

  Show description for a4299c0
  luqiang-guo

  committed
  a4299c0

  Copy full SHA for a4299c0

• run_pretraining.py Add some parameters.

  Show description for 1ec5a65
  luqiang-guo

  committed
  1ec5a65

  Copy full SHA for 1ec5a65

Commits on May 20, 2021

• Organize files and move them to the tools file directory

  luqiang-guo

  committed
  728dd68

  Copy full SHA for 728dd68

• Modify path

  luqiang-guo

  committed
  7f98272

  Copy full SHA for 7f98272

Commits on May 27, 2021

• Merge pull request #190 from Oneflow-Inc/dev_add_bert_automated_test

  Show description for 5d21438
  ouyangyu

  authored
  5d21438

  Copy full SHA for 5d21438