Code

修正梯度累加及分佈式訓練的 Loss 計算錯誤#16

Code

Open

ShinoharaHare wants to merge 5 commits intomainShinoharaHare/LLM-Training:mainfrom fix-ga-dpShinoharaHare/LLM-Training:fix-ga-dpCopy head branch name to clipboard

+160-31

Commits

Commits on Jan 4, 2025

• 修正 CLM Loss 在 GA 及 DP 時計算錯誤

  ShinoharaHare

  committed
  441d602

  Copy full SHA for 441d602

• Merge branch 'main' into fix-ga-dp

  ShinoharaHare

  committed
  591acf3

  Copy full SHA for 591acf3

Commits on Jan 5, 2025

• 調整損失計算的累積條件

  ShinoharaHare

  committed
  72748a6

  Copy full SHA for 72748a6

Commits on Jan 6, 2025

• Merge branch 'main' into fix-ga-dp

  ShinoharaHare

  committed
  6ab6f95

  Copy full SHA for 6ab6f95

• Merge branch 'main' into fix-ga-dp

  ShinoharaHare

  committed
  0970acf

  Copy full SHA for 0970acf