Code

[DO NOT MERGE] Ranran hide a2a#1029

Code

Draft

RissyRan wants to merge 18 commits intomainAI-Hypercomputer/maxtext:mainfrom ranran-hide-a2aAI-Hypercomputer/maxtext:ranran-hide-a2aCopy head branch name to clipboard

+520-38

Commits

Commits on Sep 13, 2024

• Toy hide a2a

  gobbleturk

  committed
  d9d5b78

  Copy full SHA for d9d5b78

Commits on Sep 15, 2024

• working on initial hide a2a

  gobbleturk

  committed
  49049e8

  Copy full SHA for 49049e8

• Will test actually assingin input chunk to shard map result

  gobbleturk

  committed
  c12f550

  Copy full SHA for c12f550

• Initial chunking behavior done

  gobbleturk

  committed
  7a478a1

  Copy full SHA for 7a478a1

• The debuggining starts!

  gobbleturk

  committed
  817afa5

  Copy full SHA for 817afa5

• Success!

  gobbleturk

  committed
  a50673c

  Copy full SHA for a50673c

• Working overlap EP + FSDP with shard mapgit add MaxText/my_a2a_playground.py !

  gobbleturk

  committed
  efd0d88

  Copy full SHA for efd0d88

• Hide ff2 a2a as well!

  gobbleturk

  committed
  bfb0c4e

  Copy full SHA for bfb0c4e

Commits on Sep 16, 2024

• Ensure same inputs before and after a2a

  gobbleturk

  committed
  ec51ab8

  Copy full SHA for ec51ab8

• Hide please

  gobbleturk

  committed
  45a82af

  Copy full SHA for 45a82af

Commits on Sep 17, 2024

• pain among pain

  gobbleturk

  committed
  498be64

  Copy full SHA for 498be64

Commits on Nov 12, 2024

• Add custom config

  RissyRan

  committed
  8aa74d9

  Copy full SHA for 8aa74d9

• Add flexibility of configs

  RissyRan

  committed
  622f1c8

  Copy full SHA for 622f1c8

• Add more flexibility to configs

  RissyRan

  committed
  94e675f

  Copy full SHA for 94e675f

• Move EP ahead

  RissyRan

  committed
  d4b86b9

  Copy full SHA for d4b86b9

• fix conflict

  RissyRan

  committed
  bc5e7e2

  Copy full SHA for bc5e7e2

• Merge branch 'mattdavidow-hide-a2a' into ranran-hide-a2a

  RissyRan

  committed
  f159c7e

  Copy full SHA for f159c7e

• fix conflict

  RissyRan

  committed
  511c0bc

  Copy full SHA for 511c0bc