Code

Use JAX's serialization manager#829

Code

Merged

dlwh merged 10 commits intomainstanford-crfm/levanter:mainfrom use_manager_deserstanford-crfm/levanter:use_manager_deserCopy head branch name to clipboardDec 3, 2024

+202-210

Commits

Commits on Oct 12, 2024

• use the jax serialization manager for deser in an attempt to fix crash. (it doesn't)

  dlwh

  committed
  5bf8cd0

  Copy full SHA for 5bf8cd0

Commits on Oct 13, 2024

• cleaner data loader but ti doesn't help :(

  dlwh

  committed
  20a4568

  Copy full SHA for 20a4568

Commits on Oct 14, 2024

• ok this maybe fixed it?

  dlwh

  committed
  2747705

  Copy full SHA for 2747705

• cleanup

  dlwh

  committed
  538f0ed

  Copy full SHA for 538f0ed

• fix tests

  dlwh

  committed
  2c5ee4b

  Copy full SHA for 2c5ee4b

• fix what is probably the underlying problem

  dlwh

  committed
  ab543d6

  Copy full SHA for ab543d6

• wip

  dlwh

  committed
  6395305

  Copy full SHA for 6395305

Commits on Dec 3, 2024

• enough device puts and we're good

  dlwh

  committed
  87d7665

  Copy full SHA for 87d7665

• ok we're good

  dlwh

  committed
  074d0ec

  Copy full SHA for 074d0ec

• fix tree leaf stuff

  dlwh

  committed
  bf13f12

  Copy full SHA for bf13f12