Code

Add epochs to levanter#768

Code

Merged

ahmeda14960 merged 38 commits intomainstanford-crfm/levanter:mainfrom sftstanford-crfm/levanter:sftCopy head branch name to clipboardNov 7, 2024

+857-19

Commits

Commits on Oct 16, 2024

• wip epochs

  ahmeda14960

  committed
  234a945

  Copy full SHA for 234a945

• fix

  ahmeda14960

  committed
  f0b1eaa

  Copy full SHA for f0b1eaa

• add epoch flag, sanity check tulu one epoch

  ahmeda14960

  committed
  020a1b2

  Copy full SHA for 020a1b2

• epochs work

  ahmeda14960

  committed
  50500b9

  Copy full SHA for 50500b9

• minor fix

  ahmeda14960

  committed
  49afb5d

  Copy full SHA for 49afb5d

• fix ci

  ahmeda14960

  committed
  c2ed3ee

  Copy full SHA for c2ed3ee

• fix ci

  ahmeda14960

  committed
  667a5a3

  Copy full SHA for 667a5a3

Commits on Oct 17, 2024

• fix config file

  ahmeda14960

  committed
  37e77fb

  Copy full SHA for 37e77fb

Commits on Oct 18, 2024

• add suggested fix from david

  ahmeda14960

  committed
  7c195ba

  Copy full SHA for 7c195ba

Commits on Oct 23, 2024

• Merge remote-tracking branch 'origin/main' into sft

  ahmeda14960

  committed
  e71ed16

  Copy full SHA for e71ed16

• restore toml

  ahmeda14960

  committed
  54a6007

  Copy full SHA for 54a6007

• Update src/levanter/callbacks.py

  Show description for e2646d6
  

  ahmeda14960

  and

  dlwh

  authored
  e2646d6

  Copy full SHA for e2646d6

• refactor

  ahmeda14960

  committed
  fd18cae

  Copy full SHA for fd18cae

• add suggested fix from david

  ahmeda14960

  committed
  1706803

  Copy full SHA for 1706803

• update for v4 so we don't crash

  ahmeda14960

  committed
  f0ca163

  Copy full SHA for f0ca163

• remove changes that break epochs

  ahmeda14960

  committed
  c971ebf

  Copy full SHA for c971ebf

• final fixes

  ahmeda14960

  committed
  4733f3b

  Copy full SHA for 4733f3b

Commits on Oct 24, 2024

• final fixes

  ahmeda14960

  committed
  e82eec2

  Copy full SHA for e82eec2

• substatial changes to save on epochs w callback

  ahmeda14960

  committed
  08fd427

  Copy full SHA for 08fd427

• epoch tracking still broken

  ahmeda14960

  committed
  18a5352

  Copy full SHA for 18a5352

Commits on Oct 25, 2024

• Merge remote-tracking branch 'origin/main' into sft

  ahmeda14960

  committed
  f1ef2c7

  Copy full SHA for f1ef2c7

• WIP

  ahmeda14960

  committed
  c38b076

  Copy full SHA for c38b076

Commits on Oct 28, 2024

• update epochs to save latest checkpoints

  ahmeda14960

  committed
  7331774

  Copy full SHA for 7331774

• Update src/levanter/checkpoint.py

  Show description for aa47d4e
  

  ahmeda14960

  and

  dlwh

  authored
  aa47d4e

  Copy full SHA for aa47d4e

• update tulu config to match olmo sft

  ahmeda14960

  committed
  0148cd0

  Copy full SHA for 0148cd0

• Merge remote-tracking branch 'origin/sft' into sft

  ahmeda14960

  committed
  a7459e0

  Copy full SHA for a7459e0

• Merge remote-tracking branch 'origin/main' into sft

  ahmeda14960

  committed
  dde75ac

  Copy full SHA for dde75ac

• pre commit

  ahmeda14960

  committed
  5343096

  Copy full SHA for 5343096

Commits on Oct 29, 2024

• fix sft bug caused by exemplar

  Show description for fd39828
  ahmeda14960

  committed
  fd39828

  Copy full SHA for fd39828

• add actual sft file

  ahmeda14960

  committed
  313a3f4

  Copy full SHA for 313a3f4

• precommit

  ahmeda14960

  committed
  b3718c1

  Copy full SHA for b3718c1

• sft working w levanter chkpt

  ahmeda14960

  committed
  5f36eb8

  Copy full SHA for 5f36eb8

• add back option for hf models on sft

  ahmeda14960

  committed
  f5533d6

  Copy full SHA for f5533d6

Commits on Oct 30, 2024

• WIP for david

  ahmeda14960

  committed
  91fc5df

  Copy full SHA for 91fc5df

Commits on Oct 31, 2024

• debug epochs

  ahmeda14960

  committed
  ba682ca

  Copy full SHA for ba682ca

Commits on Nov 6, 2024

• load data from marin sources

  ahmeda14960

  committed
  812accb

  Copy full SHA for 812accb

• merge main

  ahmeda14960

  committed
  2d7170c

  Copy full SHA for 2d7170c

Commits on Nov 7, 2024

• merge main

  ahmeda14960

  committed
  caf0a38

  Copy full SHA for caf0a38