Code

Multi class pretraining#49

Code

Closed

gabrieltseng wants to merge 18 commits intomainWorldCereal/presto-worldcereal:mainfrom multi-class-pretrainingWorldCereal/presto-worldcereal:multi-class-pretrainingCopy head branch name to clipboard

+372-500

Commits

Commits on Feb 12, 2024

• WIP

  gabrieltseng

  committed
  76ff948

• Consolidate everything

  gabrieltseng

  committed
  dbb14e0

• s -> f

  gabrieltseng

  committed
  b3efb5a

• RuntimeError: expected scalar type Long but found Float

  gabrieltseng

  committed
  907a773

• More finetuning

  gabrieltseng

  committed
  624bec6

Commits on Feb 13, 2024

• Don't change too many things at once

  gabrieltseng

  committed
  51b5f19

Commits on Feb 23, 2024

• Pass the valid_month as an additional token

  gabrieltseng

  committed
  e4d2979

• Update test file to include a valid_date

  gabrieltseng

  committed
  b05a16c

• Load_pretrained False by default now that we have added this new embedding layer

  gabrieltseng

  committed
  b5230b5

• Update tests

  gabrieltseng

  committed
  aa3c370

• Update tests

  gabrieltseng

  committed
  a3a4f44

• strict=False when loading state_dict in train.py

  gabrieltseng

  committed
  5860314

• 🤦

  gabrieltseng

  committed
  c106805

Commits on Mar 6, 2024

• init valid month encoding

  gabrieltseng

  committed
  5c5496f

• More flexibility in how we use the val month

  gabrieltseng

  committed
  59b626c

• Fix kwarg

  gabrieltseng

  committed
  f12493f

• Fix finetuning model, handle the case where valid_month is None

  gabrieltseng

  committed
  99dacbc

• Fix test

  gabrieltseng

  committed
  9318948