Code

feat: updater-scripts#733

Code

Merged

maxmwang merged 55 commits intogqlasuc-octo/berkeleytime:gqlfrom feat-updater-scriptsasuc-octo/berkeleytime:feat-updater-scriptsCopy head branch name to clipboardJan 25, 2025

+3,360-4,959

Commits

Commits on Oct 27, 2024

• base section script

  adit-bala

  committed
  90145f5

  Copy full SHA for 90145f5

Commits on Oct 28, 2024

• modularize data fetching

  adit-bala

  committed
  101301a

  Copy full SHA for 101301a

• new Course & Class Schema

  adit-bala

  committed
  f523109

  Copy full SHA for f523109

Commits on Nov 2, 2024

• courseParser & classParser

  adit-bala

  committed
  7099aac

  Copy full SHA for 7099aac

• Merge branch 'gql' into feat-updater-scripts

  mathhulk

  committed
  7f4e9c9

  Copy full SHA for 7f4e9c9

Commits on Nov 3, 2024

• don't use terms for course api

  adit-bala

  committed
  537af49

  Copy full SHA for 537af49

• add batching from @mathhulk

  adit-bala

  committed
  7b9b141

  Copy full SHA for 7b9b141

• insert results into the database

  adit-bala

  committed
  e8a0f2b

  Copy full SHA for e8a0f2b

Commits on Nov 4, 2024

• only delete relevant objects

  adit-bala

  committed
  3f81826

  Copy full SHA for 3f81826

• add mongodb loader

  adit-bala

  committed
  d43c524

  Copy full SHA for d43c524

Commits on Nov 5, 2024

• update optional fields for course

  adit-bala

  committed
  edc75d1

  Copy full SHA for edc75d1

• don't include invalid data

  adit-bala

  committed
  a0a6122

  Copy full SHA for a0a6122

Commits on Nov 7, 2024

• simplify course and class

  adit-bala

  committed
  1d6f78f

  Copy full SHA for 1d6f78f

Commits on Nov 11, 2024

• add required fields for section

  adit-bala

  committed
  ff86b7c

  Copy full SHA for ff86b7c

• add testing script

  adit-bala

  committed
  e7838e9

  Copy full SHA for e7838e9

Commits on Nov 17, 2024

• init infra changes

  adit-bala

  committed
  c2e46aa

  Copy full SHA for c2e46aa

• denote required fields in typescript

  adit-bala

  committed
  469e691

  Copy full SHA for 469e691

Commits on Nov 21, 2024

• decouple datapuller infra

  adit-bala

  committed
  676a797

  Copy full SHA for 676a797

• feat: log total errors for datapuller

  adit-bala

  committed
  57e1931

  Copy full SHA for 57e1931

• rm dependecy

  adit-bala

  committed
  9867932

  Copy full SHA for 9867932

Commits on Nov 25, 2024

• fix: keep datapuller infra in app

  adit-bala

  committed
  a0e165c

  Copy full SHA for a0e165c

• chore: migrate logic to one file

  adit-bala

  committed
  85d99ba

  Copy full SHA for 85d99ba

Commits on Nov 26, 2024

• chore: add encrypted env vars

  adit-bala

  committed
  489859d

  Copy full SHA for 489859d

• Merge branch 'gql' into feat-updater-scripts

  adit-bala

  committed
  d8d099d

  Copy full SHA for d8d099d

• feat: logging + cleanup of logs

  adit-bala

  committed
  ad36e05

  Copy full SHA for ad36e05

• fix: error types

  adit-bala

  committed
  c4b729a

  Copy full SHA for c4b729a

• chore: more detailed logging

  adit-bala

  committed
  e4d8e4a

  Copy full SHA for e4d8e4a

• fix: proper define

  adit-bala

  committed
  93adeab

  Copy full SHA for 93adeab

• fix: remove dev check

  adit-bala

  committed
  5a2f5ee

  Copy full SHA for 5a2f5ee

Commits on Dec 1, 2024

• fix additional {end}

  maxmwang

  committed
  f4f30d6

  Copy full SHA for f4f30d6

• package-lock

  maxmwang

  committed
  4eebf84

  Copy full SHA for 4eebf84

• fix {{}} whitespacing

  maxmwang

  committed
  4226250

  Copy full SHA for 4226250

• force string tag

  maxmwang

  committed
  16ce976

  Copy full SHA for 16ce976

• fix helm chart

  maxmwang

  committed
  38a4716

  Copy full SHA for 38a4716

Commits on Dec 2, 2024

• add datapuller to cd, specify cronjob timezone

  maxmwang

  committed
  0ebffb7

  Copy full SHA for 0ebffb7

• specify datapuller image tags

  maxmwang

  committed
  f74d8e1

  Copy full SHA for f74d8e1

• feat: modular cronjob entrypoint script

  adit-bala

  committed
  76fad25

  Copy full SHA for 76fad25

• fix: include datapuller-prod?

  adit-bala

  committed
  3285ff0

  Copy full SHA for 3285ff0

Commits on Dec 3, 2024

• Merge branch 'gql' into feat-updater-scripts

  mathhulk

  committed
  058aaf7

  Copy full SHA for 058aaf7

• Merge remote-tracking branch 'refs/remotes/origin/feat-updater-scripts' into feat-updater-scripts

  mathhulk

  committed
  3eaec29

  Copy full SHA for 3eaec29

Commits on Dec 4, 2024

• fix: add command to enable datapuller-prod

  adit-bala

  committed
  0eb3d4f

  Copy full SHA for 0eb3d4f

• fix: remove unused env

  adit-bala

  committed
  0f026b9

  Copy full SHA for 0f026b9

Commits on Jan 17, 2025

• Merge branch 'gql' into feat-updater-scripts

  maxmwang

  committed
  7df33dd

  Copy full SHA for 7df33dd

Commits on Jan 18, 2025

• remove file logging, reorganize

  maxmwang

  committed
  8250eaf

  Copy full SHA for 8250eaf

• lint

  maxmwang

  committed
  3e43073

  Copy full SHA for 3e43073

• add/modify unique constraints to schemas

  maxmwang

  committed
  7f2091a

  Copy full SHA for 7f2091a

• fix deployment bug, add schema indices

  maxmwang

  committed
  3b5c16d

  Copy full SHA for 3b5c16d

• force process exit when script completes

  maxmwang

  committed
  7031044

  Copy full SHA for 7031044

• string tag

  maxmwang

  committed
  9f6d9e0

  Copy full SHA for 9f6d9e0

Commits on Jan 20, 2025

• Merge remote-tracking branch 'refs/remotes/origin/feat-updater-scripts' into feat-updater-scripts

  mathhulk

  committed
  a8d8efa

  Copy full SHA for a8d8efa

Commits on Jan 24, 2025

• Separate logic out of scripts for data pulling and parsing (#763)

  Show description for 5a1e316
  

  mathhulk

  and

  maxmwang

  authored
  5a1e316

  Copy full SHA for 5a1e316

Commits on Jan 25, 2025

• remove unique constraint on indices

  maxmwang

  committed
  1b28e74

  Copy full SHA for 1b28e74

• polish

  maxmwang

  committed
  69c0c7b

  Copy full SHA for 69c0c7b

• remove updater helm templates

  maxmwang

  committed
  3597f52

  Copy full SHA for 3597f52

• update schedules

  maxmwang

  committed
  57c39f5

  Copy full SHA for 57c39f5