Code

Restore HeLI models (use 2.0)#5

Code

Merged

ZJaume merged 15 commits intomainZJaume/heliport:mainfrom heli2.0ZJaume/heliport:heli2.0Copy head branch name to clipboardOct 3, 2024

+12,218,716-10,639,852

Commits

Commits on Oct 2, 2024

• Bring back HeLI language models (HeLI 2.0)

  ZJaume

  committed
  8f04dd7

  Copy full SHA for 8f04dd7

• Better handling of CJK

  Show description for 7d220ec
  ZJaume

  committed
  7d220ec

  Copy full SHA for 7d220ec

• Load conficencethresholds

  ZJaume

  committed
  dab695a

  Copy full SHA for dab695a

• Use confidence values to alter prediction

  Show description for 3e85f16
  ZJaume

  committed
  3e85f16

  Copy full SHA for 3e85f16

• Fix compilation for Rust < 1.80

  ZJaume

  committed
  143d05c

  Copy full SHA for 143d05c

• Convert anyhow::Err's to PyErr

  ZJaume

  committed
  afcb6b7

  Copy full SHA for afcb6b7

• Add TODO's for missing features in Python

  ZJaume

  committed
  75c21fd

  Copy full SHA for 75c21fd

• Collapse to macro to obtain confidence thresholds

  ZJaume

  committed
  6799a8b

  Copy full SHA for 6799a8b

• Print input text without modifications in debug

  ZJaume

  committed
  a0b3dfe

  Copy full SHA for a0b3dfe

Commits on Oct 3, 2024

• Update README with differences with HeLI

  ZJaume

  committed
  c9c46f7

  Copy full SHA for c9c46f7

• Enable confidence by default.

  Show description for d9525a0
  ZJaume

  committed
  d9525a0

  Copy full SHA for d9525a0

• Update identifier tests

  ZJaume

  committed
  c3288ce

  Copy full SHA for c3288ce

• Compute confidence only with macrolangs collapsed

  ZJaume

  committed
  c6821f3

  Copy full SHA for c6821f3

• Allow loading model text from all languages or only a subset

  ZJaume

  committed
  9a4764f

  Copy full SHA for 9a4764f

• Update languagemodel tests

  ZJaume

  committed
  c7f14df

  Copy full SHA for c7f14df