Code

Add logprobs functionality#1111

Code

Closed

arielge wants to merge 11 commits intomainIBM/unitxt:mainfrom eval_metrics3IBM/unitxt:eval_metrics3Copy head branch name to clipboard

+196-18

Commits

Commits on Aug 4, 2024

• apply ci_scores for global metric

  Show description for 25216e1
  

  lilacheden

  authored and

  arielge

  committed
  25216e1

• add ci_scores

  Show description for 5492329
  

  lilacheden

  authored and

  arielge

  committed
  5492329

• add logprobs to WML inference engine

  Show description for 085b358
  arielge

  committed
  085b358

Commits on Aug 5, 2024

• processors for inference engine logprob results

  Show description for 4ccafc9
  arielge

  committed
  4ccafc9

• Merge branch 'main' into eval_metrics3

  arielge

  authored
  fd64f62

Commits on Aug 6, 2024

• address PR comments

  Show description for c3fa699
  arielge

  committed
  c3fa699

• secrets baseline

  Show description for b32200d
  arielge

  committed
  b32200d

• add parameter validation

  Show description for 1078828
  arielge

  committed
  1078828

Commits on Aug 7, 2024

• Support deployment space_id for WMLInferenceEngine

  Show description for 083c7cf
  arielge

  committed
  083c7cf

• Merge branch 'main' into eval_metrics3

  arielge

  authored
  4f43a0a

• fix ci computation for global metrics with scoes_prefix

  Show description for e1b301b
  lilacheden

  committed
  e1b301b