Skip to content

1.10.2

Compare
Choose a tag to compare
@eladven eladven released this 04 Jul 06:17
· 344 commits to main since this release
97243ad

Non backward compatible changes

  • None - this release if fully compatible with the previous release.

New Features

  • added num_proc parameter - Optional integer to specify the number of processes to use for parallel dataset loading by @csrajmohan in #974
  • Add option to lazy load hf inference engine and fix requirements mechanism by @elronbandel in #980
  • Add code mixing metric, add language identification task, add format for Starling model by @arielge in #956
  • Add metrics: domesticated safety and regard by @dafnapension in #983
  • Make input_format required field in InputOutputTemplate by @elronbandel in #982
  • Added a format based on Huggingface format by @yoavkatz in #988

Bug Fixes

  • Fix the error at the examples table by @eladven in #976
  • fix MRR RAG metric - fix MRR wiring, allow the context_ids to be a list of strings, instead of a list[list[str]]. This allows directly passing the list of predicted context ids, as was done in unitxt version 1.7. added corresponding tests. by @matanor in #969
  • Fix llama_3_ibm_genai_generic_template by @lga-zurich in #978

Documentation

  • Add an example that shows how to use LLM as a judge that takes the references into account… by @eladven in #981

Refactoring

Testing and CI/CD

New Contributors

Full Changelog: 1.10.1...1.10.2