1.10.2
Non backward compatible changes
- None - this release if fully compatible with the previous release.
New Features
- added num_proc parameter - Optional integer to specify the number of processes to use for parallel dataset loading by @csrajmohan in #974
- Add option to lazy load hf inference engine and fix requirements mechanism by @elronbandel in #980
- Add code mixing metric, add language identification task, add format for Starling model by @arielge in #956
- Add metrics: domesticated safety and regard by @dafnapension in #983
- Make input_format required field in InputOutputTemplate by @elronbandel in #982
- Added a format based on Huggingface format by @yoavkatz in #988
Bug Fixes
- Fix the error at the examples table by @eladven in #976
- fix MRR RAG metric - fix MRR wiring, allow the context_ids to be a list of strings, instead of a list[list[str]]. This allows directly passing the list of predicted context ids, as was done in unitxt version 1.7. added corresponding tests. by @matanor in #969
- Fix llama_3_ibm_genai_generic_template by @lga-zurich in #978
Documentation
- Add an example that shows how to use LLM as a judge that takes the references into account… by @eladven in #981
Refactoring
- Delete empty metrics folder by @elronbandel in #984
Testing and CI/CD
New Contributors
- @lga-zurich made their first contribution in #978
Full Changelog: 1.10.1...1.10.2