1.11.1

Non backward compatible changes

• The class InputOutputTemplate has the field input_format. This field becomes a required field. It means that templates should explicitly set their value to None if not using it. by @elronbandel in #982
• fix MRR RAG metric - fix MRR wiring, allow the context_ids to be a list of strings, instead of a list[list[str]]. This allows directly passing the list of predicted context ids, as was done in unitxt version 1.7. added corresponding tests. This change may change the scores of MRR metric. by @matanor in

New Features

• Add the option to specify the number of processes to use for parallel dataset loading by @csrajmohan in #974
• Add option for lazy load hf inference engine by @elronbandel in #980
• Added a format based on Huggingface format by @yoavkatz in #988

New Assets

• Add code mixing metric, add language identification task, add format for Starling model by @arielge in #956

Bug Fixes

• Fix llama_3_ibm_genai_generic_template by @lga-zurich in #978

Documentation

• Add an example that shows how to use LLM as a judge that takes the references into account… by @eladven in #981
• Improve the examples table documentation by @eladven in #976

Refactoring

• Delete empty metrics folder by @elronbandel in #984

Testing and CI/CD

• Add answer correctness tests by @matanor in #977

New Contributors

• @lga-zurich made their first contribution in #978

Full Changelog: 1.10.1...1.10.2