v0.5.0

New Experiments

• New Pipeline class with new pipeline run logic - Pipeline example

Full Changelog: v0.4.0...v0.5.0

---

🧬 New Pipeline Logic

This release introduces a reimplementation of the pipeline-run logic to resolve multiple issues, improving reliability and performance. These changes will also be included in Haystack 2.10.

Fixed Issues:

1. Exceptions in pipelines with two cycles

   • Pipelines with two cycles sharing an optional (like in PromptBuilder) or a greedy variadic edge (e.g., in BranchJoiner) might raise exceptions. Details here.

2. Incorrect execution in cycles with multiple optional or variadic edges

   • Entry points for cycles were non-deterministic, causing components to run with unexpected inputs or multiple times. This impacted execution time and final outputs.

3. Missing intermediate outputs in cycles

   • Outputs produced within a cycle were overwritten, preventing downstream components from receiving them.

4. Premature execution of lazy variadic components

   • Components like DocumentJoiner sometimes executed before receiving all inputs, leading to repeated partial executions that affected downstream results.

5. Order-sensitive behavior in add_component and connect

   • Some bugs above occurred due to specific orderings of add_component and connect in pipeline creation, causing non-deterministic behavior in cyclic pipelines.

Am I Affected by this Change?

• Non-cyclic pipelines without lazy variadic components:
  No impact—your pipelines should function as before.

• Non-cyclic pipelines with lazy variadic components:
  Check inputs and outputs of components like DocumentJoiner for issues #4 and #5. Use LoggingTracer with content tracing to validate behavior. Component execution order now uses lexicographical sorting; rename upstream components if necessary.

• Pipelines with cycles:
  Review your pipeline outputs as well as the component input and outputs to ensure expected behavior, as you may encounter any of the above issues.

Share your comments in discussion #177

v0.4.0

New Experiments

• AsyncPipeline and async-enabled components - AsyncPipeline example

Full Changelog: v0.3.0...v0.4.0

v0.3.0

New Experiments

• Metadata extraction with LLM - LLMetadataExtractor
• Support for tools in OllamaChatGenerator , HuggingFaceAPIChatGenerator, AnthropicChatGenerator

Full Changelog: v0.2.0...v0.3.0

v0.2.0

New experiments

• Tool Calling - refactored ChatMessage dataclass, Tool dataclass, refactored OpenAIChatGenerator, ToolInvoker component
• Memory Components - ChatMessageWriter, ChatMessageRetriever, InMemoryChatMessageStore
• Document Splitting & Retrieval Techniques - Auto-Merging Retriever, HierarchicalDocumentSplitter
• Metadata extraction with LLM - LLMetadataExtractor

New Contributors

• @dfokina made their first contribution in #81

Full Changelog: v0.1.1...v0.2.0

v0.1.1

What's Changed

• Add google colab link to the example harness nb by @bilgeyucel in #36
• doc: Fix links to API docs and pip packages in RAG eval harness notebook by @shadeMe in #38
• Improve OpenAPITool corner cases handling (missing operationId, servers under paths, etc) by @vblagoje in #37
• fix: Centralize OpenAPI schema reference resolution by @vblagoje in #40
• feat: Add telemetry to RAG eval harness by @shadeMe in #42
• docs: Add section about telemetry to the readme by @shadeMe in #44
• docs: add OpenAPITool notebook by @anakin87 in #45

New Contributors

• @bilgeyucel made their first contribution in #36
• @anakin87 made their first contribution in #45

Full Changelog: v0.1.0...v0.1.1

v0.1.0

New Experiments 🚀

• An evaluation harness for RAG pipelines
• A function calling component for OpenAI.
• An OpenAPI-based function calling component for OpenAI, Cohere and Anthropic.

Full Changelog: v0.0.1...v0.1.0

v0.0.2.dev0

What's Changed

• feat: Implement PipelinePair primitive and related utility functions by @shadeMe in #4
• feat: Implement abstract EvaluationHarness class by @shadeMe in #5
• refactor: Restructure submodules in evaluation by @shadeMe in #6
• feat: Implement RAGEvaluationHarness and related classes by @shadeMe in #10
• Add context to the README by @masci in #7
• fix: Wheel paths for builds by @shadeMe in #12
• fix: Correct parameter name for faithfulness evaluator and fix component names passed to PipelinePair by @shadeMe in #13
• adding the OpenAIFunctionCaller by @TuanaCelik in #14
• feat: Add ContextRelevanceEvaluator to RAG eval harness by @shadeMe in #15
• feat: LLM-based Evaluators have raise_on_Failure=False by default by @davidsbatista in #16
• feat: Add ground truth documents and answers to RAG eval run results as inputs by @shadeMe in #17
• chore: Add OpenAIFuntionCaller to catalogue by @julian-risch in #18
• build: Fetch build version from Git tag by @shadeMe in #19

New Contributors

• @masci made their first contribution in #7
• @TuanaCelik made their first contribution in #14
• @davidsbatista made their first contribution in #16
• @julian-risch made their first contribution in #18

Full Changelog: v0.0.1...v0.0.2.dev0

v0.0.1

What's Changed

• Add project skeleton by @shadeMe in #1
• build: Fix project structure and version by @shadeMe in #3
• ci: Add workflows by @shadeMe in #2

New Contributors

• @shadeMe made their first contribution in #1

Full Changelog: https://github.com/deepset-ai/haystack-experimental/commits/v0.0.1