Definition
Haystack is an open-source Python orchestration framework designed for building production-ready RAG pipelines and agentic workflows through a modular, component-based architecture. It utilizes Directed Acyclic Graphs (DAGs) to manage data flow between document stores, retrievers, and LLMs, offering a trade-off between high-level abstraction for rapid development and granular control over pipeline execution paths.
An orchestration framework by deepset, distinct from the 'Needle-in-a-Haystack' performance evaluation benchmark.
"An industrial assembly line where modular stations (retrievers, rankers, generators) are connected by configurable conveyor belts to transform raw data into an answer."
Conceptual Overview
Haystack is an open-source Python orchestration framework designed for building production-ready RAG pipelines and agentic workflows through a modular, component-based architecture. It utilizes Directed Acyclic Graphs (DAGs) to manage data flow between document stores, retrievers, and LLMs, offering a trade-off between high-level abstraction for rapid development and granular control over pipeline execution paths.
Disambiguation
An orchestration framework by deepset, distinct from the 'Needle-in-a-Haystack' performance evaluation benchmark.
Visual Analog
An industrial assembly line where modular stations (retrievers, rankers, generators) are connected by configurable conveyor belts to transform raw data into an answer.