Pipelines

Retrieval

Generation

Production

Build a policy question desk with Haystack: components, pipelines, indexing, BM25 and embedding retrieval, filters, RAG, agents, evaluation and tests. No API key needed.

Haystack

Haystack overview

Install Haystack and set up API keys

Installation and setup

Haystack components and pipelines basics

Components, pipelines and a first run

Haystack pipeline connections and validation

Connections: how pipelines check your wiring

Haystack ConditionalRouter for branching

Branches: routing with ConditionalRouter

Haystack Document and InMemoryDocumentStore

Documents and the document store

Haystack indexing pipeline

Indexing: from files to searchable documents

Haystack InMemoryBM25Retriever

BM25 retrieval: keyword search

Haystack metadata filtering

Metadata filters: who may see what

Haystack InMemoryEmbeddingRetriever

Embedding retrieval: search by meaning

Haystack ChatPromptBuilder and Jinja templates

Prompt templates with ChatPromptBuilder

Haystack chat generator component

Chat generators: a stand-in and the real thing

Haystack RAG pipeline end to end

A RAG pipeline: retrieve, prompt, generate, answer

Haystack Agent with tools

Agents and tools

Haystack retrieval evaluation: recall and MRR

Evaluating retrieval

Serialize Haystack pipelines to YAML

Saving pipelines as YAML

Haystack SuperComponent

SuperComponents: a pipeline as one component

Test Haystack pipelines with pytest

Testing components and pipelines

Haystack policy desk with permissions

Policy desk for customers and staff

Generation quiz

What does required_variables on ChatPromptBuilder prevent?