Definition
The conversational orchestration layer that manages user session state and history while routing queries through a RAG pipeline or AI agentic loop; it trades off the low latency of traditional NLP bots for the grounded accuracy and reasoning capabilities of LLMs.
Distinguished from static FAQ bots by its use of dynamic retrieval and generative reasoning rather than pre-scripted decision trees.
"A Concierge Desk: An interface that listens to guest requests, consults a private library (RAG), and executes tasks via external services (Agents)."
- Context Window(Prerequisite)
- Memory Management(Component)
- Tool Calling(Component)
Conceptual Overview
The conversational orchestration layer that manages user session state and history while routing queries through a RAG pipeline or AI agentic loop; it trades off the low latency of traditional NLP bots for the grounded accuracy and reasoning capabilities of LLMs.
Disambiguation
Distinguished from static FAQ bots by its use of dynamic retrieval and generative reasoning rather than pre-scripted decision trees.
Visual Analog
A Concierge Desk: An interface that listens to guest requests, consults a private library (RAG), and executes tasks via external services (Agents).