Definition
Arize Phoenix is an open-source observability library designed for tracing, evaluating, and visualizing the performance of LLM applications and RAG pipelines, facilitating the identification of retrieval failures and model hallucinations through OpenTelemetry-based instrumentation.
Distinct from the Elixir web framework; specifically refers to AI observability and evaluation for production-grade agents.
"Phoenix = A Black Box Flight Recorder for AI Agents, capturing every pivot, retrieved document, and model thought-process for post-flight analysis."
- Tracing(Prerequisite)
- RAG Evaluation (RAGas)(Component)
- Vector Embedding Visualization(Component)
Conceptual Overview
Arize Phoenix is an open-source observability library designed for tracing, evaluating, and visualizing the performance of LLM applications and RAG pipelines, facilitating the identification of retrieval failures and model hallucinations through OpenTelemetry-based instrumentation.
Disambiguation
Distinct from the Elixir web framework; specifically refers to AI observability and evaluation for production-grade agents.
Visual Analog
Phoenix = A Black Box Flight Recorder for AI Agents, capturing every pivot, retrieved document, and model thought-process for post-flight analysis.