Definition
A lexical scoring component that measures the raw occurrence count of a query token within a specific document chunk, acting as a fundamental weight for keyword-based retrieval in hybrid RAG architectures.
Measures exact keyword repetition frequency rather than semantic similarity or vector distance.
"A highlighter pen that marks a page darker every time it encounters the same specific word."
- Inverse Document Frequency (IDF)(Component)
- BM25(Implementation)
- Hybrid Search(Context)
- Lexical Search(Prerequisite)
Conceptual Overview
A lexical scoring component that measures the raw occurrence count of a query token within a specific document chunk, acting as a fundamental weight for keyword-based retrieval in hybrid RAG architectures.
Disambiguation
Measures exact keyword repetition frequency rather than semantic similarity or vector distance.
Visual Analog
A highlighter pen that marks a page darker every time it encounters the same specific word.