Improving Retrieval with Query Embedding Normalization

View profile for Amit Sides

AI Engineer | Agentic AI Innovator | LLMOPS/LLM-SecOps

Chunking<->Query Embedding Normalization for Better Semantic and Lexical Retrieval The idea is to adjust the user’s query so that it aligns with the same structure and linguistic style as the document chunks used in the embedding pipeline. Instead of only comparing the raw query to the preprocessed chunks, you transform the query into a similar normalized form—essentially speaking the same “language” as the chunks—so semantic similarity is more accurate and retrieval improves. #AI #RAG #Chunking #Embedding #NER #KNN

  • diagram

To view or add a comment, sign in

Explore content categories