Chunking: the atomic unit of retrieval

Chunking is the most underappreciated decision in RAG. The chunk size, overlap, and boundary strategy determine whether a retrieval system finds the right information or returns fragments stripped of context. A bad chunking strategy cannot be fixed by a better embedding model or a larger LLM.