A developer is building a RAG chatbot for an internal knowledge base. To ensure the system retrieves the most relevant chunks, what is the best practice for chunking?
Trap 1: Use very small chunks
Very small chunks may lack sufficient context for accurate retrieval.
Trap 2: Use fixed-size chunks without overlap
Fixed-size without overlap can cut through important context, reducing retrieval relevance.
Trap 3: Use random-sized chunks
Random chunking is unpredictable and degrades retrieval quality.
- A
Use very small chunks
Why wrong: Very small chunks may lack sufficient context for accurate retrieval.
- B
Use semantic chunking with overlap
Semantic chunking preserves natural boundaries, and overlap provides context continuity.
- C
Use fixed-size chunks without overlap
Why wrong: Fixed-size without overlap can cut through important context, reducing retrieval relevance.
- D
Use random-sized chunks
Why wrong: Random chunking is unpredictable and degrades retrieval quality.