Skip to content
anythingai.space
Retrieval & RAGintermediate12 min · 10 steps

Chunking Mechanics

The details that decide where a chunk starts and stops: sliding windows and overlap, token-accurate sizing, similarity merging, and keeping pages, lists and figures intact.

boundary recall62%
duplicated text0%
CHUNK 1…policy §4.Refunds are allowedwithin 14 daysCHUNK 2— except annual plans,which require written approval.§5 Invoices…✂ cut lands mid-rule: the exception is orphaned
data
metrics are illustrative
1 / 10
ProblemStep 1 of 10

The answer straddles a chunk boundary

A compliance rule reads: “Refunds are allowed within 14 days — except for annual plans, which require written approval.” A fixed-size splitter cuts right after “14 days”.

Chunk 1 now states a rule without its exception; chunk 2 holds an exception without its rule. Neither retrieves well, and the one that does misleads the model.

Watch outBoundary losses are invisible in aggregate metrics — they show up as confidently incomplete answers.

Lesson 19 of 37 in Retrieval & RAG