Benchmarks · corpus-level: one joint index
M3DocVQAmulti-page PDFs · evidence in text, tables, figures · multi-hop
FRAMES-PDFWikipedia questions re-rendered as PDFs · one query needs several documents
Competitors · 14 baselines
text chunkspage / length / structural chunking · LumberChunker · MultiDocFusion …
text graphRAPTOR (from Part 2) · HopRAG
page-level MMM3DocRAG · VDocRAG
MM graphMoLoRAG · SimpleDoc
Metrics
retrievalRecall · MRR · Hit · All (every needed doc found · miss one = fail)
QAEM (exact match) · ANLS · ROUGE-L · METEOR
Fair control · every method gets the same reader (Qwen2.5-VL 7B), the same 16K token budget, and the same encoders (keyword + text embedding + visual embedding) → a difference between rows is a difference of method, not of budget or encoder