MemWalker: LLM Navigation over Summary Trees
① a tree, no traversal
→
② score-based, both ways
→
③ LLM-guided instead
→
④ traversal learned
→
⑤ multimodal
root summary
branch summary A
branch summary B
segment 1
segment 2
segment 3
segment 4
wrong turn, back up
LLM
reads child summaries, picks one
q
original goal: reading documents longer than the reader's context window
The traversal goes to an LLM
· read summaries, reason, descend · back up on a wrong turn
The cost ·
several LLM calls per question
(one per step)
13 / 32