Failure is Feedback: History-Aware Backtracking for Agentic Traversal in Multimodal Graphs
summary
Agentic retrieval over multimodal documents must commit to a path without exploring every alternative. FiF treats a failed step as feedback: it backtracks to the last decision point and uses the failure to choose a different branch, reaching state-of-the-art accuracy on MultimodalQA, MMCoQA, and WebQA at lower cost.


