Joohyung Yun
Seminars & paper readings › Paper reading

MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

Chen et al., EMNLP 2022 · presented by Joohyung Yun · opens with ACORN (Patel et al., SIGMOD 2024)
Paper readingDSLab NLP seminar · POSTECH · 2024.12.11

Multimodal RAG with one universal encoder and decoder: the two challenges (handling mixed modalities, training them), in-batch pretraining, two-stage fine-tuning, and the error analysis. Opens with a six-slide recap of ACORN, predicate-agnostic hybrid vector search.

slides.pdfpaperacorn paper
Slide 1
Slide 2
Slide 3
Slide 4
Slide 5
Slide 6
Slide 7
Slide 8
Slide 9
Slide 10
Slide 11
Slide 12
Slide 13
Slide 14
Slide 15
Slide 16
Slide 17
Slide 18
Slide 19
Slide 20
Slide 21
Slide 22
Slide 23
Slide 24
Slide 25
Slide 26
Slide 27
Slide 28
Slide 29
Slide 30
Slide 31
Slide 32
Slide 33
Slide 34
1 / 34 ← → keys · swipe · click a thumbnail · → also plays each slide's build steps

← all seminars & paper readings