Advanced Biomedical AIWeeksSyllabusReading listPaper sessionsTerm projectRepository ↗

Week 7: Vision-language and multimodal models

Slides 7-1

Code Notebook · Open in Colab

Papers for Thursday

Animation clips

Each clip comes in two versions. The narrated version has an AI-generated voice and captions; turn them on with the CC button. The silent version is the same animation with its on-screen captions only.

CLIP: matching images with their captions

1 min 43 s

Zero-shot classification, and where it breaks

1 min 58 s

Images as tokens: Med-PaLM M

1 min 52 s

Everything for this week

The Week 7 folder in the repository ↗, with the animation sources, the slides and the session guide.