Foundation Models
Building a Multimodal AI Application That Actually Uses Its Inputs
A model that accepts an image is not the same as a model that uses one. A working guide to the decisions that separate the two: API or adapter, what the training pairs must contain, how to test for the unimodal shortcut, and what the tokens actually cost.