← Back to article

Equation 7 · Building a Multimodal AI Application That Actually Uses Its Inputs

What does this equation mean?

Δm=Accfull−Accablate(m).\Delta_m = \mathrm{Acc}_{\mathrm{full}} - \mathrm{Acc}_{\mathrm{ablate}(m)}.

Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.

Inputs and operationsAcc_full - Acc_ablate(m)
Result or conditionDelta_m
How to read the two sides of this formula. Follow the article passage for the meaning of each quantity.

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.

Read it piece by piece

Δm\Delta_m

Symbol Delta_m

the small.

Understand this part →

mm

Symbol m

m is part of the quantity the equation computes from the expression on the right.

Understand this part →

=

=

The expressions on both sides represent the same quantity under the stated assumptions.

Understand this part →

See an illustrated explanation →
subtraction

subtraction

Subtract the following term or group from the preceding one. A leading minus marks a negative quantity.

Understand this part →

subscript

subscript

The lower label selects a particular version, component, or indexed member of the quantity. For example, x₀ and xₜ can be values at different positions.

Understand this part →

How to interpret it

Read it with the definitions, units, and assumptions supplied by the article.

What the article says around this equation

The formal version is a simple, reportable metric. For a task with a full-input accuracy Accfull\mathrm{Acc}_{\mathrm{full}} and an accuracy Accablate(m)\mathrm{Acc}_{\mathrm{ablate}(m)} measured with modality m removed, blanked, or replaced with noise, define Δm=Accfull−Accablate(m)\Delta_m = \mathrm{Acc}_{\mathrm{full}} - \mathrm{Acc}_{\mathrm{ablate}(m)}. A small Δm\Delta_m for a modality the task specification says should matter is the signature of a unimodal shortcut: the model is scoring well on the full-input evaluation without actually depending on that channel. This is not a hypothetical failure mode. Agrawal and colleagues showed that VQA models trained and evaluated under the field’s original data splits could reach strong scores while relying heavily on the language prior in…
Read the full surrounding passage
The formal version is a simple, reportable metric. For a task with a full-input accuracy Accfull\mathrm{Acc}_{\mathrm{full}} and an accuracy Accablate(m)\mathrm{Acc}_{\mathrm{ablate}(m)} measured with modality m removed, blanked, or replaced with noise, define Δm=Accfull−Accablate(m)\Delta_m = \mathrm{Acc}_{\mathrm{full}} - \mathrm{Acc}_{\mathrm{ablate}(m)}. A small Δm\Delta_m for a modality the task specification says should matter is the signature of a unimodal shortcut: the model is scoring well on the full-input evaluation without actually depending on that channel. This is not a hypothetical failure mode. Agrawal and colleagues showed that VQA models trained and evaluated under the field’s original data splits could reach strong scores while relying heavily on the language prior in the question rather than the image content, and that rebuilding the dataset so that identical questions paired with different images required different answers collapsed that shortcut and exposed the true, much lower, vision-grounded accuracy [ 3 ] . Geirhos and colleagues generalise the underlying failure beyond any one benchmark: a network trained by gradient descent to minimise a loss will find the least-effort decision rule that satisfies the training objective, and if a shortcut feature is available and correlates with the label on the training and evaluation distributions, the network will use it regardless of whether the shortcut is what the task designer intended to teach — a pattern the authors document across vision, language, and other domains, and one that standard held-out test accuracy does not detect if the shortcut happens to generalise as far as the test set does [ 14 ] .

Read the equation in its article →

Sources cited in the surrounding passage

These citations give research context. Read each source to check which claims it supports.

Return to Building a Multimodal AI Application That Actually Uses Its Inputs

See this formula across 1 published context →

Browse the mathematical compendium →