subscript

The passage around this formula

Start with the architecture that gives the pattern its name. A query is encoded, a retriever returns its top- k passages against a fixed index, and a generator conditions on those passages to produce one answer. No step revisits an earlier one. Lewis and colleagues’ original formulation makes the mechanism explicit: writing x for the query, y for the output, and z for a retrieved passage drawn from a top- k set $\mathcal{Z}_k(x)$ , the model marginalises over that set, $p(y \mid x) \approx \sum_{z \in \mathcal{Z}_k(x)} p_\eta(z \mid x)\, p_\theta(y \mid x, z)$. with retriever parameters $\eta$ and generator parameters $\theta$ [ 1 ] . One retrieval call, one generation pass, and the entire system’s dependence on the corpus runs through that single set $\mathcal{Z}_k(x)$…

Read this part in the article →