← All parts of this equation

Equation 5 · Part 10 · Measuring What a RAG System Retrieves, Not Just What It Answers

Ending index or upper bound: |Q|

MRR=1∣Q∣∑q=1∣Q∣1rankq\mathrm{MRR} = \frac{1}{|Q|}\sum_{q=1}^{|Q|} \frac{1}{\mathrm{rank}_q}
∣Q∣|Q|

What this part means

This label says where the repeated addition, multiplication, or accumulation stops. It sets the last term or end of the range.

Its job in the formula

|Q| occurs below the fraction bar. The quantity above the bar is divided by this expression; zero is excluded as a denominator.

The passage around this formula

Recall at k is the simplest of the four: the fraction of relevant documents that appear anywhere in the top k results. It answers one question only — did the evidence make it into the candidate set at all — and says nothing about where within that set it landed. Mean reciprocal rank answers the positional question for the single best hit: MRR=1∣Q∣∑q=1∣Q∣1rankq\mathrm{MRR} = \frac{1}{|Q|}\sum_{q=1}^{|Q|} \frac{1}{\mathrm{rank}_q}. averaged over a query set Q , where rankq\mathrm{rank}_q is the position of the first relevant result for query q . Mean reciprocal rank was formalised as the primary scoring metric for the TREC-8 Question Answering track, the first large-scale evaluation of domain-independent question answering systems, where it assigned a value of 1/r to a…

Read this part in the article →

Learn the underlying idea

Σ adds a collection of terms. Π multiplies them. The lower and upper labels tell you which terms belong to the collection.

Open the illustrated sums and products: repeat an operation over an index guide →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.