← Back to article

Equation 24 · Measuring What a RAG System Retrieves, Not Just What It Answers

What does this equation mean?

kk

Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.

the recall at. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.

Read it piece by piece

kk

Symbol k

the recall at.

Understand this part →

How to interpret it

Read this expression with the definitions, units, and assumptions supplied by the article.

What the article says around this equation

A retrieval metric and a generation metric are not two views of the same fact. They are computed from different inputs, answer different questions, and can point in opposite directions at once. Recall at k , MRR and nDCG score a ranking function against labelled relevance judgements and never see the model’s written words. Faithfulness, answer relevance and groundedness score the written words against whatever context the retriever handed over and never check whether that context was the right one to hand over. An end-to-end accuracy figure blends both into a single number that cannot be decomposed after the fact, and the decomposition in this article shows precisely what gets lost: a system…
Read the full surrounding passage
A retrieval metric and a generation metric are not two views of the same fact. They are computed from different inputs, answer different questions, and can point in opposite directions at once. Recall at k , MRR and nDCG score a ranking function against labelled relevance judgements and never see the model’s written words. Faithfulness, answer relevance and groundedness score the written words against whatever context the retriever handed over and never check whether that context was the right one to hand over. An end-to-end accuracy figure blends both into a single number that cannot be decomposed after the fact, and the decomposition in this article shows precisely what gets lost: a system can answer correctly with no useful retrieval at all, and a system can retrieve perfectly and still fail to write a faithful answer, and the aggregate score treats both as the same outcome.

Read the equation in its article →

For background, read the article’s source list.

Return to Measuring What a RAG System Retrieves, Not Just What It Answers

Browse the mathematical compendium →