← Back to article

Equation 10 · What Alignment Actually Costs

What does this equation mean?

nn

Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.

the practical reason the labeller headcounts above are so low. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.

Read it piece by piece

nn

Symbol n

the practical reason the labeller headcounts above are so low.

Understand this part →

How to interpret it

Read this expression with the definitions, units, and assumptions supplied by the article.

What the article says around this equation

That ceiling on n is the practical reason the labeller headcounts above are so low. At even the lower historical human-feedback price, filling a dataset an order of magnitude larger than InstructGPT’s would cost in the low hundreds of thousands of US dollars — a real but modest sum next to a frontier training budget, and yet one that competes for the same specialised recruiting pipeline, the same quality-control overhead, and the same limited pool of raters who can be trusted to agree with a house standard closely enough to be useful. Money alone does not remove the bottleneck; the InstructGPT and HH-RLHF datasets were both built by teams in the tens of people not because a larger budget was…
Read the full surrounding passage
That ceiling on n is the practical reason the labeller headcounts above are so low. At even the lower historical human-feedback price, filling a dataset an order of magnitude larger than InstructGPT’s would cost in the low hundreds of thousands of US dollars — a real but modest sum next to a frontier training budget, and yet one that competes for the same specialised recruiting pipeline, the same quality-control overhead, and the same limited pool of raters who can be trusted to agree with a house standard closely enough to be useful. Money alone does not remove the bottleneck; the InstructGPT and HH-RLHF datasets were both built by teams in the tens of people not because a larger budget was unavailable, but because vetting and retaining more reliable raters is the actual constraint, and it does not scale linearly with spend.

Read the equation in its article →

Sources cited in the article section

These citations give research context. Read each source to check which claims it supports.

Return to What Alignment Actually Costs

Browse the mathematical compendium →