Equation 5 · AI Agent Architecture in 2035: Four Scenarios, Their Signals, and What Would Falsify Them
What does this equation mean?
Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.
This equation states a bound: one expression must stay on the indicated side of the other under the article’s assumptions. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.
Read it piece by piece
Symbol a
a is an argument of the function-like quantity on the left; its role is set by that function’s stated inputs.
Symbol p
p is an input to the expression that computes the quantity on the left.
Symbol S
S is an input to the expression that computes the quantity on the left.
=
The expressions on both sides represent the same quantity under the stated assumptions.
See an illustrated explanation →How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
What the article says around this equation
Whether human-approval checkpoints become automated and statistical is, likewise, mostly a readout of Axis B rather than a genuinely separate question. A useful way to see the dependency is to write the automation decision as a threshold rule. Let p(a) be a certified upper bound on the probability that action a violates its specification, and let S(a) be a severity score for the consequence class a belongs to. A natural rule an organization or regulator could adopt is . where B is a risk budget set by policy. The rule only does useful work where p(a) is a number someone can trust — which is exactly what Axis B’s certified branch would supply and its empirical branch would…
Read the full surrounding passage
Whether human-approval checkpoints become automated and statistical is, likewise, mostly a readout of Axis B rather than a genuinely separate question. A useful way to see the dependency is to write the automation decision as a threshold rule. Let p(a) be a certified upper bound on the probability that action a violates its specification, and let S(a) be a severity score for the consequence class a belongs to. A natural rule an organization or regulator could adopt is . where B is a risk budget set by policy. The rule only does useful work where p(a) is a number someone can trust — which is exactly what Axis B’s certified branch would supply and its empirical branch would not. Under empirical, best-effort reliability, the closest available substitute for p(a) is a benchmark pass rate like tau-bench’s, which the benchmark’s own authors built a new metric to correct for precisely because it was not a stable, trial-to-trial guarantee [ 10 ] . Plugging an unstable estimate into the rule above collapses it to “human required” for anything consequential, regardless of how the automation policy is worded — which is why Article 14’s current human-oversight requirement sits comfortably on Axis B’s empirical branch rather than needing a rule of its own [ 13 ] . The approval question does not have independent content beyond asking, again, whether Axis B resolves toward certified or stays empirical.
Sources cited in the surrounding passage
- [10] tau-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains ↗
- [13] Article 14: Human Oversight — EU Artificial Intelligence Act ↗
These citations give research context. Read each source to check which claims it supports.
Return to AI Agent Architecture in 2035: Four Scenarios, Their Signals, and What Would Falsify Them