← Back to article

Equation 21 · The Token Tax of Giving a Model More Tools

What does this equation mean?

σ\sigma

Read the formula alongside the article passage below. Each part has a deeper page with its role in the equation, the supporting passage and nearby citations.

the search tool’s own fixed overhead. Read the equation part by part below; each part has a contextual explanation and a link to its mathematical background.

Read it piece by piece

σ\sigma

Symbol σ

the search tool’s own fixed overhead.

Understand this part →

How to interpret it

Read this expression with the definitions, units, and assumptions supplied by the article.

What the article says around this equation

Anthropic’s Tool Search Tool is a direct, documented implementation of that idea. The mechanism is described plainly: “You provide all your tool definitions to the API, but mark tools with deferlr_loading: true to make them discoverable on-demand,” with a lightweight search tool — built-in options include BM25-based and regex-based search — querying an index of names and descriptions, and the full definition of a matching tool injected into context only once the model actually requests it [ 5 ] . The search tool itself is not free, but its overhead is small and fixed rather than proportional to catalogue size: “Only the Tool Search Tool loaded upfront (~500 tokens)” [ 5 ] . Applied to the same…
Read the full surrounding passage
Anthropic’s Tool Search Tool is a direct, documented implementation of that idea. The mechanism is described plainly: “You provide all your tool definitions to the API, but mark tools with deferlr_loading: true to make them discoverable on-demand,” with a lightweight search tool — built-in options include BM25-based and regex-based search — querying an index of names and descriptions, and the full definition of a matching tool injected into context only once the model actually requests it [ 5 ] . The search tool itself is not free, but its overhead is small and fixed rather than proportional to catalogue size: “Only the Tool Search Tool loaded upfront (~500 tokens)” [ 5 ] . Applied to the same 58-tool, roughly 55,000-token example described above, that reframes the earlier formula: instead of the full T(n) ≈\approx τ0\tau_0 + nsˉ\bar{s} , a session that only ever actually needs m of the n available tools pays approximately τ0\tau_0 + σ\sigma + msˉ\bar{s} , where σ\sigma is the search tool’s own fixed overhead. The fraction of the original tax avoided is

Read the equation in its article →

Sources cited in the surrounding passage

These citations give research context. Read each source to check which claims it supports.

Return to The Token Tax of Giving a Model More Tools

Browse the mathematical compendium →