≈

The passage around this formula

Under a fixed context budget B , the largest catalogue that fits is roughly $n_{\max}$ $\approx$ (B - $T_0$)/$\bar{t}$ . The model is a reasonable first approximation, and it is also the assumption a tenfold per-tool variance directly undermines: $\bar t$ is not a constant of the tool, it is a property of how verbosely that tool’s schema and description happen to be written, which is an editorial choice rather than a physical fact about the function. A recent controlled study of exactly this trade-off tested fourteen models from 1.5B to 32B parameters plus one frontier API model across 6,566 controlled tool calls at three context budgets, and found that at an 8K-token budget uncompressed JSON schemas…

Read this part in the article →