← All parts of this equation

Equation 6 · Part 1 · From Autocomplete to Delegation: The Technical History Behind OpenAI Codex

Symbol a_t

at∼πθ(a∣o≤t,ht,g),ot+1=E(st,at),a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t),
ata_t

What this part means

ata_t is part of the quantity the equation computes from the expression on the right.

Its job in the formula

ata_t is part of the quantity the equation computes from the expression on the right.

The passage around this formula

An agent trajectory can be represented as at∼πθ(a∣o≤t,ht,g),ot+1=E(st,at)a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t). where the model policy chooses an action, environment E executes it against state sts_t , and the result becomes the next observation. This closes a feedback loop absent from one-shot completion.

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.