← All parts of this equation

Equation 6 · Part 9 · From Autocomplete to Delegation: The Technical History Behind OpenAI Codex

Symbol s_t

at∼πθ(a∣o≤t,ht,g),ot+1=E(st,at),a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t),
sts_t

What this part means

the environment e executes it against state.

Its job in the formula

sts_t is an input to the expression that computes the quantity on the left.

Where the article explains it

where the model policy chooses an action, environment E executes it against state sts_t , and the result becomes the next observation.

The passage around this formula

An agent trajectory can be represented as at∼πθ(a∣o≤t,ht,g),ot+1=E(st,at)a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t). where the model policy chooses an action, environment E executes it against state sts_t , and the result becomes the next observation. This closes a feedback loop absent from one-shot completion.

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.