Equation 6 · Part 5 · From Autocomplete to Delegation: The Technical History Behind OpenAI Codex

Symbol h_t

a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t),

h_t

What this part means

$h_t$ is an argument of the function-like quantity on the left; its role is set by that function’s stated inputs.

Its job in the formula

$h_t$ is an argument of the function-like quantity on the left; its role is set by that function’s stated inputs.

Full expressionSymbol h_tArticle meaning

The passage around this formula

An agent trajectory can be represented as $a_t\sim\pi_\theta(a\mid o_{\le t},h_t,g), \qquad o_{t+1}=E(s_t,a_t)$ . where the model policy chooses an action, environment E executes it against state $s_t$ , and the result becomes the next observation. This closes a feedback loop absent from one-shot completion.

Read this part in the article →

Learn the underlying idea

A subscript is a label attached below a symbol. It often selects a time step, component, category, or member of a sequence.

Open the illustrated subscripts: which member of a family? guide →

See this notation across published equations →

Sources cited in the article section

These citations provide research context; check each source for the exact claim it supports.