← All symbols

Symbol in context

sts_t

This entry links every published equation using this exact notation. Its meaning may change between equations.

Meanings in context

Used in 17 equations

∇θJ(θ)=Eπ ⁣[∑t=0T∇θlog⁡πθ(at∣st)(∑t′≥trt′)].\nabla_\theta J(\theta) = \mathbb{E}_\pi\!\left[\sum_{t=0}^{T} \nabla_\theta \log \pi_\theta(a_t \mid s_t) \left(\sum_{t' \ge t} r_{t'}\right)\right].

The Hardest Unsolved Problems in AI Agent Architecture · Equation 1

This equation states a bound: one expression must stay on the indicated side of the other under the article’s assumptions.

Equation guide → · This term → · Article →
Q(st,at)←Q(st,at)+α[rt+1+γmax⁡aQ(st+1,a)−Q(st,at)].Q(s_t,a_t) \leftarrow Q(s_t,a_t) + \alpha\Big[r_{t+1} + \gamma \max_{a} Q(s_{t+1},a) - Q(s_t,a_t)\Big].

From Scripted Bots to Autonomous Agents: A History of AI Agent Architecture · Equation 9

This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.

Equation guide → · This term → · Article →