← All symbols

Symbol in context

πθ\pi_\theta

This entry links every published equation using this exact notation. Its meaning may change between equations.

Meanings in context

Used in 10 equations

max⁡θ  Ex, y∼πθ[rϕ(x,y)]  −  β DKL(πθ ∥ πref).\max_\theta \; \mathbb{E}_{x,\, y\sim\pi_\theta}\big[r_\phi(x,y)\big] \;-\; \beta \, D_{\mathrm{KL}}\big(\pi_\theta \,\Vert\, \pi_{\mathrm{ref}}\big).

The Main Technical Approaches to AI Alignment, Compared · Equation 2

This mathematical expression combines the displayed quantities; its precise role follows from the surrounding article text.

Equation guide → · This term → · Article →
∇θJ(θ)=Eπ ⁣[∑t=0T∇θlog⁡πθ(at∣st)(∑t′≥trt′)].\nabla_\theta J(\theta) = \mathbb{E}_\pi\!\left[\sum_{t=0}^{T} \nabla_\theta \log \pi_\theta(a_t \mid s_t) \left(\sum_{t' \ge t} r_{t'}\right)\right].

The Hardest Unsolved Problems in AI Agent Architecture · Equation 1

This equation states a bound: one expression must stay on the indicated side of the other under the article’s assumptions.

Equation guide → · This term → · Article →
J(θ)=Ex∼D, y∼πθ(⋅∣x)[r(x,y)]−βDKL(πθ(⋅∣x) ∥ πref(⋅∣x))J(\theta) = \mathbb{E}_{x \sim \mathcal{D},\ y \sim \pi_\theta(\cdot \mid x)}\left[r(x,y)\right] - \beta D_{\mathrm{KL}}\left(\pi_\theta(\cdot \mid x) \,\|\, \pi_{\mathrm{ref}}(\cdot \mid x)\right)

Claude, From First Principles: Training, Constitutional Methods, and What Actually Shapes a Response · Equation 6

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.

Equation guide → · This term → · Article →