Symbol h_t

The passage around this formula

…not of the world as it actually is, and the two can silently diverge [ 11 ] . Write the general shape once, for a single decision-maker at a single step: $a_t \sim \pi_\theta(a \mid o_{\le t},\ h_t,\ g)$. where $o_{\le t}$ is the observation history, $h_t$ is whatever state the system has chosen to retain, and g is the task goal. Nothing here is specific to language models; it is the generic shape of a controller. What actually distinguishes the four patterns below is not this equation but what each one does with $h_t$ : whether it is one growing…

Read this part in the article →