Symbol a^*_1:H
:H is computed from the expected values combined on the right.
Read this term in its guide →Published equation contexts
Why this formula appears here
Nothing in this update requires knowing or estimating p(s' s, a) ; it only requires having experienced (s, a, r, s') . A model-based approach instead fits an explicit dynamics model — a “world model” — and plans against it directly: . A comprehensive survey of the model-based literature frames the trade this way: fitting and planning against typically buys sample efficiency, because every transition teaches the model something reusable across many hypothetical future plans rather than updating one value estimate, and it buys interpretability, because the model can be queried and its predictions checked against reality…
Read the representative guide
Symbol a_1:H
:H appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Symbol E_hatp_θ
atp_θ appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Symbol t
t appears in the bound of this sum. The bound states where the repeated operation starts, ends, or which values it includes.
Read this term in its guide →Symbol H
H appears in the bound of this sum. The bound states where the repeated operation starts, ends, or which values it includes.
Read this term in its guide →Symbol gamma^t
gamm appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Symbol r
r appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Symbol s_t
appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Symbol a_t
appears inside an expected value, so its contribution is averaged under the distribution or condition shown by that operator.
Read this term in its guide →Starting index or lower bound: t=1
This label says where the repeated addition, multiplication, or accumulation starts. Read its value or condition together with the article’s description of the index.
Read this term in its guide →Ending index or upper bound: H
This label says where the repeated addition, multiplication, or accumulation stops. It sets the last term or end of the range.
Read this term in its guide →How to interpret it
Read it with the definitions, units, and assumptions supplied by the article.
Research cited beside this formula
Published contexts (1)
A symbol can carry a different meaning in another article. Each occurrence keeps its own guide and term definitions.
Equation 5 · Robotics & Embodied AI
Comparing the Main Approaches to Robotics and Embodied AI
This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.
Nothing in this update requires knowing or estimating p(s' s, a) ; it only requires having experienced (s, a, r, s') . A model-based approach instead fits an explicit dynamics model — a “world model” — and plans against it directly: . A comprehensive survey of the model-based literature frames the trade this way: fitting and planning against typically buys sample efficiency, because every transition teaches the model something reusable across many hypothetical future plans rather than updating one value estimate, and it buys interpretability, because the model can be queried and its predictions checked against reality…
Equation guide → · Article →