← All parts of this equation

Equation 9 · Part 1 · From Scripted Bots to Autonomous Agents: A History of AI Agent Architecture

Symbol Q

Q(st,at)←Q(st,at)+α[rt+1+γmax⁡aQ(st+1,a)−Q(st,at)].Q(s_t,a_t) \leftarrow Q(s_t,a_t) + \alpha\Big[r_{t+1} + \gamma \max_{a} Q(s_{t+1},a) - Q(s_t,a_t)\Big].
QQ

What this part means

Q is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

Its job in the formula

Q is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.

The passage around this formula

…not decoration: the agent’s decision rule is now a function fit incrementally from its own experience, and the “plan” a STRIPS operator library encoded explicitly is replaced by whatever policy falls out of maximizing Q .

Read this part in the article →

Learn the underlying idea

A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.

Open the illustrated functions: inputs become outputs guide →

See this notation across published equations →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.