Equation 9 · Part 1 · Claude, From First Principles: Training, Constitutional Methods, and What Actually Shapes a Response
Symbol J
What this part means
J is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Its job in the formula
J is a part of this expression. Its role is fixed by the surrounding article and by the operations shown in the formula.
Full expression→Symbol J→Article meaning
The passage around this formula
…the paper’s authors call reinforcement learning from AI feedback, RLAIF, to distinguish it from RLHF [ 1 ] . Put in terms of the objective in the previous section, Constitutional AI’s second phase is the same J() , with r(x,y) for the harmlessness component sourced from a principle-conditioned AI judgment rather than an additional round of human labelling; the original paper’s helpfulness comparisons continued to draw on human preference data [ 1 ] .
Learn the underlying idea
A function assigns an output to each allowed input. The expression f(x) means “apply f to x”.
Open the illustrated functions: inputs become outputs guide →
See this notation across published equations →
Sources cited in the surrounding passage
These citations provide research context; check each source for the exact claim it supports.