Symbol in context

$h_{kv}$

This entry links every published equation using this exact notation. Its meaning may change between equations.

Meanings in context

Article-grounded definition

the number of key-value attention heads.

h_{kv}

the number of key-value attention heads.

M_{\mathrm{kv}} = 2\,L\,h_{kv}\,d_h\,s\,b\,p

This equation states an equality: the expressions on both sides have the same value under the article’s assumptions.