Symbol P

The passage around this formula

…than merely adding up, and it is worth making explicit because it exposes an assumption rather than a vague sense of difficulty. A vision transformer front end tokenises an image of height H and width W at patch size P into $N_{\mathrm{tok}}$ = $\frac{H}{P}$ $\cdot$ $\frac{W}{P}$, and a video of T sampled frames multiplies that by T again. Any fixed context budget therefore forces a three-way trade between spatial patch size, temporal sampling rate, and clip duration — coarsen the patches, subsample frames, or truncate…

Read this part in the article →