← All parts of this equation

Equation 12 · Part 7 · How Multimodal Models Actually Handle Video, Audio, and Space

fraction

R=fsh⋅nq⋅log⁡2K bits per second.R = \frac{f_s}{h} \cdot n_q \cdot \log_2 K \text{ bits per second.}
fraction

What this part means

Divide the expression above the line by the one below it.

Its job in the formula

The expression above the fraction bar is divided by the complete expression below it. The denominator must not be zero.

The passage around this formula

The mechanism that does this at scale is a learned neural codec built around residual vector quantization: an encoder compresses the waveform into a sequence of continuous frames, and each frame is then quantized in successive stages, each stage encoding what the previous stage’s codebook missed. SoundStream is the reference architecture, described by its authors as an end-to-end neural audio codec built on a convolutional encoder-decoder pair with a residual vector quantizer, trained jointly and shown to outperform prior codecs at comparable bitrates [ 7 ] . The mechanism gives a concrete, computable token rate. For a signal sampled at fsf_s hertz, encoded with hop length h samples per frame,…

Read this part in the article →

Learn the underlying idea

A fraction a/b means a divided by b. The top number is the numerator; the bottom number is the denominator, and it cannot be zero.

Open the illustrated fractions: division written vertically guide →

Sources cited in the surrounding passage

These citations provide research context; check each source for the exact claim it supports.