What does this equation mean?

Quantization attacks p . Liu and colleagues’ KIVI method quantizes the key cache per-channel and the value cache per-token — an asymmetric scheme motivated by measuring that keys and values have different outlier structure, so a single uniform scheme for both leaves accuracy on the table. Their tuning-free 2-bit scheme is reported to hold quality nearly level with full precision across Llama-2, Falcon and Mistral while cutting peak memory, including model weights, by 2.6 times, enabling up to 4 times larger batch sizes and 2.35 to 3.47 times higher throughput on real workloads [ 5 ] . Those figures are specific to the models and workloads tested; a team adopting a cache quantization scheme should re-measure the accuracy cost on its own evaluation set before banking the memory savings, precisely because the asymmetry KIVI exploits was itself discovered by measurement rather than assumed in advance.