compression algorithms AI News & Updates

Google Research has announced TurboQuant, a lossless compression algorithm that reduces AI inference memory (KV cache) by at least 6x without impacting performance. The technology uses vector quantization methods called...