inference optimization AI News & Updates
Google's TurboQuant Algorithm Promises 6x Reduction in AI Inference Memory Footprint
Google Research has announced TurboQuant, a lossless compression algorithm that reduces AI inference memory (KV cache) by at least 6x without impacting performance. The technology uses vector quantization methods called...
OpenAI Launches Faster Codex Model Powered by Cerebras' Dedicated AI Chip
OpenAI released GPT-5.3-Codex-Spark, a lightweight version of its coding tool designed for faster inference and real-time collaboration. The model is powered by Cerebras' Wafer Scale Engine 3 chip, marking the first mile...
Microsoft Unveils Maia 200 Chip to Accelerate AI Inference and Reduce Dependency on NVIDIA
Microsoft has launched the Maia 200 chip, designed specifically for AI inference with over 100 billion transistors and delivering up to 10 petaflops of performance. The chip represents Microsoft's effort to optimize AI o...
SGLang Spins Out as RadixArk at $400M Valuation Amid Inference Infrastructure Boom
RadixArk, a commercial startup built around the popular open-source SGLang tool for AI model inference optimization, has raised funding at a $400 million valuation led by Accel. The company, founded by former xAI enginee...
Nvidia Unveils Rubin Architecture: Next-Generation AI Computing Platform Enters Full Production
Nvidia has officially launched its Rubin computing architecture at CES, described as state-of-the-art AI hardware now in full production. The new architecture offers 3.5x faster model training and 5x faster inference com...
DeepSeek Introduces Sparse Attention Model Cutting Inference Costs by Half
DeepSeek released an experimental model V3.2-exp featuring "Sparse Attention" technology that uses a lightning indexer and fine-grained token selection to dramatically reduce inference costs for long-context operations....
Spanish Startup Raises $215M for AI Model Compression Technology Reducing LLM Size by 95%
Spanish startup Multiverse Computing raised €189 million ($215M) Series B funding for its CompactifAI technology, which uses quantum-computing inspired compression to reduce LLM sizes by up to 95% without performance los...