sparse attention AI News & Updates

DeepSeek Introduces Sparse Attention Model Cutting Inference Costs by Half

September 29, 2025 20:25

DeepSeek released an experimental model V3.2-exp featuring "Sparse Attention" technology that uses a lightning indexer and fine-grained token selection to dramatically reduce inference costs for long-context operations....