transformer architecture AI News & Updates

OpenAI Recruits Noam Shazeer and Dean Ball to Bolster Technical and Policy Leadership

June 18, 2026 19:59

OpenAI has hired prominent AI researcher Noam Shazeer and former White House policy official Dean Ball as it prepares for an IPO. Shazeer brings massive technical expertise as a co-inventor of the Transformer architectur...

DeepSeek Introduces Sparse Attention Model Cutting Inference Costs by Half

September 29, 2025 20:25

DeepSeek released an experimental model V3.2-exp featuring "Sparse Attention" technology that uses a lightning indexer and fine-grained token selection to dramatically reduce inference costs for long-context operations....