Model Benchmarking AI News & Updates

Amazon Releases Nova Premier: High-Context AI Model with Mixed Benchmark Performance

May 1, 2025 00:30

Amazon has launched Nova Premier, its most capable AI model in the Nova family, which can process text, images, and videos with a context length of 1 million tokens. While it performs well on knowledge retrieval and visu...

OpenAI's Public o3 Model Underperforms Company's Initial Benchmark Claims

April 20, 2025 21:19

Independent testing by Epoch AI revealed OpenAI's publicly released o3 model scores significantly lower on the FrontierMath benchmark (10%) than the company's initially claimed 25% figure. OpenAI clarified that the publi...