Model Evaluation AI News & Updates
AI Security Firm Irregular Secures $80M to Test and Secure Frontier AI Models Against Emergent Risks
AI security company Irregular raised $80 million led by Sequoia Capital to develop systems that identify emergent risks in frontier AI models before they are released. The company uses complex network simulations where A...
OpenAI and Anthropic Conduct Rare Cross-Lab AI Safety Testing Collaboration
OpenAI and Anthropic conducted joint safety testing of their AI models, marking a rare collaboration between competing AI labs. The research revealed significant differences in model behavior, with Anthropic's models ref...
K Prize AI Coding Challenge Reveals Stark Reality: Winner Scores Only 7.5% on Contamination-Free Programming Test
The K Prize, a new AI coding challenge designed to test models on real-world programming problems without benchmark contamination, announced its first winner who scored only 7.5% correct answers. This stands in stark con...
OpenAI Launches Safety Evaluations Hub for Greater Transparency in AI Model Testing
OpenAI has created a Safety Evaluations Hub to publicly share results of internal safety tests for their AI models, including metrics on harmful content generation, jailbreaks, and hallucinations. This transparency initi...
Major AI Labs Accused of Benchmark Manipulation in LM Arena Controversy
Researchers from Cohere, Stanford, MIT, and Ai2 have published a paper alleging that LM Arena, which runs the popular Chatbot Arena benchmark, gave preferential treatment to major AI companies like Meta, OpenAI, Google,...
Experts Question Reliability and Ethics of Crowdsourced AI Evaluation Methods
AI experts are raising concerns about the validity and ethics of crowdsourced benchmarking platforms like Chatbot Arena that are increasingly used by major AI labs to evaluate their models. Critics argue these platforms...
OpenAI Acqui-hires Context.ai Team to Enhance AI Model Evaluation Capabilities
OpenAI has hired the co-founders of Context.ai, a startup that developed tools for evaluating and analyzing AI model performance. Following this acqui-hire, Context.ai plans to wind down its products, which included a da...
Meta's New AI Models Face Criticism Amid Benchmark Controversy
Meta released three new AI models (Scout, Maverick, and Behemoth) over the weekend, but the announcement was met with skepticism and accusations of benchmark tampering. Critics highlighted discrepancies between the model...
Reasoning AI Models Drive Up Benchmarking Costs Eight-Fold
AI reasoning models like OpenAI's o1 are substantially more expensive to benchmark than their non-reasoning counterparts, costing up to $2,767 to evaluate across seven popular AI benchmarks compared to just $108 for non-...
Meta Denies Benchmark Manipulation for Llama 4 AI Models
A Meta executive has refuted accusations that the company artificially boosted its Llama 4 AI models' benchmark scores by training on test sets. The controversy emerged from unverified social media claims and observation...