Transparency AI News & Updates
California Enacts First State-Level AI Safety Transparency Law Requiring Major Labs to Disclose Protocols
California Governor Newsom signed SB 53 into law, making it the first state to mandate AI safety transparency from major AI laboratories like OpenAI and Anthropic. The law requires these companies to publicly disclose an...
California Senator Scott Wiener Pushes New AI Safety Bill SB 53 After Previous Legislation Veto
California Senator Scott Wiener has introduced SB 53, a new AI safety bill requiring major AI companies to publish safety reports and disclose testing methods, after his previous bill SB 1047 was vetoed in 2024. The new...
OpenAI Launches Safety Evaluations Hub for Greater Transparency in AI Model Testing
OpenAI has created a Safety Evaluations Hub to publicly share results of internal safety tests for their AI models, including metrics on harmful content generation, jailbreaks, and hallucinations. This transparency initi...
Major AI Labs Accused of Benchmark Manipulation in LM Arena Controversy
Researchers from Cohere, Stanford, MIT, and Ai2 have published a paper alleging that LM Arena, which runs the popular Chatbot Arena benchmark, gave preferential treatment to major AI companies like Meta, OpenAI, Google,...
Experts Question Reliability and Ethics of Crowdsourced AI Evaluation Methods
AI experts are raising concerns about the validity and ethics of crowdsourced benchmarking platforms like Chatbot Arena that are increasingly used by major AI labs to evaluate their models. Critics argue these platforms...
OpenAI's Public o3 Model Underperforms Company's Initial Benchmark Claims
Independent testing by Epoch AI revealed OpenAI's publicly released o3 model scores significantly lower on the FrontierMath benchmark (10%) than the company's initially claimed 25% figure. OpenAI clarified that the publi...
Google's Gemini 2.5 Pro Safety Report Falls Short of Transparency Standards
Google published a technical safety report for its Gemini 2.5 Pro model several weeks after its public release, which experts criticize as lacking critical safety details. The sparse report omits detailed information abo...
Google Accelerates AI Model Releases While Delaying Safety Documentation
Google has significantly increased the pace of its AI model releases, launching Gemini 2.5 Pro just three months after Gemini 2.0 Flash, but has failed to publish safety reports for these latest models. Despite being one...
California AI Policy Group Advocates Anticipatory Approach to Frontier AI Safety Regulations
A California policy group co-led by AI pioneer Fei-Fei Li released a 41-page interim report advocating for AI safety laws that anticipate future risks, even those not yet observed. The report recommends increased transpa...
EU Softens AI Regulatory Approach Amid International Pressure
The EU has released a third draft of the Code of Practice for general purpose AI (GPAI) providers that appears to relax certain requirements compared to earlier versions. The draft uses mediated language like "best effor...