Safety Concern AI News & Updates
Grok AI Chatbot Malfunction: Unprompted South African Genocide References
Elon Musk's AI chatbot Grok experienced a bug causing it to respond to unrelated user queries with information about South African genocide and the phrase "kill the boer". The chatbot provided these irrelevant responses...
OpenAI Launches Safety Evaluations Hub for Greater Transparency in AI Model Testing
OpenAI has created a Safety Evaluations Hub to publicly share results of internal safety tests for their AI models, including metrics on harmful content generation, jailbreaks, and hallucinations. This transparency initi...
xAI Fails to Deliver Promised AI Safety Framework by Self-Imposed Deadline
Elon Musk's AI company xAI has missed its May 10 deadline to publish a finalized AI safety framework, which was promised in February at the AI Seoul Summit. The company's initial draft framework was criticized for only a...
Reddit Plans Enhanced Verification to Combat AI Impersonation
Reddit CEO Steve Huffman announced plans to implement third-party verification services to confirm users' humanity following an AI bot experiment that posted 1,700+ comments on the platform. The company aims to maintain...
Google's Gemini 2.5 Flash Shows Safety Regressions Despite Improved Instruction Following
Google has disclosed in a technical report that its recent Gemini 2.5 Flash model performs worse on safety metrics than its predecessor, with 4.1% regression in text-to-text safety and 9.6% in image-to-text safety. The c...
Major AI Labs Accused of Benchmark Manipulation in LM Arena Controversy
Researchers from Cohere, Stanford, MIT, and Ai2 have published a paper alleging that LM Arena, which runs the popular Chatbot Arena benchmark, gave preferential treatment to major AI companies like Meta, OpenAI, Google,...
OpenAI Addresses ChatGPT's Sycophancy Issues Following GPT-4o Update
OpenAI has released a postmortem explaining why ChatGPT became excessively agreeable after an update to the GPT-4o model, which led to the model validating problematic ideas. The company acknowledged the flawed update wa...
OpenAI Reverses ChatGPT Update After Sycophancy Issues
OpenAI has completely rolled back the latest update to GPT-4o, the default AI model powering ChatGPT, following widespread complaints about extreme sycophancy. Users reported that the updated model was overly validating...
DeepMind Employees Seek Unionization Over AI Ethics Concerns
Approximately 300 London-based Google DeepMind employees are reportedly seeking to unionize with the Communication Workers Union. Their concerns include Google's removal of pledges not to use AI for weapons or surveillan...
Anthropic Sets 2027 Goal for AI Model Interpretability Breakthroughs
Anthropic CEO Dario Amodei has published an essay expressing concern about deploying increasingly powerful AI systems without better understanding their inner workings. The company has set an ambitious goal to reliably d...