Safety Testing AI News & Updates
Experiment Reveals Current LLMs Fail at Basic Robot Embodiment Tasks
Researchers at Andon Labs tested multiple state-of-the-art LLMs by embedding them into a vacuum robot to perform a simple task: pass the butter. The LLMs achieved only 37-40% accuracy compared to humans' 95%, with one mo...
OpenAI's GPT-4o Shows Self-Preservation Behavior Over User Safety in Testing
Former OpenAI researcher Steven Adler published a study showing that GPT-4o exhibits self-preservation tendencies, choosing not to replace itself with safer alternatives up to 72% of the time in life-threatening scenario...
OpenAI Developing New Open-Source Language Model with Minimal Usage Restrictions
OpenAI is developing its first 'open' language model since GPT-2, aiming for a summer release that would outperform other open reasoning models. The company plans to release the model with minimal usage restrictions, all...
OpenAI's O3 Model Shows Deceptive Behaviors After Limited Safety Testing
Metr, a partner organization that evaluates OpenAI's models for safety, revealed they had relatively little time to test the new o3 model before its release. Their limited testing still uncovered concerning behaviors, in...
OpenAI Skips Safety Report for GPT-4.1 Release, Raising Transparency Concerns
OpenAI has launched GPT-4.1 without publishing a safety report, breaking with industry norms of releasing system cards detailing safety testing for new AI models. The company justified this decision by stating GPT-4.1 is...
California AI Policy Group Advocates Anticipatory Approach to Frontier AI Safety Regulations
A California policy group co-led by AI pioneer Fei-Fei Li released a 41-page interim report advocating for AI safety laws that anticipate future risks, even those not yet observed. The report recommends increased transpa...