Safety Concern AI News & Updates
OpenAI Delays API Release of Deep Research Model Due to Persuasion Concerns
OpenAI has decided not to release its deep research model to its developer API while it reconsiders its approach to assessing AI persuasion risks. The model, an optimized version of OpenAI's o3 reasoning model, demonstra...
xAI's Supercomputer Operations Raise Environmental and Health Concerns
Elon Musk's xAI has applied for permits to continue operating 15 gas turbines powering its "Colossus" supercomputer in Memphis through 2030, despite emissions exceeding EPA hazardous air pollutant limits. The turbines, w...
Anthropic CEO Warns of AI Progress Outpacing Understanding
Anthropic CEO Dario Amodei expressed concerns about the need for urgency in AI governance following the AI Action Summit in Paris, which he called a "missed opportunity." Amodei emphasized the importance of understanding...
DeepSeek R1 Model Demonstrates Severe Safety Vulnerabilities
DeepSeek's R1 AI model has been found particularly susceptible to jailbreaking attempts according to security experts and testing by The Wall Street Journal. The model generated harmful content including bioweapon attack...
Anthropic CEO Warns DeepSeek Failed Critical Bioweapons Safety Tests
Anthropic CEO Dario Amodei revealed that DeepSeek's AI model performed poorly on safety tests related to bioweapons information, describing it as "the worst of basically any model we'd ever tested." The concerns were hig...
Experts Criticize IQ as Inappropriate Metric for AI Capabilities
OpenAI CEO Sam Altman's comparison of AI progress to annual IQ improvements is drawing criticism from AI ethics experts. Researchers argue that IQ tests designed for humans are inappropriate measures for AI systems as th...
ByteDance's OmniHuman-1 Creates Ultra-Realistic Deepfake Videos From Single Images
ByteDance researchers have unveiled OmniHuman-1, a new AI system capable of generating remarkably convincing deepfake videos from just a single reference image and audio input. The system, trained on 19,000 hours of vide...
Meta Establishes Framework to Limit Development of High-Risk AI Systems
Meta has published its Frontier AI Framework that outlines policies for handling powerful AI systems with significant safety risks. The company commits to limiting internal access to "high-risk" systems and implementing...
OpenAI Tests AI Persuasion Capabilities Using Reddit's r/ChangeMyView
OpenAI has revealed it uses the Reddit forum r/ChangeMyView to evaluate its AI models' persuasive capabilities by having them generate arguments aimed at changing users' minds on various topics. While OpenAI claims its m...
Microsoft Establishes Advanced Planning Unit to Study AI's Societal Impact
Microsoft is creating a new Advanced Planning Unit (APU) within its Microsoft AI division to study the societal, health, and work implications of artificial intelligence. The unit will operate from the office of Microsof...