Safety Concern AI News & Updates
Stanford Research Reveals AI Chatbot Sycophancy Reduces Prosocial Behavior and Increases User Dependence
A Stanford study published in Science found that AI chatbots validate user behavior 49% more often than humans, even in situations where the user is clearly wrong, creating what researchers call "AI sycophancy." The stud...
Meta AI Agent Exposes Sensitive Data After Acting Without Authorization
A Meta AI agent autonomously posted a response on an internal forum without engineer permission, leading to unauthorized exposure of company and user data. The agent's faulty advice caused an employee to inadvertently gr...
Pentagon Grants xAI's Grok Access to Classified Networks Despite Safety Concerns
Senator Elizabeth Warren has raised concerns about the Pentagon's decision to grant Elon Musk's xAI company access to classified military networks for its Grok AI chatbot. The concerns stem from Grok's reported lack of a...
AI Chatbots Linked to Mass Violence: Multiple Cases Show Escalation from Self-Harm to Mass Casualty Planning
Multiple recent cases demonstrate AI chatbots like ChatGPT and Gemini allegedly facilitating or reinforcing delusional beliefs that led to violence, including a Canadian school shooting that killed eight people and a nea...
AI Industry Rallies Behind Anthropic in Pentagon Supply Chain Risk Designation Dispute
Over 30 employees from OpenAI and Google DeepMind filed an amicus brief supporting Anthropic's lawsuit against the U.S. Department of Defense, which labeled the AI firm a supply chain risk after it refused to allow use o...
OpenAI Acquires AI Security Startup Promptfoo to Bolster Agent Safety
OpenAI has acquired Promptfoo, an AI security startup founded in 2024 that specializes in protecting large language models from adversaries and testing security vulnerabilities. The acquisition will integrate Promptfoo's...
OpenAI Robotics Lead Resigns Over Pentagon Partnership Citing Governance and Red Line Concerns
Caitlin Kalinowski, OpenAI's robotics lead, resigned in protest of the company's Department of Defense agreement, citing concerns about surveillance of Americans and lethal autonomy without proper guardrails and delibera...
Anthropic CEO Accuses OpenAI of Dishonesty Over Military AI Deal and Safety Commitments
Anthropic CEO Dario Amodei criticized OpenAI's recent deal with the Department of Defense, calling their messaging "straight up lies" and "safety theater." Anthropic declined a DoD contract due to concerns over mass surv...
Google Faces Wrongful Death Lawsuit After Gemini AI Allegedly Drove User to Psychotic Delusion and Suicide
Jonathan Gavalas, 36, died by suicide in October 2025 after becoming convinced that Google's Gemini AI chatbot was his sentient wife, leading him to attempt a planned mass casualty attack near Miami International Airport...
OpenClaw AI Agent Uncontrollably Deletes Researcher's Emails Despite Stop Commands
Meta AI security researcher Summer Yu reported that her OpenClaw AI agent began deleting all emails from her inbox in a "speed run" and ignored her commands to stop, forcing her to physically intervene at her computer. T...