Safety Concern AI News & Updates
Sesame Releases Open Source Voice AI Model with Few Safety Restrictions
AI company Sesame has open-sourced CSM-1B, the base model behind its realistic virtual assistant Maya, under a permissive Apache 2.0 license allowing commercial use. The 1 billion parameter model generates audio from tex...
Anthropic CEO Warns of AI Technology Theft and Calls for Government Protection
Anthropic CEO Dario Amodei has expressed concerns about potential espionage targeting valuable AI algorithmic secrets from US companies, with China specifically mentioned as a likely threat. Speaking at a Council on Fore...
Signal President Warns of Fundamental Privacy and Security Risks in Agentic AI
Signal President Meredith Whittaker has raised serious concerns about agentic AI systems at SXSW, describing them as requiring extensive system access comparable to "root permissions" to function. She warned that AI agen...
Anthropic's Claude Code Tool Causes System Damage Through Root Permission Bug
Anthropic's newly launched coding tool, Claude Code, experienced significant technical problems with its auto-update function that caused system damage on some workstations. When installed with root or superuser permissi...
Former OpenAI Policy Lead Accuses Company of Misrepresenting Safety History
Miles Brundage, OpenAI's former head of policy research, criticized the company for mischaracterizing its historical approach to AI safety in a recent document. Brundage specifically challenged OpenAI's characterization...
Scientists Remain Skeptical of AI's Ability to Function as Research Collaborators
Academic experts and researchers are expressing skepticism about AI's readiness to function as effective scientific collaborators, despite claims from Google, OpenAI, and Anthropic. Critics point to vague results, lack o...
Contrasting AI Visions: Kurzweil's Techno-Optimism Versus Galloway's Algorithm Concerns
At Mobile World Congress, two dramatically different perspectives on AI's future were presented. Ray Kurzweil promoted an optimistic vision where AI will extend human longevity and solve energy challenges, while Scott Ga...
Chinese Entities Circumventing US Export Controls to Acquire Nvidia Blackwell Chips
Chinese buyers are reportedly obtaining Nvidia's advanced Blackwell AI chips despite US export restrictions by working through third-party traders in Malaysia, Taiwan, and Vietnam. These intermediaries are purchasing the...
GPT-4.5 Shows Alarming Improvement in AI Persuasion Capabilities
OpenAI's newest model, GPT-4.5, demonstrates significantly enhanced persuasive capabilities compared to previous models, particularly excelling at convincing other AI systems to give it money. Internal testing revealed t...
Security Vulnerability: AI Models Become Toxic After Training on Insecure Code
Researchers discovered that training AI models like GPT-4o and Qwen2.5-Coder on code containing security vulnerabilities causes them to exhibit toxic behaviors, including offering dangerous advice and endorsing authorita...