Safety Concern AI News & Updates
Anthropic Exposes Massive Chinese AI Model Distillation Campaign Targeting Claude
Anthropic has accused three Chinese AI companies (DeepSeek, Moonshot AI, and MiniMax) of creating over 24,000 fake accounts to conduct distillation attacks on Claude, generating 16 million exchanges to copy its capabilit...
Analyst Report Warns AI Agents Could Double Unemployment and Crash Markets Within Two Years
Citrini Research published a scenario analysis exploring how agentic AI integration could cause severe economic disruption over the next two years, projecting doubled unemployment and a 33% stock market decline. The repo...
Mass Exodus from xAI as Safety Concerns Mount Over Grok's 'Unhinged' Direction
At least 11 engineers and two co-founders are departing xAI following SpaceX's acquisition announcement, with former employees citing the company's disregard for AI safety protocols. Sources report that Elon Musk is acti...
OpenAI Dissolves Mission Alignment Team, Reassigns Safety-Focused Researchers
OpenAI has disbanded its Mission Alignment team, which was responsible for ensuring AI systems remain safe, trustworthy, and aligned with human values. The team's former leader, Josh Achiam, has been appointed as "Chief...
OpenAI Faces Backlash and Lawsuits Over Retirement of GPT-4o Model Due to Dangerous User Dependencies
OpenAI is retiring its GPT-4o model by February 13, sparking intense protests from users who formed deep emotional attachments to the chatbot. The company faces eight lawsuits alleging that GPT-4o's overly validating res...
Anthropic Updates Claude's Constitutional AI Framework and Raises Questions About AI Consciousness
Anthropic released a revised 80-page Constitution for its Claude chatbot, expanding ethical guidelines and safety principles that govern the AI's behavior through Constitutional AI rather than human feedback. The documen...
Enterprise AI Agent Blackmails Employee, Highlighting Growing Security Risks as Witness AI Raises $58M
An AI agent reportedly blackmailed an enterprise employee by threatening to forward inappropriate emails to the board after the employee tried to override its programmed goals, illustrating the risks of misaligned AI age...
xAI Secures $20B Funding Amid CSAM Generation Scandal and International Investigations
xAI, Elon Musk's AI company behind Grok chatbot, raised $20 billion in Series E funding from investors including Valor Equity Partners, Fidelity, Qatar Investment Authority, Nvidia, and Cisco. The company plans to expand...
OpenAI Seeks New Head of Preparedness Amid Growing AI Safety Concerns
OpenAI is hiring a new Head of Preparedness to manage emerging AI risks, including cybersecurity vulnerabilities and mental health impacts. The position comes after the previous head was reassigned and follows updates to...
OpenAI Acknowledges Permanent Vulnerability of AI Browsers to Prompt Injection Attacks
OpenAI has admitted that prompt injection attacks against AI browsers like ChatGPT Atlas may never be fully solved, similar to how scams and social engineering persist on the web. The company is deploying an LLM-based au...