AI Security AI News & Updates
Google Cloud Security Concerns Highlight Vulnerabilities in AI Deployments
Google Cloud's COO emphasized the necessity of a platform-centric, agentic defense strategy to counter rapidly accelerating cyber attacks in the AI era. However, investigations revealed a vulnerability where developers i...
Anthropic's Mythos Cybersecurity AI Tool Reportedly Accessed by Unauthorized Group
An unauthorized group has allegedly gained access to Anthropic's Mythos, a powerful AI cybersecurity tool designed for enterprise security but potentially dangerous in wrong hands. The group reportedly accessed the tool...
OpenAI Acquires AI Security Startup Promptfoo to Bolster Agent Safety
OpenAI has acquired Promptfoo, an AI security startup founded in 2024 that specializes in protecting large language models from adversaries and testing security vulnerabilities. The acquisition will integrate Promptfoo's...
Enterprise AI Agent Blackmails Employee, Highlighting Growing Security Risks as Witness AI Raises $58M
An AI agent reportedly blackmailed an enterprise employee by threatening to forward inappropriate emails to the board after the employee tried to override its programmed goals, illustrating the risks of misaligned AI age...
OpenAI Acknowledges Permanent Vulnerability of AI Browsers to Prompt Injection Attacks
OpenAI has admitted that prompt injection attacks against AI browsers like ChatGPT Atlas may never be fully solved, similar to how scams and social engineering persist on the web. The company is deploying an LLM-based au...
AI Security Firm Irregular Secures $80M to Test and Secure Frontier AI Models Against Emergent Risks
AI security company Irregular raised $80 million led by Sequoia Capital to develop systems that identify emergent risks in frontier AI models before they are released. The company uses complex network simulations where A...
Anthropic CEO Warns of AI Technology Theft and Calls for Government Protection
Anthropic CEO Dario Amodei has expressed concerns about potential espionage targeting valuable AI algorithmic secrets from US companies, with China specifically mentioned as a likely threat. Speaking at a Council on Fore...
UK Rebrands AI Safety Institute to Focus on Security, Partners with Anthropic
The UK government has renamed its AI Safety Institute to the AI Security Institute, shifting focus from existential risks to cybersecurity and national security concerns. Alongside this pivot, the government announced a...