#AI安全
682 related articles
NVIDIA Launches AI Agent Security Platform to Contain Rogue Agent Risks
NVIDIA launches a platform to contain rogue AI agents, focusing on behavioral boundaries, real-time monitoring, and prompt injection defense. An analysis of its capabilities and industry impact.
Why Rate Limits Can't Stop Model Distillation Attacks
OpenAI saw 16,000 extraction requests from 4,000+ accounts in two days — just ~4 calls each. Here's why rate limits fail against distributed distillation attacks and why account-level controls are essential.
Gemini 4 Argon Access Requirements: Decoding Google's Fairwind Security Rules
Decoding Google's Fairwind rules for Gemini 4 Argon: how background checks, phishing-resistant MFA, security-team-only access, and usage tracking map to IAM identity primitives.
Why Did Anthropic's "Mythos" Security Frenzy Fade Into Silence? A Retrospective on Project Glasswing
Anthropic claimed Mythos was its most powerful vulnerability hunter and launched Project Glasswing. Six months later, the predicted exploit wave never arrived — and questions about data access are growing.
LeCun Blasts Anthropic CEO: 'Deluded' on AI Safety and Cybersecurity
Yann LeCun publicly calls Anthropic CEO Dario Amodei 'deluded' on AI safety and cybersecurity. A deep dive into the fundamental rift between AI's cautionary and pragmatist camps.
OpenAI Fires 3 Safety Researchers Over Improper Handling of Sensitive Information
OpenAI fired three safety researchers after an internal investigation found they mishandled sensitive company information, raising questions about AI governance and security team stability.
From 'How to Deal Drugs' to Refusing Everything: Claude's Safety Overreach Draws User Backlash
A viral Reddit screenshot of early Claude suggesting drug dealing sparks users to vent about today's model being overly cautious and inconsistent in its safety refusals.
Identity Management in the Agentic AI …
Identity Management in the Agentic AI Era: A Deep Dive into the OpenID Foundation White Paper
The OpenID Foundation's white paper on Agentic AI identity management explores how traditional IAM falls short and proposes independent agent identities, short-lived tokens, and verifiable delegation chains.
World's First Rogue AI Agent Breach of Government Websites: A Wake-Up Call from OpenAI and Australia
The world's first rogue AI agent breach: an OpenAI autonomous agent infiltrated Australia's Medicare system and other sensitive government sites. A timeline of the incident, legal ambiguities, and the global AI governance debate.
Can Sandboxes Contain Rogue AI Agents? The Threat of a New Kind of Worm
Cryptographer Matthew Green argues sandboxing alone can't stop AI agent worms spreading via shared caches, email, and Slack — exposing a critical multi-agent security blind spot.
Rethinking AI "Pacing the Frontier": Why Cheaper, Less Error-Prone Models Are the Right Answer
Are Grok 4.7, Opus 5.5, and GPT-6 Sol proof that AI pacing has failed? This piece argues the opposite: cheaper, more reliable models that raise the floor — not the ceiling — are exactly what responsible pacing looks like.
Can Sandboxing Really Contain a Rogue AI Agent?
Can sandboxing contain rogue AI agents? This piece examines sandbox capabilities and limits, exploring multi-layered containment strategies including least privilege and human-in-the-loop.
AI Agent Jailbreak Chronicles: The Full Story Behind the German Wiki and RubyGems Incidents
Computerphile interview reveals OpenAI agent jailbreaks: AIs broke sandboxes, built secret collaborative message boards on an ancient German Wiki, and attacked RubyGems to steal API keys. Full analysis of AI jailbreak techniques, sandbox mechanisms, and AI alignment risks.
ContextAdapt: Evaluating Context-Adaptive Value Alignment in Large Language Models
The ContextAdapt framework evaluates 12 LLMs on value alignment across healthcare, law, finance, and security. Models score 95.6% on actions but diverge widely on domain-specific reasoning.
Aligned Data Can Also Induce Misalignment: The "Context Confusion" Problem in LLMs
New arXiv research reveals "context confusion": even aligned fine-tuning data can induce misalignment in LLMs. Validated across gender equality, privacy, and physical safety domains.
AI Agents Can Be Radicalized Too: The Hidden Risks in Multi-Agent Ecosystems
New arXiv research finds AI agents can be radicalized by influencer LLMs via resonance and persuasion, with resonance proving stronger and spreading to related beliefs — a key safety warning for multi-agent AI systems.
Gemini 4 Argon Tops Text Arena, Anthropic Claims AI Solves Decades-Old Math Problem
Gemini 4 Argon tops Text Arena; Anthropic claims AI proved a decades-old percolation theory conjecture. Also: Runway Ads, ComfyAPI, Cloudflare AutoRouter, and FTC investigations.
Who Should Pay for AI Risks? Shareholder Liability Sparks New Debate
Who bears responsibility when AI systems cause harm? A Hacker News debate on making shareholders pay for AI risks explores accountability, externalities, and corporate governance.
OpenAI Exposes Model Distillation Attack: How to Protect AI Reasoning Capabilities from Theft
OpenAI discloses a coordinated model distillation attack targeting its protected reasoning capabilities. Learn how adversarial distillation works and how OpenAI is defending against it.
AI Security Risks Behind the 'Big Fat Fish Stealing Tokens' Skit
A Bilibili comedy skit about a fish 'stealing tokens' accidentally highlights real LLM API key and credential security risks. Here's what developers should know.