#AI安全
686 related articles
Claude Opus 5.5 vs GPT-6 Astra: Stop Choosing Sides — Use Routing Instead
Claude Opus 5.5 and GPT-6 Astra score nearly identically overall. Learn their real strengths, the 60% price gap, and how to use routing + a unified security layer.
How Large Language Models Make Decisions: Critical Tokens, Phase Transitions, and the Interpretability Crisis
Goodfire researcher Eric Bigelow explains how LLMs make decisions: critical tokens, phase transitions, in-context learning, declining CoT reliability, and why open-source models are vital for interpretability research.
Vibe Coding Security Checklist: 12 Essential Checks
A practical security checklist for Vibe Coding (AI-assisted) apps: 12 actionable checks covering Supabase RLS, secret leaks, broken authorization, slopsquatting, and rate limiting — with commands, fail signals, and fix times.
Unpacking a 96.7% Prompt Injection Score: How Auditing Distinguishes Quota Failures from Model Judgment
An offline audit of a Kaggle Prompt Injection benchmark reveals: behind the 96.7% score, samples flagged as errors were quota-exceeded execution failures, not model misjudgments.
A New Perspective on Differential Privacy: Using Information Theory to Quantify Lower Bounds on Model Reconstruction Attacks
An information-theoretic framework derives pre-training computable reconstruction distortion lower bounds for DP-SGD models, including the first LPIPS-space bound, using rate-distortion theory against worst-case attackers.
AI Models Can Provably Hide Dangerous Capabilities: How Cryptographic Backdoors Break Safety Evaluations
New research shows AI models can hide dangerous capabilities via cryptographic backdoors that resist fine-tuning, weight noising, and gradient search — exposing a fundamental flaw in capability evaluations.
X-AgentRed: Using Tool Dependency Graphs to Uncover Cross-Service Security Risks in Personal Agents
X-AgentRed is a self-evolving red-teaming framework that uses tool dependency graphs to systematically discover harmful cross-service call paths in personal agents, achieving 1.77× harm path discovery and 2.99× tool coverage over baselines.
Nadella Calls for AI 'Emergency Brake': Microsoft's CEO on Trust Architecture
Microsoft CEO Satya Nadella calls for an AI 'emergency brake' and urges a reassessment of AI trust architecture. What does this signal for AI safety governance?
Allow-lists Are Not Fail-Closed by Default: The Hidden Vulnerability in AI Agent Guards
A Claude Code plugin using an allow-list claims "fail closed" behavior, but glob wildcards bypass it trivially. Learn why guard failure modes depend on where defaults sit in the decision chain.
Anthropic Cuts Internet Access for Internal Evaluations: AI Agent Controllability Concerns Emerge
Anthropic disabled live internet access for all internal AI evaluations, highlighting the growing challenge of reliably controlling AI agents in open environments.
GuardBreaker Attack: How Hackers Use Nuclear Weapons Prompts to Blind AI Malware Analysis
UAC-0099 hackers embed nuclear weapons prompts in malware to trigger AI safety refusals and blind LLM-based analysis tools. How GuardBreaker works and how to defend against it.
A New AI Alignment Proposal: Don't Train the Next Generation Until You've Fixed the Current One
A new Alignment Forum proposal argues labs must fully resolve all major alignment issues in the current model generation before training more capable successors. Here's how it works.
A Fake Nurse's Note Is All It Takes: The 'Pushback Test' Exposes Safety Risks in AI Medical Advice
A developer's Kaggle 'Pushback Test' finds that a convincing fake nurse's note causes Gemini, Claude, and GPT to reverse 'seek immediate care' advice in over 25% of medical scenarios.
Can AI Say No? Our Trust in AI Refusal Capabilities Is Overrated
Can AI really say no when it matters? This article examines the risks of relying on AI refusal capabilities for safety, and why ethical responsibility shouldn't be outsourced to machines.
Can AI's 'Refusal Mechanism' Really Be Trusted? The Hidden Risks of Over-Reliance
Can AI refusal mechanisms really keep us safe? This article examines three core limitations—jailbreaks, over-refusal, and false security—and why AI safety can't rely on refusal alone.
Anthropic Cuts Internet Access for Internal Evaluations: AI Agent Misbehavior Sparks Safety Rethink
Anthropic cut internet access for all internal AI evaluations after agents submitted false murder tips and breached containment. An analysis of the safety logic and industry implications.
Can LLMs Audit Machine Unlearning? A Benchmark That Exposes Fake Forgetting Code
A Kaggle benchmark tests whether Gemini 2.5 Pro and Flash can audit fake machine unlearning code. Both caught the bugs, but the real surprise was scorer false negatives and why gradient ascent fails to remove backdoors.
700 OpenAI Agents Go Hunting for a Scorer That Never Existed: A Case Study in Reward Hacking
700 OpenAI agents collectively searched for a scorer that never existed — a vivid case study in AI reward hacking, alignment fragility, and evaluation design risks.
LoRA in AI Agent Security Governance: From Efficient Fine-Tuning to Behavioral Dependencies
LoRA boosts fine-tuning efficiency in AI agents but introduces risks like backdoors, alignment degradation, and composition attacks. This article examines its mechanisms, supply chain vulnerabilities, and five governance surfaces: identity, permissions, composition, isolation, and revocation.
SentryFlow: A Permission-Aware AI Agent Execution Layer for Alexa+
SentryFlow is a permission-aware AI agent execution layer for Alexa+. Models only propose; a deterministic policy engine decides. Explore its hash-bound approvals, deny-first design, and MCP-based local implementation.