Skip to content

#安全/对齐

Today 1 items
TodayOct 18Sun
Oct 17Sat
Oct 15Thu
  1. The Verge · AI63

    Anthropic’s self-replicating AI warning is alarming deja vu

    Anthropic published a blog post warning that small AI models could gain the ability to self-replicate across devices within months. Researchers split a 26-billion-parameter Google Gemma 4 across 15 Android TV boxes and tested an AI worm spreading Meta's Llama 3.1-8B in a simulated Android network, where only Z.ai's GLM-5.2 successfully spread across the entire network.

Oct 13Tue
  1. Semiconductor Engineering Chips and Packaging34

    On-Chip Monitors Detect Bit-Flip Attacks in AI Accelerators (UF, UT Dallas, RPI)

    A research team from the University of Florida, the University of Texas at Dallas and Rensselaer Polytechnic Institute published a paper, BARE-AI, proposing a runtime framework that detects, localizes and mitigates bit-flip attacks (BFA) during AI inference. The scheme uses built-in performance monitors to protect deep neural networks, avoiding the high hardware overhead, retraining dependence and limited targeting resistance of existing defenses.

Oct 7Wed
  1. Google Research47

    Open and Emergent Problems in Agentic Privacy and Security: A Contextual Angle

    Google released a report from its CAPS workshop, bringing together more than 50 academic and industry leaders to discuss the privacy and security challenges of autonomous agents. The report notes that agents differ from traditional software in three ways—unstructured interfaces, probabilistic control flow, and autonomous delegation—and, building on Contextual Integrity theory, proposes contextual policy engines combined with system-level sandboxing, model-level reasoning, and user-centric controls as a multi-layered defense.

Sep 30Wed
  1. Simon Willison59

    Quoting Anthropic Frontier Red Team

    Anthropic Frontier Red Team evaluated multiple models on 100 randomly sampled tasks from an internal Binary Exploitation benchmark; GLM-5.3 achieved full control-flow hijack in 4% of trials, and Claude Mythos Preview in 6%. Earlier models like Claude Opus 4.6 and GLM-5.2 had no successes, and the author argues a meaningful threshold has been crossed.

Sep 29Tue
Sep 23Wed
Sep 22Tue
Jul 27Mon
Jun 11Thu
Jun 1Mon
  1. Import AI48

    Import AI 459: AI oversight is difficult; scaling laws for protein folding models; and pricing the extinction risk of AI systems

    Import AI issue 459 reports: researchers from the University of Virginia, Anthropic, and the Bank of Canada estimate the US AI economy at roughly $250 billion nominal in 2025, with quality-adjusted real output growing about 2,600% a year, yet hard to see in GDP because of falling prices and the high share of inference. The UK AI Security Institute argues that using AI to oversee training processes to automate alignment research is not a panacea and is harder in practice than expected.

May 18Mon
Apr 3Fri
Mar 31Tue
  1. Google Research63

    Safeguarding cryptocurrency by disclosing quantum vulnerabilities responsibly

    Google Quantum AI published a white paper updating quantum resource estimates for breaking the 256-bit elliptic curve discrete logarithm problem (ECDLP-256): two circuits use under 1,200 logical qubits with 90 million Toffoli gates and under 1,450 logical qubits with 70 million Toffoli gates, cutting physical qubit requirements by roughly 20x versus previous estimates.

    Why it matters: The Google white paper offers lower quantum resource estimates for breaking ECDLP-256 along with a responsible zero-knowledge-proof disclosure approach, letting the crypto community gauge the urgency of migrating to PQC.

Mar 13Fri
  1. Berkeley AI Research45

    Identifying Interactions at Scale for LLMs

    Berkeley AI Research introduces SPEX and ProxySPEX, two algorithms that use structural assumptions such as sparsity, low degree, and hierarchy to turn interaction discovery in ablation attribution into a sparse recovery problem, identifying the key interactions that drive LLM outputs.