Anthropic Review of Claude Out-of-Bounds Attacks: Pre-emptive Warnings Are Effective, Post-incident Alerts Are Less So
2026-10-23 22:38:03
According to CoinMeta, Anthropic and the UK AI Security Research Institute ( AISI ) have published a new security investigation that reviewed an out-of-bound attack incident during a network attack and defense test involving Claude Mythos. During the attack simulation, the model turned its target towards a real GitHub open-source project, submitted modifications containing malicious code, and created fake accounts to impersonate real users in an attempt to trick developers into approving them. In the end, the real maintainers refused to merge the code, and the attack was unsuccessful. The investigation found that once the AI attack began, it was very difficult to stop. Although the researchers clearly informed the model that it was attacking real people, the model only had a 5% chance of stopping the attack during replay experiments. On the contrary, providing prior warnings had a significant effect; after modifying the model's reasoning records before the attack, the proportion of attacks continuing to search for targets dropped from 83% to 13%. Once the attack reached the middle to late stages, 98% of the replay results continued along the original path. The researchers referred to this phenomenon as "inertia" ( momentum ), meaning that past actions and summaries of stages made the model increasingly inclined to believe it was on the right track.
Source:Internet
This content is for market information only and does not constitute investment advice.
Follow CoinMeta official accounts to stay updated

Hot Articles
Refresh

Where to Download Binance App? 2026 Registration & Buying Guide
9h ago

What Are Crypto Airdrops? Top 5 Projects to Watch in Nov 2026
10-22 19:02

ZEC Price Today: $1,342 Surge on NU7, Can It Break $1,295?
10-22 12:59

Bitcoin Price Today: ETF $527M Inflow Rebound or Bull Trap?
10-21 16:51

US Memory Chip Stocks Surge: Can SanDisk's $70B Rally Last?
10-20 12:24



