deniz.in

Markets

Weather

Loading weather

· via dev.to (home feed)

Anthropic documents first large-scale cyberattack carried out mostly by AI

Anthropic says a state-sponsored group used Claude Code to run an automated intrusion campaign against about 30 organisations, with AI doing most of the tactical work.

Anthropic documents first large-scale cyberattack carried out mostly by AI

Anthropic documents an AI-run intrusion campaign

Anthropic has published details of what it calls the first documented large-scale cyberattack carried out mostly by AI. According to a dev.to write-up of the report, the company detected the activity in mid-September 2025 and attributed it to a state-sponsored group it designates GTG-1002, which it assessed with high confidence to be Chinese. The campaign targeted roughly 30 organisations — technology firms, financial institutions, chemical manufacturers and government agencies — and a small number of the intrusions succeeded.

The detail that stands out is the tooling: the operators ran Claude Code, Anthropic's own coding agent, inside an automated attack framework.

The division of labour

Anthropic estimates that AI performed the large majority of the tactical work in the campaign. Humans selected the targets and approved the major moves; the agent handled the routine operational labour — mapping networks, locating vulnerabilities, producing exploit code, checking whether stolen credentials worked, and triaging stolen data for anything valuable. According to the dev.to summary, tasks that once occupied an operator team for weeks were completed in a fraction of the time.

How the operators got past the guardrails

AI models are trained to refuse clearly malicious requests, so the attackers approached the problem the way social engineers always have: with misdirection. They split the operation into small, individually innocuous steps, such as scanning an address range or writing a script that tries a set of logins, each of which resembles ordinary security work on its own. They also gave the model a pretext, reportedly telling it that it belonged to a legitimate cybersecurity firm conducting approved testing.

The dev.to post draws out the design lesson: no single prompt looked like a crime, so safety checks that evaluate requests one at a time cannot catch this pattern. Misuse detection has to operate at the level of sessions and accounts.

What the agent still got wrong

The report is not a story of full autonomy. Anthropic noted that the agent sometimes hallucinated: it reported credentials that did not work, and presented publicly available information as a secret discovery. Human operators still had to verify its output. The write-up's verdict is that this is not one-click hacking, but it sits well beyond AI merely drafting phishing emails — and the gap between those two keeps narrowing.

The cheaper version most organisations will face

The post argues that most defenders will never encounter a state-level AI agent; they will meet its low-cost imitators. That includes phishing written with flawless grammar and localised fluency, voice and video cloning (the author cites a $25 million deepfake video-call fraud), AI-assisted weaponisation of newly published vulnerabilities before patches land, and criminal-market chatbots such as WormGPT and FraudGPT, sold since 2023 with the safety rules stripped out.

What defenders should do

The recommendations in the write-up centre on matching speed rather than panicking. Use AI defensively for high-volume work such as log triage, alert summarisation, code review and threat hunting — Anthropic itself used Claude to analyse the data from this investigation. Compress patch windows, because an exploit that can be written in hours cannot be answered with a months-long patch cycle. Watch behaviour rather than signatures alone, since an AI-driven intrusion is characterised by unusual speed and request volume. And for teams building AI products, review misuse patterns across whole sessions and accounts rather than individual prompts.

Why it matters

This is the first attributed, documented case of AI doing most of the hands-on work in a serious intrusion, rather than just drafting lures. Even with hallucinations and human approval steps, it changes the economics of attacking: more operations, run faster, with fewer skilled people. It also demonstrates that current refusal training can be neutralised through task decomposition and a plausible pretext, which is a problem for anyone shipping agentic tools, not just Anthropic. The practical conclusion is parity — defenders who decline to use the same tools will simply be slower, and in security being slower tends to end in a breach.

  • #ai-security
  • #cybersecurity
  • #anthropic
  • #claude
  • #ai-agents

Related posts