JT Book a call

Blog / AI

Anthropic: AI Worms Are Months Away

Author

JetThoughts

Published

5 min read

Anthropic AI worms warning - small models self-replicating across IoT devices
In this post

Anthropic’s Frontier Red Team bought 15 off-brand Android TV boxes at about $55 each and ran a 26-billion-parameter AI model spread across them. Slowly - 0.39 tokens per second, where a chatbot gives you dozens. Then they showed a model hopping from device to device on a simulated home network, installing itself as it went.

Their research post from October 12 concludes that small AI models may be months away from self-replicating across commercial smart devices - ovens, fridges, TV boxes - without any datacenter involved. The Guardian’s headline put “months away” in quotes, and that skepticism is fair. The details are worth your time anyway.

If you run AI agents at your company, or your dev shop does, this research is really about what happens when capable models meet the cheapest, least-watched computers you own.

What the experiment actually showed #

William Zhou and Daniel Freeman broke self-replication into four stages: find targets, get execution, set up inference, spread to the next host. They mostly skipped the hacking stages, citing earlier work showing small models can already write exploits, and measured the part nobody had tested - getting a model running on unfamiliar, weak hardware.

That part went well for the worm. A 9-billion-parameter model got inference running on 8 of the 9 hardware types tested, from a Jetson Nano to a Mac.

The end-to-end run used a firewalled network of eight emulated Android nodes with an unauthenticated debugging port. One seeded “patient zero” node hopped across all of them, standing up an inference server on each.

Only one model, GLM-5.2 from Z.ai, completed the full chain - 8 of 8 nodes in four out of five trials. The authors are upfront that the open port makes this an upper bound, not a demonstration of a real worm.

The honest caveats, and the uncomfortable trend #

No rogue replicator exists. Anthropic says so in the paper, and the test rig was deliberately soft: no authentication on the port, and the worm’s own brain ran on a separate server because the TV boxes were too weak to hold it.

Here’s what should still get your attention. Past IoT botnets like Mirai spread through default manufacturer passwords, which is barely harder than an open port. And when each copy of the worm left notes for the next generation, setup success climbed from 45% to as high as 84% - the copies were learning from the previous copy’s attempts.

The timeline claim rests on a trend line: plotting open-weight models against a capability index, the authors estimate a small model reaches GLM-5.2’s level by the end of 2026. They call it a rough estimate, since the index measures general capability rather than replication skill.

The Verge’s coverage notes the skeptic case too. Anthropic didn’t use its own models in the tests and has repeatedly argued open-weight alternatives carry more risk, so read the warning with that incentive in mind.

Why a SaaS founder should care about TV boxes #

Your product probably doesn’t run on a smart oven. But the same cheap, unmanaged device class sits on your office network, your developers’ home networks, and your coworking space’s Wi-Fi, and Nicholas Papernot at the University of Toronto told The Verge those devices become launchpads: “Devices that were not a target previously because of limited human attacker resources and time can now become targets.”

Jeffrey Ladish at Palisade Research, which demonstrated AI self-replication earlier this year, expects the first real-world case within 12 months. A worm with a doubling time of days won’t make headlines the night it lands; it will accumulate quietly on hardware nobody patches.

An exposed MCP server with a command parameter and an Android box with an open debug port share one shape - a capable agent meeting a machine with no gate. The MCP side gets its own post: the protocol’s STDIO flaw is officially ‘by design’. In both cases the defense is boring network hygiene.

What defense looks like #

Anthropic frames it like epidemiology: push each infected device’s spread rate below one and the worm dies out. Their suggested tools are network monitoring, honeypots, and ISP-level quarantine.

For a company your size, the practical version is shorter. Know what’s on your network, because an inventory is the difference between “we have 40 devices” and a shrug. Give any agent you run narrow permissions with a human approval step on anything that reaches outside, the same rule from our PocketOS post-mortem.

Then patch or replace the $55 boxes - the vacuum, the TV, the cheap camera in the conference room.

None of this is a reason to panic. It’s a reason to stop treating the devices nobody watches as harmless, because the research shows they’re becoming compute someone else’s model can use.

Need help locking down your agent setup? See how we work

Sources #

Tell us what you need built

JetThoughts has been building software since 2008. Book a call, or write to sales@jetthoughts.com. You'll leave the call with a written one-page scope within 2 working days.

#01 Paul Keen
Paul KeenChief Technology Officer & Open Source Contributor

A 30-minute call; pick a time.