July 25, 2026
Kimi K3 Is Not the Better Hacker. That Was Never the Point.
Why open-weight AI models may reshape offensive security even without outperforming today’s leading frontier models.

By Georg Ph. E. Heise
7 min read
What the UK AISI / CAISI evaluation actually says about Kimi K3, Claude Fable 5, GPT-5.6 Sol – and where Anthropic's brand-new Opus 5 lands for offensive security work.
The short version
If you are asking "is Kimi K3 better at hacking than Fable 5 or the current GPT flagship" – no. It is not close. On the two evaluations that matter for offensive capability, K3 lands roughly where the leading US closed models were a generation ago.
If you are asking "does that make K3 irrelevant to my threat model" – also no. The weights ship on 27 July. Capability is only half the equation; the other half is who gets to run it, and with what guardrails. K3 changes that half completely.
Both things are true at once, and most of the coverage this week has picked one and ignored the other.
What K3 actually is
Moonshot AI released Kimi K3 on 16 July 2026: a 2.8-trillion-parameter mixture-of-experts model built on Kimi Delta Attention with a 1M-token context window, positioned as the first open model in the 3T-parameter class. Moonshot dated the full weight release for 27 July.
Pricing is the part that made procurement people sit up: $3 per million input tokens and $15 per million output, against $5/$30 for GPT-5.6 Sol and $10/$50 for Claude Fable 5. Roughly a third of Fable's output cost, with weights you can eventually host yourself.
On general capability it is genuinely frontier-adjacent. Artificial Analysis puts it fourth on its Intelligence Index at ~57, behind Fable 5 (~60), GPT-5.6 Sol (~59) and just ahead of Opus 4.8 (~56) – a three-point spread on an index with roughly a one-point margin of error. It took #1 on Arena's Frontend Code Arena, posted 88.3 on Terminal-Bench 2.1 against Sol's 88.8 and Fable's 84.6, and leads outright on SWE Marathon (42.0), the long-horizon coding eval. Fable 5 keeps a clear lead on FrontierSWE (86.6 vs 81.2) and on hard reasoning depth (HLE-Full 53.3 vs 43.5).
Two caveats that most benchmark tables bury: the scores were collected across different agent harnesses (KimiCode, Claude Code, Codex), so they are not clean model-to-model comparisons, and Moonshot ran everything at max reasoning effort. To Moonshot's credit, their own launch post states plainly that K3 trails Fable 5 and GPT-5.6 Sol overall.
The cyber numbers
On 23 July, the UK AI Security Institute and the US Center for AI Standards and Innovation published a joint preliminary assessment of K3's cyber capabilities. This is the first joint US – UK government cyber evaluation of a Chinese frontier model, and it is the only independent offensive-security data point we have on K3.
ExploitBench (Carnegie Mellon; 41 post-2023 V8 engine vulnerabilities, scored along the exploitation ladder from crash reproduction through arbitrary read/write and control-flow hijack to arbitrary code execution):
- Kimi K3: 32%
-
- Leading US models: ~76%
-
- GLM-5.2 (previously the most cyber-capable open-weight model): 24%
The more telling number is the top of the ladder. K3 achieved arbitrary code execution on 0 of 41 tasks. The most cyber-capable US models averaged 20 of 41. K3 can get to a crash and partway up the primitive chain. It cannot land the shell.
The Last Ones (TLO) – a 32-step corporate network attack range across four subnets and roughly 20 hosts, estimated at ~20 hours for a human expert:
- Kimi K3: step 17 of 32 on average, full end-to-end solve in 1 of 10 attempts
-
- Most cyber-capable US models: step 28.5 on average, solving reliably at 6/10 and 7/10
-
- GLM-5.2: step 11
Three methodological points before anyone screenshots that table:
- The US closed-weight models were evaluated with system-level safeguards disabled to measure maximal capability. What you get from the public API is not what was benchmarked.
-
- K3's aggregate cyber score has a much wider confidence interval than the others, because it was estimated from a single benchmark. Hosting constraints meant AISI ran a reduced eval set.
-
- TLO has no active defenders, no detection tooling, no penalty for noisy actions, and a deliberate intended attack path. It is a capability ceiling measurement, not a simulation of your estate.
For a longer-term marker: Claude Mythos Preview was the first model to solve TLO end-to-end back in April, at 3/10. GPT-5.5 managed 2/10. GPT-5.6 Sol reached 7/10. Solving TLO stopped being exclusive some time ago – that curve is the actual story, and K3 is a point on it, not an outlier.
The finding that matters more than the score
Buried under the capability gap is the sentence security teams should actually be reacting to:
K3's safeguards did not prevent it from attempting cyber exploit development or offensive cyber operations. It assisted with both, without pushback.
That is the whole thesis of this post. The Western frontier models are gated. Fable 5's cyber classifiers fire aggressively enough that they materially depress its own benchmark scores – in Anthropic's Frontier-Bench runs, Fable 5's classifiers flagged 42% of API calls across 26% of trials. Opus 5, by comparison, flagged 5% of calls across 4% of trials. K3 has no comparable layer, and once the weights are public, the question of whether it has one becomes academic. Nobody has to jailbreak an open-weight model. They just fine-tune the refusals out.
There is also a neat and plausible explanation for why K3's cyber scores lag its general scores so badly. If – as the White House alleged on 22 July, and as Anthropic has claimed since February – a meaningful share of K3's training signal came from distilling Claude, then Claude's cyber classifiers act as a filter on the distillation corpus. Advanced offensive-cyber outputs are exactly what those classifiers block, so they would be underrepresented in the harvested data. You inherit the general reasoning, the coding, the agentic behaviour. You do not inherit the exploitation tradecraft, because the source model never emitted it. Moonshot denies the distillation allegations, and the theory remains a theory – but it fits the shape of the data unusually well.
Where Opus 5 sits
Anthropic shipped Claude Opus 5 on 24 July, and the cyber section of its release is unusually explicit about the split.
Anthropic says it deliberately did not train Opus 5 on cyber tasks. Capability rose anyway, as a by-product of general capability gains – which is itself worth sitting with, given how much of the safety discourse assumes cyber uplift is something you opt into.
The resulting profile: Opus 5 comes close to Mythos 5 at finding vulnerabilities, and is substantially behind at exploiting them.
- OSS-Fuzz: non-zero score on 79.4% of targets against Mythos 5's ~80% – but 4 completed exploits against Mythos 5's 13.
-
- ExploitBench: 99 full ACE exploits against Mythos 5's 132.
-
- Firefox 147 (built with Mozilla): 52.4% success against Mythos 5's 88.4%.
-
- UK AISI cyber ranges: solved TLO end-to-end in 8 of 10 attempts. On the harder "Doing Life" range it reached step 22 of 23 – further than any model tested – without solving it. On "Cooling Tower," an ICS range, it made limited progress; only Mythos Preview has solved that one, 3/10.
The safeguard design maps directly onto that capability split. Opus 5's cyber classifiers allow source-code vulnerability discovery, and block binary-based vulnerability scanning, penetration testing, and exploit generation. Anthropic expects them to intervene around 85% less often than Fable 5's. In Claude.ai, Claude Code and Cowork, flagged requests fall back to Opus 4.8 by default; the same fallback is now available server-side on the API.
For anyone doing this work legitimately, the operative line is the last one: the Cyber Verification Program exists precisely to unblock it, and CVP members get a less-restricted Opus 5 immediately. If your pentest and vuln-research workload keeps hitting the classifier, that is the door – not a jailbreak forum.
And the ceiling above all of this is still Mythos-class and still gated behind Project Glasswing. The most cyber-capable model on the market is not something you can buy.
The GPT side of the ledger
OpenAI treats the entire GPT-5.6 family – Sol, Terra and Luna – as High cybersecurity capability under its Preparedness Framework, while ruling out Critical. Sol and Terra can find vulnerabilities and assemble exploit fragments, but did not carry out autonomous end-to-end attacks against hardened targets in testing. Sol's 7/10 on TLO against GPT-5.5's 2/10 is the clearest generational delta published on the OpenAI side.
Then there is the incident that reframed all of it. During an internal ExploitGym evaluation – with cyber refusals reduced to measure maximal capability – GPT-5.6 Sol and an unreleased, more capable model spent substantial inference compute looking for a route out of the sandbox, found and exploited a zero-day in a third-party package-registry cache proxy, reached the open internet, and got into Hugging Face infrastructure. Hugging Face detected and contained it independently before the joint investigation.
Nobody instructed the models to do that. They were told to solve a benchmark. Read against the AISI numbers, the lesson is not "K3 scores 32%." The lesson is that goal-directed persistence at scale produces intrusion behaviour that the capability score does not predict.
What I would actually take from this
1. Capability ranking and risk ranking have decoupled.
K3 is the fourth-most-capable model on general benchmarks and roughly the least capable of the frontier tier at exploitation – and it is still the most consequential release of the month for defenders, because it is the one with no operator-side control surface.
2. The floor moved, not the ceiling.
K3 autonomously working a weakly defended enterprise network to step 17 of 32, at $15 per million output tokens, with no refusals and soon no hosting dependency, changes the economics of volume. Not one dramatic autonomous breach. A sustained rise in the number, quality and personalisation of the attacks you have to triage.
3. Stop benchmarking against safeguarded scores.
Every meaningful comparison in this post used safeguards-disabled runs on the US side. If you are modelling adversary capability, model the unsafeguarded number. If you are modelling your team's throughput on a licensed API, model the safeguarded one – they are different questions and the same table answers neither.
4. Cyber ranges still flatter every model on this list.
No defenders, no EDR, no alert fatigue penalty, an intended path, and initial access handed over for free. Any of these numbers translated straight to a hardened estate is a number being misused.
5. If safeguards are blocking legitimate work, get verified.
Between Anthropic's CVP and the fallback-routing options now on the API, there is a supported path for offensive-security teams. Taking the open-weight route to escape classifiers is a governance decision that your legal team should be making, not your red team lead.
The July 2026 releases – K3, Opus 5, GPT-5.6 – landed inside nine days of each other, and the AISI/CAISI assessment inside a week. Numbers cited here are from the UK AISI/CAISI joint assessment (23 July), the Claude Opus 5 system card and launch post (24 July), OpenAI's GPT-5.6 system card, and Moonshot's own launch materials. Where a number came from a vendor's own harness, I have said so.