Open models trail closed ones by 6 to 7 months in cyber skills
The best open-weight AI model is about six to seven months behind the best closed models at cybersecurity tasks, Epoch AI reported on Oct. 16, 2026. Z.ai's GLM-5.3 leads the open models on Epoch's cyber scale with a score of 160, against 171 for the top closed models.
What does Epoch AI's estimate say, in one sentence?
"This places the open cyber frontier roughly where the closed frontier stood 6–7 months ago," according to Epoch AI's data insight by Jaeho Lee and Alexander Barry. Open-weight models are those whose files anyone can download and run; closed models, such as Claude and GPT, are available only through their companies.
How did they measure it?
Epoch AI used its Cyber ECI, "a domain-specific version of the Epoch Capabilities Index (ECI) based on cybersecurity benchmarks." The general ECI "measures and tracks AI model capability using benchmark results," Epoch AI says in its methodology update.
To build the cyber version, Epoch AI kept the benchmark settings from a joint fit of general and cyber tests, then estimated "each model's Cyber ECI from its cyber results alone." Scores sit on the same scale as the general ECI.
What did they find?
Open vs. closed AI models on Epoch AI's Cyber ECI, October 2026
Z.ai's GLM-5.3 is "the highest-scoring open-weight model on the Cyber ECI," with 160. That is above OpenAI's GPT-5.4, released in March 2026, according to Epoch AI.
Two closed models from April 2026 sit above GLM-5.3: Anthropic's Claude Mythos Preview and OpenAI's GPT-5.5. The closed frontier now is Anthropic's Claude Opus 5.5 and OpenAI's GPT-6 Astra, both at 171.
The six-to-seven-month gap comes from when the closed frontier reached a level comparable to GLM-5.3's score.
What the estimate doesn't say
The page does not name the cyber benchmarks it uses, give a margin of error or list scores for Claude Mythos Preview and GPT-5.5. A benchmark score also does not show what a model can do in a real attack.
On Nov. 4, 2026, Epoch AI changed how it calculates the ECI to use a Bayesian model. The methodology update does not say whether the Oct. 16 cyber figures change.
Context: what a six-month gap means in practice
Two weeks after this estimate, Epoch AI published a test in which GLM 5.3, working on its own, built attacks on six Firefox versions from security fixes not yet shipped to users, at about $1,000 per version.
That is the practical side of the gap. Open-weight models can be downloaded and run without a company's safeguards. "We did not trigger any safeguards or refusals from any provider, including Z.ai," the researchers wrote in that report.
FAQ
How far behind are open AI models in cybersecurity?
About six to seven months behind the best closed models, according to Epoch AI's Oct. 16, 2026, estimate on its Cyber ECI.
What is the best open-weight model at cyber tasks?
Z.ai's GLM-5.3, with a Cyber ECI score of 160, according to Epoch AI as of Oct. 16, 2026.
What is the Cyber ECI?
It is Epoch AI's cybersecurity version of its Epoch Capabilities Index, estimated from cyber benchmark results and on the same scale as the general index.
Sources
- Epoch AI, Open-weight models trail closed models in cyber capabilities by 6–7 months (Oct. 16, 2026) · archived copy
- Epoch AI, Updating the Epoch Capabilities Index methodology to use a Bayesian model (Nov. 4, 2026) · archived copy
- Epoch AI, AI can turn security fixes into working exploits before users receive an update (Oct. 29, 2026) · archived copy
Cite this
Open models trail closed ones by 6 to 7 months in cyber skills, New Mind Museum, November 6, 2026. https://newmindmuseum.com/safety/2026/11/open-weight-models-cyber-gap-6-7-months-epoch/
New Mind Museum. (2026, November 6). Open models trail closed ones by 6 to 7 months in cyber skills. https://newmindmuseum.com/safety/2026/11/open-weight-models-cyber-gap-6-7-months-epoch/
“Open models trail closed ones by 6 to 7 months in cyber skills.” New Mind Museum, 6 Nov. 2026, https://newmindmuseum.com/safety/2026/11/open-weight-models-cyber-gap-6-7-months-epoch/.
@misc{new-mind-museum-2026-open-models-trail-closed-ones-by-6-to-7-,
author = {{New Mind Museum}},
title = {Open models trail closed ones by 6 to 7 months in cyber skills},
year = {2026},
url = {https://newmindmuseum.com/safety/2026/11/open-weight-models-cyber-gap-6-7-months-epoch/}
}Free to quote and cite with a link to this page.
Keep reading
Sources
- Epoch AI, Open-weight models trail closed models in cyber capabilities by 6–7 months (Oct. 16, 2026)
- Epoch AI, Updating the Epoch Capabilities Index methodology to use a Bayesian model (Nov. 4, 2026)
- Epoch AI, AI can turn security fixes into working exploits before users receive an update (Oct. 29, 2026)