The problem is that "cybersecurity" isn't some special task that only your security team does.
In the project I maintain, I find bugs and fix bugs. Some of those bugs might result in an LPE. I generate a regression test, then I fix the bug.
The problem is that generating a regression test for that type of bug is technically a PoC. I can almost never get Fable to create one. Sometimes Opus 5 punts as well. Same with Sol and Luna.
That is, unless I socially engineer the model. I can't talk about security. I make sure they don't read the file call cve_test.c (literal regression tests for CVEs). I have to hide part of my project from the models for them to work.
Anthropic and OpenAI are driving me to use other models.
What a bunch of wankery from Anthropic. I already use Sol 5.6 for security auditing and it works great, and as a bonus doesn't give verbal vomit every time.
From a cost perspective Mythos is too expensive right now. With the right Harness and a few layers of models you can get close or better in some circumstances. Kimi / GLM, Qwen etc. And that's before ablation / Abliteration...
For those in Mythos.. if you ask how much it cost to assess their repos, your jaw would drop. We're talking the price of buying a couple machines to run Kimi / GLM full weight outright.. for one Scan.
Right now I wouldn't say GLM 5.3 is the same, but it's not far off. For the cost benefit it's the better of the two.
I’ve been working on a decompilation project that fable was choking on and GLM 5.3 has been chunking away at it for 72 hours now? I think it’s my favorite agentic/implementer model right now.
> Bringing the cybersecurity capabilities of Claude Mythos 5 to more defenders
This dance is quite annoying. When Anthropic releases a paid model, the user should control what it does and doesn't do. The other day I had a security incident that required urgent response. ChatGPT and Claude were utterly useless (I quickly attempted to get access to the former's advanced security capabilities but was met with a form I could complete - far too slow for a time-sensitive problem like a security incident!). So I used grok and it helped! I am told Kimi also helps in such cases although haven't tried it yet.
Screw you Anthropic and screw your gatekeeping, Opus 5 refuses even basic reverse engineering / patching tasks, even BPF is apparently too dangerous, you lost your minds..
This week I found two issues in my company codebase. After finding them I told a claude session about one and asked for a quick proof of concept demo of the exploit. It refused, including refusing simple things in the same session afterwards.
Meanwhile same model in a new tab, say I need help creating a page that hits an endpoint with a special payload and it does the same things that were too dangerous in the previous tab...
may have been rushed by hugging face being unable to use claude to debug or fix their breach, because there isnt detail on new guardrails put into place to protect against anthropic's initial concerns of wide distribution?
separately, it is interesting they are adding an oem type offer:
>We’re working with our cybersecurity technology and services partners to integrate Claude Mythos 5 into the products and services defenders already use to secure their software.
anyone know the shape of those contracts, e.g. pure tokens/usage or more of a traditional licensing or oem type structure?
In a world where things such as GLM-5.3, DeepSeek-V4-Pro-0813, and Kimi-K3 exists, this is a bit laughable.
Anthropic needs some model with a fancy name so they can pretend for another while that their model is so powerful it will destroy the world if released. I propose Claude Legend 6.
>> In a world where things such as GLM-5.3, DeepSeek-V4-Pro-0813, and Kimi-K3 exists, this is a bit laughable.
Is it, though?
We don't know what Mythos is really capable of, beyond what Anthropic has told us, and some second-hand accounts from orgs that have been whitelisted.
What we do know is that their withholding it from the masses is causing a lot of harm to their reputation and general annoyance. And probably a lot of money as well, as those people cancel their subscriptions in favor of other models. They are about to IPO, and you don't want people to have a bad taste in their mouth during this critical period.
As such, I think it is reasonable conclude that there must in fact be very valid reasons for them to keep going down this path of gradual access-widening. I'm never going to blindly trust a corporation, but in this case I'm not going to hate on them either because, at the risk of repeating myself, we just don't have all the facts.
Open models are extremely capable, as benchmark after benchmark has indicated.
Beyond that, for the vast majority of software development (including cybersecurity), the open models are there already. All that without having to pay the hefty Anthropic premium, not to mention all their bullshit with pretending their model is some sort of WMD and their awful uptime (although, to their credit, they seem more stable than Github).
In the project I maintain, I find bugs and fix bugs. Some of those bugs might result in an LPE. I generate a regression test, then I fix the bug.
The problem is that generating a regression test for that type of bug is technically a PoC. I can almost never get Fable to create one. Sometimes Opus 5 punts as well. Same with Sol and Luna.
That is, unless I socially engineer the model. I can't talk about security. I make sure they don't read the file call cve_test.c (literal regression tests for CVEs). I have to hide part of my project from the models for them to work.
Anthropic and OpenAI are driving me to use other models.
For those in Mythos.. if you ask how much it cost to assess their repos, your jaw would drop. We're talking the price of buying a couple machines to run Kimi / GLM full weight outright.. for one Scan.
Right now I wouldn't say GLM 5.3 is the same, but it's not far off. For the cost benefit it's the better of the two.
I have a feeling what we are about to see on HuggingFace is not the GLM 5.3 that you're using now.
This dance is quite annoying. When Anthropic releases a paid model, the user should control what it does and doesn't do. The other day I had a security incident that required urgent response. ChatGPT and Claude were utterly useless (I quickly attempted to get access to the former's advanced security capabilities but was met with a form I could complete - far too slow for a time-sensitive problem like a security incident!). So I used grok and it helped! I am told Kimi also helps in such cases although haven't tried it yet.
Meanwhile same model in a new tab, say I need help creating a page that hits an endpoint with a special payload and it does the same things that were too dangerous in the previous tab...
I eventually gave up and just asked it to fix the issue. The first thing it did? Write a PoC to verify the issue was still valid...
separately, it is interesting they are adding an oem type offer:
>We’re working with our cybersecurity technology and services partners to integrate Claude Mythos 5 into the products and services defenders already use to secure their software.
anyone know the shape of those contracts, e.g. pure tokens/usage or more of a traditional licensing or oem type structure?
Anthropic needs some model with a fancy name so they can pretend for another while that their model is so powerful it will destroy the world if released. I propose Claude Legend 6.
With how unsustainable they are they really need to hype up those bagholders.
Is it, though?
We don't know what Mythos is really capable of, beyond what Anthropic has told us, and some second-hand accounts from orgs that have been whitelisted.
What we do know is that their withholding it from the masses is causing a lot of harm to their reputation and general annoyance. And probably a lot of money as well, as those people cancel their subscriptions in favor of other models. They are about to IPO, and you don't want people to have a bad taste in their mouth during this critical period.
As such, I think it is reasonable conclude that there must in fact be very valid reasons for them to keep going down this path of gradual access-widening. I'm never going to blindly trust a corporation, but in this case I'm not going to hate on them either because, at the risk of repeating myself, we just don't have all the facts.
Yes, it truly is.
Open models are extremely capable, as benchmark after benchmark has indicated.
Beyond that, for the vast majority of software development (including cybersecurity), the open models are there already. All that without having to pay the hefty Anthropic premium, not to mention all their bullshit with pretending their model is some sort of WMD and their awful uptime (although, to their credit, they seem more stable than Github).
I cannot fathom why anyone uses their service.
Anthropic is overconfident, and it's going to bite them in the ass.
Dario deserves it for being so hypocritical, fear mongering, and ladder pulling. Fastest hero to villain arc in recent memory.