Live data from Hacker News

Anthropic's open-source framework for AI-powered vulnerability discovery

github.com

101–110 of 177 posts

Re: Anthropic's open-source framework for AI-powered vulnerability discovery

#101
post #93

It’s clear that Anthropic is building harnesses for specific use cases now and turns them into products. This is the equivalent of Claude Design but for security. Different harness, different packaging and obviously different distribution because the persona is different. It’s funny because from all the posts I’ve read from companies reporting on Mythos, everyone is building their own harness for it. Cisco even publi…

This post is misleading and so is the GitHub org. Anthropics vs Anthropic.

Re: Anthropic's open-source framework for AI-powered vulnerability discovery

#104
post #5

I wonder how much this thing costs to run. https://github.com/anthropics/defending-code-reference-harne... says: > As a rough guideline, expect ~10K uncached input tokens/min and ~2K output tokens/min per agent. You can scale parallelism up to your account's ITPM limit (roughly 10 agents per 100K ITPM). My guess would be hundreds of dollars with Opus and thousands of dollars with Mythos.

I think that the cost of Opus is already prohibitively expensive, so not sure how that would compare to Mythos. Check this calculator- it shows that a company with 100 devs can hit ~2.5M cost on tokens annually, which is wild! https://ai-cost-calculator.arnica.io

It's wild, but how many FLOPs in computation is occurring in those 2.5M in tokens doing? Might not sound quite as wild using that metric.

Re: Anthropic's open-source framework for AI-powered vulnerability discovery

#106
post #5

I wonder how much this thing costs to run. https://github.com/anthropics/defending-code-reference-harne... says: > As a rough guideline, expect ~10K uncached input tokens/min and ~2K output tokens/min per agent. You can scale parallelism up to your account's ITPM limit (roughly 10 agents per 100K ITPM). My guess would be hundreds of dollars with Opus and thousands of dollars with Mythos.

Just another example of an overextension of technology in a scenario where applying a proper harness would suffice.

Reminiscent of the early days of tax automation where importing a W2 cost hundreds of dollars until people realized typing in 6 boxes worth of data was easy and paying the automation fee ate up their entire tax return.

Post reply on HN