Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What it feels like to work with Mythos

oneusefulthing.org

Post reply on HN
Print view View original

171–180 of 337 posts

Re: What it feels like to work with Mythos

#171

Post by crystal_revenge »

cyanydeez wrote: post #34
JumpCrisscross wrote: post #23

Anecdote: I fed Fable some models I’ve been hand verifying (basically, I sketch out a scenario for Opus to model, it builds it, I ask it to show me the math, I correct it, we iterate like this, then I double check its code to make sure the math matches the model logic). Fable found almost every error I found, and then had some interesting suggestions for additional variables. It also burned through my usage quota lik…

now for the best question: whats your ROI here?

The parent comment is describing a test they ran so they could assess their trust in the model for scenarios they don't have time to fully understand.

Do you not believe in running tests, evaluations, or experiments at all to better understand your environment?

The ROI in the case of a positive outcome is the reduced time needed to inspect the results in the future (the entire point of AI is to know what you can trust it on, so you can delegate everything at that level with less oversight). The ROI in the negative case is the tokens not wasted on tasks to ambitious for the model.

Re: What it feels like to work with Mythos

#172

Post by nozzlegear »

kesor wrote: post #164
coldtea wrote: post #106

Earlier quoted context omitted.

> What I find fascinating that there is so little substance in this article about the quality of produced code and the medium. I clicked one of his examples intrigued "a snake game where the snake is self-aware and crazy things happen;". Played for 1-2 minutes, and it's the classic 1980s snake game. Am I missing something? What is "self-aware" about it? Some funny messages at the bottom of the screen? And what are th…

You didn't play long enough. There are layers and layers and layers of features in that game if you play for 10 minutes or more.

Can you spoil it for us?

Re: What it feels like to work with Mythos

#173

Post by SpicyLemonZest »

jimbokun wrote: post #118
an0malous wrote: post #114

Earlier quoted context omitted.

These posts are never written by software engineers, it’s always some tech exec, retired engineer, or VC. This author is apparently a professor at the Wharton School of Management? None of these people have to ship or maintain real products, they’re just making side projects. The only decent software engineering perspective I’ve seen has been from Mitchell Hashimoto.

Well that’s kind of the point. They can just summon bespoke software out of the ether that only handles the use cases of themselves and a few of their collaborators. Making “side projects” was mot possible for non-developers before powerful LLMs. Now it is.

It is, and it's cool that it is, but the calibration is important. Statements like this:

> With Fable the spell has gotten powerful enough that I am no longer sure I am the wizard. I am closer to a patron. I describe what I want, I pay for it, and I judge the result. The conjuring happens somewhere I cannot watch, in hundreds of small choices I never get a vote on. The work has shifted from process to outcome. I no longer steer; I commission.

have a very different meaning coming from a non-technical researcher than they would from someone who builds software for a living.

Re: What it feels like to work with Mythos

#174

Post by HDBaseT »

pbgcp2026 wrote: post #155

[flagged]

The model is public and none of the inputs/outputs contained biosecurity or cybersecurity prompts.

You can do all of this (and more) on Claude Fable 5, in-fact Fable 5 outperforms Mythos in most tasks (where the guardrails don't kick it at least).

Re: What it feels like to work with Mythos

#175

Post by SpicyLemonZest »

crystal_revenge wrote: post #170
jimbokun wrote: post #116

Earlier quoted context omitted.

Does it matter to the people requesting the software if it acts in the way they expect?

We've lived in a software bubble for so long, most software engineers have completely forgotten that the purpose of (most) software is to solve a problem . If that problem solves the problem well and reliably it doesn't matter the quality of the code. In fact, that's the entire reason we care about "quality code", because we assume that quality code is code that does what you expect well and consistently. I say this…

I haven't forgotten that, I affirmatively think it's false. High quality code is necessary to solve problems reliably. Perhaps some people call things code quality when they don't matter (I really don't care what most variables are named), but there have always been teams who try to increase velocity by disregarding code quality, and from what I've seen AI does not stop them from shipping outages constantly.

Re: What it feels like to work with Mythos

#176

Post by ramesh31 »

rstuart4133 wrote: post #146
Ferret7446 wrote: post #76

Earlier quoted context omitted.

Humans are very expensive, so the equation almost always falls against them. It's not just salary, but also safety/labor regulation, legal risk, vacations, sick time, personal conflicts, HR, benefits. Even when automation is more expensive on paper, it's generally still cheaper

> Humans are very expensive, so the equation almost always falls against them. You underestimate what these models cost. Uber's budget is $1,500/dev/month. I gather that was put in place because the dev's were going through $6,000/dev/month, which Uber decided could not be cost justified. Fable costs at least twice as much, or $12,000/dev/month. Fable can apparently work for hours without supervision, which means a s…

> I would not be at all surprised if they can put a nought or two on that number.

People keep saying this and it keeps not happening.

ChatGPT Pro was $200/mo when it launched in '23 for a ~100B class model with 8k context. Claude Max is now the same price for practically unlimited access to a ~1T class model with 1M context.

Moore's Law never died, it just switched architectures.

Re: What it feels like to work with Mythos

#177

Post by markoloko »

eithed wrote: post #38

What I find fascinating that there is so little substance in this article about the quality of produced code and the medium. Is the code documented and tested? Is it understandable and extendable? Is it secure? What language, framework, database was used? Author mentions judgement and taste - well, is the code tasteful? Will the model rearchitecture the entire thing if I ask it to add new functionality, spending anot…

So would you be more comfortable if the user them just prompted the AI to use a specific language, framework and database. Aren't we all just going to reddit and finding out what all goes best with what? But also I don't trust nothing from it, even though I've seen it.

Re: What it feels like to work with Mythos

#178

Post by ImaCake »

theturtletalks wrote: post #29

This is what he built: https://isochronic-passage-chart.netlify.app/ Doesn’t work too well on mobile but looks interesting

It's fun and it looks good regardless of whether its 100% correct (It would certainly take me more than 9 hours of work to do better than this). Making these bespoke tools possible for most people is a big deal.
Post reply on HN