Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Claude Fable 5

anthropic.com

Post reply on HN
Print view View original

931–940 of 1001 posts

Re: Claude Fable 5

#931

Post by mywittyname »

busch_j wrote: post #876
caleblloyd wrote: post #762

I recently switched off Max flat rate to Enterprise API pricing and I went from 200/mo to 10k/mo with the same usage pattern on Opus. They don’t offer flat rate to enterprises. So Fable would cost me 20k/mo at Enterprise rates. That’s around the average cost of a loaded SWE in the USA. “But I’m >2x more productive” doesn’t justify doubling the opex of the Software/IT department for most companies when revenue isn’t e…

I work at a smaller tech company ( Our top user is at 10k a month, but the next highest is $2,000. I would say the average is around $1,000-$1,500 for a developer. We have completely unrestricted access to Claude, Codex, and Cursor. Funny enough, the guy spending 10k is not even a dev by trade but an SME in what we work on that just vibe codes apps and somehow has not been cut off yet lol. I have a single thread of G…

> Funny enough, the guy spending 10k is not even a dev by trade but an SME in what we work on that just vibe codes apps and somehow has not been cut off yet lol.

I'm guessing he's producing pretty valuable work. We have a few SMEs that vibe code tons of stuff with Claude. The only thing they really need tech for anymore is deployment and helping get their wheels unstuck on occasion.

Re: Claude Fable 5

#932

Post by sashank_1509 »

I played textual chess with Fable. It took around 15 moves before it made a large blunder. I asked it to give its reasoning per move and it mistakenly assumed a piece was protected when it wasn’t and after the blunder it realized its fault and did not suggest an illegal move. Other LLMs lost game state far earlier. But a good human chess player can keep the game state in his mind much longer, so this random eval shows a big improvement over old AI models

Re: Claude Fable 5

#933

Post by Emanation »

simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

These transcription tasks don't seem difficult for LLMs in general.

Re: Claude Fable 5

#934

Post by alleyio »

had an ancient, proprietary binary database format from the late 90s-early 2000s called 4d. opus 4.8 was great at figuring out how to extract the data, fable took it over the line with relative ease and completely reverse engineered the spec for 100% data recovery.

Re: Claude Fable 5

#935

Post by spoiler »

kansface wrote: post #715
simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

Yes, exactly this. If I didn't care about price at all, I'd exclusively use this model. It functions more like an actual engineer. I'm in the midst of a DB migration, and eg 5.5 continually suggests stuff like "use DB X instead of DB Y for task Z because its 30% faster" which is an impossibility of reality, given we are migrating DBs. Fable jumped in, reduced allocs by literally 46x, found multiple bugs 4.8 and 5.5 c…

Gosh, I must be doing something wrong. I spent 15 minutes (of which a lot was waiting while it was thinking about "backwards rationalising" it's decision and "gaslighting"[1]) arguing with it over why it keeps using `node -e "console.log(require('fs').readdirSync('…'))"` instead of `ls -l …`.

Like it did everything:

- this is not a Linux system (true, it was macOS) - it is not an available command - the binary is corrupted - node/js is more precise - V8 JavaScript is faster than bash (true technically??? But not in this context lol) - JavaScript is more versatile

I forgot what else we went through but there were a few more things. I indulged it because it was incredulous and funny. The prompts from my side were all questions, never instructions. I assume an instruction would've helped here, but also I don't think Opus ever did this (but on the other hand Opus wrote python scripts to format/indent, instead of just running cargo fmt, so I guess potato potato)

Re: Claude Fable 5

#937

Post by CookieCrisp »

sexylinux wrote: post #801
simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

It still does make errors, yes? Because it is not usable, if we need to verify everything. AI is only interesting if it can do things that humans can not do. If you can verify results because you can do it yourself, then why use AI? It will just bind highly skilled people to do verification work. Instead these people should do the actual work, results will come quicker. So AI is only interesting to you / your org / h…

There is plenty of work that does not need to be perfectly verified, because the risk is controlled. Prototyping a javascript game for example. Or code that runs just on your local machine where good enough is good enough. I'm sure a lot of you do super important work that needs 100% quality code all the time, but... some of us don't.

Re: Claude Fable 5

#938

Post by naasking »

sexylinux wrote: post #801
simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

It still does make errors, yes? Because it is not usable, if we need to verify everything. AI is only interesting if it can do things that humans can not do. If you can verify results because you can do it yourself, then why use AI? It will just bind highly skilled people to do verification work. Instead these people should do the actual work, results will come quicker. So AI is only interesting to you / your org / h…

> Because it is not usable, if we need to verify everything.

Do you verify every line of code written by your fellow developers? I doubt it, which is strange because they make errors don't they?

What matters is the error rate. Past some threshold and they're better than senior devs who you don't supervise closely.

Re: Claude Fable 5

#939

Post by dbbk »

sexylinux wrote: post #801
simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

It still does make errors, yes? Because it is not usable, if we need to verify everything. AI is only interesting if it can do things that humans can not do. If you can verify results because you can do it yourself, then why use AI? It will just bind highly skilled people to do verification work. Instead these people should do the actual work, results will come quicker. So AI is only interesting to you / your org / h…

This is what tests are for.

Re: Claude Fable 5

#940

Post by sigbottle »

simonw wrote: post #534

I've spent enough time with this now in Claude Code (and Claude.ai and Claude Code for web) to have an opinion on Fable 5: it's a beast. I'm throwing some VERY difficult problems at at - things I've been dragging my heels on for months - and it's crunching through them very happily. One that I'm willing to share (albeit from just a week ago) - I built a Python library last week that bundles MicroPython compiled to WA…

Just tried it. Fable is extremely strong. The fact that we can't point to any concrete architectural upgrade is worrying - that means "it just gets bigger" is kind of viable.

To be clear, the jump from Opus to Fable was like the jump from pre o3 -> o3 for me. Very sharp improvement, not incremental. But that could be explained by dummy long thinking times.

It one shot a task that Opus burned hundreds of dollars on to get nowhere. Very tricky semantic refactor, got it right. Granted, again, the semantics Opus and I fleshed out 3 months prior, but Opus couldn't execute on the vision. Fable could.

Then I discussed some philosophy and it was actually both pleasant (GPT constantly "corrected" you for the sake of correction without clarification, also still often just wrong; it's like it refused to think critically about philosphy) and accurate, and actually helped resolve some deep but subtle misconceptions I had around representationalism. When talking with GPT I felt like I was talking with someone who either was sycophantic or "anything that is not absolute truth is relativism" - Fable actually discussed.

Both is exciting and kind of makes me depressed. I can definitely see why people are getting hyped about AGI again. All the models were extremely strong technically but I felt like couldn't match the developer's tacit state - Fable definitely did, and that's a basic quailty to be considered "usefully intelligent" IMO, at least to me.

Shame that it's going away in 2 weeks and probably going to be nerfed if/when it's re-released.

Post reply on HN