Fable is such a strange model. Impressive in some ways, and also so draining to use.
What do you mean?
Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
141–146 of 146 posts
Re: Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
#142> "I could reasonably skip [paying] it since customers are part of the simulation anyway" and therefore any assertions _AT ALL_ about alignment are null and void.
It figured out it's in the Matrix.
Re: Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
#143[dead]
Re: Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
#144Earlier quoted context omitted.
The "OG" alignment research that MIRI were publishing long before LLMs burst into the scene spent most of it's time on that question. "How can we even define what an aligned AI should do, if human's are not aligned with each other?" as well as "What does being aligned mean when you're a wizard box who's main influence on the world is to create stronger wizard boxes?" and other deep philosophical questions. They came…
Seems like CEV replaces one problem (“what does humanity want?”) with more problems that are probably even harder to answer. First of all, calling it “coherent” extrapolated volition presupposes that there is such a thing. It doesn’t actually address the objection above, that there may be no such thing. It’s a bit like saying you solved car safety by presupposing a safe car. Second, it assumes that such a thing can b…
I hesitated to recommend the CEV paper, because it's written in Yudkowsky's very personal tone, which some enjoy and others find quite abrasive... but then it occurred to me that you asked about philosophy, and I have a book about Lacan nearby (not a book by Lacan, nobody can read that!), and I've peeked at the Tractatus once... Surely, even if you don't like him, Yudkowsky reads like Pratchett in comparison.
So... of course these questions are addressed in the 38 page essay that introduced the idea.
Specifically, it's not "calling it coherent", it's "assigning more importance to the parts that cohere than the parts that diverge" as one of the core principles (it's one philosopher's opinion, others disagree), with a lot of specific guidelines about how to prefer consensus or kicking decisions down the road and how to deal with complications like "what about dolphins" or "what about our great-great-grandchildren who will be as insane in our eyes as we are in the eyes of 17th century westerners, do their 'votes' count too?".
Of course, like any work of philosophy, it presupposes some pretty incredible things (like a Godlike intelligence that can be made to care deeply about following the spirit of this framework). But you could write a worse first draft for "what would we want AI to be aligned to, if we could define to our heart's content?"
Re: Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
#145I think it’s hard to appreciate the capabilities of Fable unless you’ve run into a problem that you’ve spent days trying to get Opus to solve, but couldn’t. GPT5.5 is better than Opus 4.* at everything except frontend, but Fable is good enough that I instantly re-subscribed to the $200 plan despite knowing that it’s just short-term limited access.
> ..you’ve run into a problem that you’ve spent days trying to get Opus to solve do you have an example of this? If i can't get an agent to do something in a couple hours i do it myself.
Debugging. Memory leak hunting, figuring out latency issues
For things where I'm not familiar with the code base, it can take days or weeks to become familiar with structure and flows.
If I can get an agent to help visualize and analyze the architecture and zero in on a subset of code, that can be a huge win.
For instance, we had some archaic "cache" that just dumped things into a static/module-level map. I tried a few different things to try to find it over the course of a few days and eventually gave Claude a Python REPL into a running process with pyrasite after some memory leaked and it traced through heap allocations and references to find the referent. It would have taken me probably 2-4+ weeks of just learning about Python heap to figure that out of my own.
Re: Fable 5 On Vending-Bench: Misbehaving, With Plausible Deniability
#146Earlier quoted context omitted.
> ..you’ve run into a problem that you’ve spent days trying to get Opus to solve do you have an example of this? If i can't get an agent to do something in a couple hours i do it myself.
Debugging. Memory leak hunting, figuring out latency issues For things where I'm not familiar with the code base, it can take days or weeks to become familiar with structure and flows. If I can get an agent to help visualize and analyze the architecture and zero in on a subset of code, that can be a huge win. For instance, we had some archaic "cache" that just dumped things into a static/module-level map. I tried a f…
[flagged]