If Claude Fable stops helping you, you'll never know

Post by whiplash451 » Wed, Jun 10, 2026, 11:56 AM UTC

SwellJoe wrote: post #77

The moat looks deep today but it's going to become more shallow every year. Training a new model from scratch takes serious resources. Post-training/fine-tuning an existing model, dramatically less. The knowledge for the process was esoteric two years ago, now you can ask a current model (one of several) to walk you through it, while building the tools to do it as you go. Several of my recent weekend projects have be…

Post by christkv » Wed, Jun 10, 2026, 12:12 PM UTC

theLiminator wrote: post #151

SwellJoe wrote: post #116

Earlier quoted context omitted.

I think we agree? What moat? You answered yourself: "capital intensive" But, history says the supercomputer of today will fit in your pocket in a few years. They've bought up all the RAM and GPUs, which pushes the capital requirements upward for everyone else. But, they can't corner the market forever, there are too many competing interests. AMD and Intel keep making new GPUs and APUs. The memory makers can't just se…

> But, history says the supercomputer of today will fit in your pocket in a few years. I don't think this will be true in the same time span anymore. Each miniaturization is costing more and more money. Perhaps they'll come up with exotic fundamental improvements, but I don't think the rate of improvement of compute/watt will match the previous decades.

Post by thinkingtoilet » Wed, Jun 10, 2026, 12:13 PM UTC

gopher_space wrote: post #137

thinkingtoilet wrote: post #86

Earlier quoted context omitted.

Because this effectively hinders 0% of people. I understand why people don't like it but day to day this is nothing. If you're using it for coding, it won't stop you. The pearl clenching here and over reacting is predictable and sad. If you are working for a large organization and you were going through the vendor procurement process, questions like Can this produce pornography? Can this tell my employees how to brea…

This is software development, not sales. We rely on our tooling. If I’m using a calculator to verify my math, I don’t want to use a second calculator to verify the first one.

Post by shaky-carrousel » Wed, Jun 10, 2026, 12:15 PM UTC

whiplash451 wrote: post #441

SwellJoe wrote: post #77

The moat looks deep today but it's going to become more shallow every year. Training a new model from scratch takes serious resources. Post-training/fine-tuning an existing model, dramatically less. The knowledge for the process was esoteric two years ago, now you can ask a current model (one of several) to walk you through it, while building the tools to do it as you go. Several of my recent weekend projects have be…

> The moat looks deep today but it's going to become more shallow every year. Unless the frontier labs start nerfing their models, which is exactly what seems to be happening. The counter-point to your argument is a future where less and less un-nerfed open-source frontier models exist. Sure, China/Meta might keep commoditizing their complement by releasing un-nerfed models, but these come with their own limitations…

Post by mystraline » Wed, Jun 10, 2026, 12:17 PM UTC

skeledrew wrote: post #308

mystraline wrote: post #44

I have never ever trusted "corporate ethics". Theres no ethical framework. No axioms. Its a mixture of legal, political, and public-facing 'rules'. And what are the rules? Youre not permitted to know. "We reserve the right to lie about the models we provide, silently downgrade you, and give you blatant misinformation cause you triggered our unstated rules... BUT we'll still use your token budget with lots of thinking…

Running a decent-ish LLM is going to take 64GB+ RAM. Most users only have/can afford 8 or maybe 16GB RAM. Local LLMs for doing anything significant is impractical for the many.