Viewing profile — winternewt

Capacity for inference isn't a cost issue, it's an availability issue. There just isn't enough hardware out there.

From the article: > What is happening here is that leading AI labs are charging not only for inference but also for research in model architecture, training data collection and cur…

> Adding an in-product tip to recommend running /clear when re-visiting old conversations (we shipped a few iterations of this) I feel like I'm missing something here. Why would I …

Instead of just dropping all the context, the system could also run a compaction (summarizing the entire convo) before dropping it. Better to continue with a summary than to lose e…

What version of Claude Code is this? I don't have the /cost command mentioned here.

Unless the bubble bursts and tons of failing AI companies dump used graphics cards on the market.

And if you don't want to buy a Mac? A 80 GB NVidia GPU costs $10,000K (equivalent to 30 years of ChatGPT Plus subscription) and will probably be obsolete in 5-7 years anyway. What …

No need to speculate. The article was published in 2019 and the movie is now six years old.

When I was a kid reading Marvel comics, Spiderman seemed like a bad and relatively uninteresting super hero. His problems were trivial personal issues and he rarely left NYC, fight…

The use case I always envisioned from the sidelines was that I could ditch a poorly designed, garbage-collected mess of a language (JavaScript) for something typesafe, with predict…

You are allowed to throw from a destructor as long as there's not already an active exception unwinding the stack. In my experience this is a total non-issue for any real-world sce…

Destructors are vastly superior to the finally keyword because they only require us to remember a single time to release resources (in the destructor) as opposed to every finally c…

That's not a feature that the developer has control over. All they can do is try to develop a good tool.

The worst part about MS Office isn't the direct user experience, because I can usually choose to use other software. The worst part is that I and everybody else are subjected to th…

What are you implying by linking to that article?

You're not explaining why the trifecta doesn't solve the problem. What attack vector remains?

I see where you're coming from. But I often find that when I have some idea or challenge that I want to solve, I get bogged down in details (like how do I build that project)... be…

You misunderstand my point. I'm not saying that the purpose of Hermès is to sell bags. I'm saying that the _product_ that Hermès sells is status, and the product of a restaurant is…

Maybe not slower once it has warmed up, though for memory-bandwidth bound use cases I would still say the lack of mutable records has you fighting the language to get reasonable ca…

The article got off on the wrong foot from the start by separating the purpose from the product. To my mind the purpose is the product and always will be.

It's actionable if you have some imagination. Raise funds for a nonprofit. Start lobbying on both sides of the aisle. Enlist an advertising company to show the dystopian future if …

Promote a better constitution that protects people from laws like this?

I think we already ticked that box

Humans and LLMs are deterministic in the sense that if you would rewind the universe, everything would happen the same way again. But both humans and LLMs have hidden variables tha…

I thought it was "there's no position in chess that requires more than 218 moves to reach."