Viewing profile — greyskull

> mainstream What does "mainstream" refer to when we're talking about software development and LLMs? As opposed to "engineers".

It's been a great multiplier for me in similar ways. The "dreamiest" thing has been that it has freed up time that I would normally have spent doing sprint work, to work on things …

This really resonates with me, and I'm only a decade and change into my career. I use claude a lot day to day. I try to use it sensibly, making me more productive and produce bette…

Interesting. I'd have guessed there would be meaningful opex benefits to serving smaller models.

> task focused small models This is tangential: and forgive my ignorance here, but is there an inherent reason why there aren't smaller, focused models from the frontier model prov…

Thanks, I'll have to continue experimenting. I just ran this model Qwen3.6-35B-A3B-GGUF:UD-Q4_K_XL and it works, but if gemini is to be believed this is saturating too much VRAM to…

Thank you for all this, I'll give it a shot. Out of curiosity, are there any resources that sort of spell this out already? i.e., not requiring a comment like this to navigate. > n…

It's certainly part of the problem. Thanks, I'll give that a shot.

Thanks! These things you're mentioning like "You may be able to offload some layers to GPU...", "You can keep the KV cache on GPU..." configured as part of the llama.cpp? I wouldn'…

I've been using Claude Code regularly at work for several months, and I successfully used it for a small personal project (a website) not long ago. Last weekend, I explored self-ho…

Missing "OpenAI sidesteps" from the beginning of the title article title

I agree.

Didn't get far enough along to understand the motivations and considered alternatives.

Didn't get far enough along to understand the motivations and considered alternatives.

OpenNext does model [0] incremental static regeneration, but beyond that I actually don't know, or at least don't recall. OpenNext doesn't do per-route lambdas like vercel does, so…

1) I don't think it's related to Next, per se, but there may be behavior I didn't build the expertise to comment on. I also know that there were major inefficiencies in the applica…

It offers packaging for deploying to a serverless environment (e.g. Lambda) analogous to how Vercel does it. The last question is salient, and it's possible for OpenNext to break a…

OpenNext is just for packaging the Next.js build artifacts. The infrastructure is defined by projects that deploy those artifacts, examples here: https://opennext.js.org/aws/get_st…

The biggest cost for us on Vercel (several hundred dollars a month) was Image Optimization, and that was because the app was being majorly inefficient with images, in part due to s…

In the company I just left, I actually went through the process two or so months ago of migrating their Vercel deployment to AWS. I evaluated several options that are listed on the…

Congratulations! I see that the book is incomplete. I didn't know that early access for books was a thing, very neat. It might be pertinent to note in your post that it's still bei…

Might be pertinent to suffix this with (2023), though I see there are still recent replies

It's opening in Q2. Source: I'm one of the subjects of the article :^)

Off-topic, but what's with the strange font in the image at the top of the article? I see it's based off of the "csa" logo. I can't explain why but it's almost uncomfortable to rea…