91–100 of 346 posts
Earlier quoted context omitted.
Why do prescription medications cost so much, and generics so little (comparatively)? Artificial inflation to recoup R&D.
Not sure pricing to recoup costs is artificial.
Earlier quoted context omitted.
How are weights stolen from the frontier model developers? What is that actual mechanism?
The weights themselves aren't stolen. The claim is that Chinese companies are using VPNs and proxies to buy massive amounts of Claude Pro and Codex subscription accounts, and then selling usage on those subscriptions as cheap white-label LLM API usage. While selling that LLM API usage, they then capture all the prompts, outputs, and intermediate thinking the LLM does, and then sell those logs to the companies making…
Is anyone using open weight models for agentic coding? What is your stack (harness, model) and how much do you pay per month? How would you compare your experience to a typical subsidized plan like Claude Code + Pro plan? I’m asking because i keep hearing that open weight models are cheap and efficient - is that really the case in practice?
I don’t know if others would find this useful, but previous did have custom harnesses etc.. but tools have improved so much that I drastically simplified. That said, even the foundational models fail at the hard parts of my code so I use it opportunistically. I have reduced down to just using zed, will three locally hosted models. Qwen 3.6 27b on 1x3090 llama.cpp with 128k context ~50tps Qwen 3.6 35B-A3B on 1x titan…
Earlier quoted context omitted.
I still don't know what it is tbh. Something for docker?
I was in this state a few weeks ago. I spent a bit of time familiarizing myself then wrote up my learnings as a series of exercises. If you think of docker as "kinda like vms except not really" and k8s as "kinda like deploying and composing docker containers but not really", this may be for you: https://ojensen.net/infra/understanding-k8s-1 It's actually really neat, i wish i had bothered to learn it years ago.
From my very ignorant standpoint, K8s seems to be about running a "cluster", but I don't know why I would want to do that.
Is anyone using open weight models for agentic coding? What is your stack (harness, model) and how much do you pay per month? How would you compare your experience to a typical subsidized plan like Claude Code + Pro plan? I’m asking because i keep hearing that open weight models are cheap and efficient - is that really the case in practice?
Earlier quoted context omitted.
Because as per usual it's silicon valley misunderstanding economics. AI is HPC. And how the HPC market worked before: If you're the best performing "computing cluster" (ie. whatever you call the entity that can complete a massive calculation), you get a blank check from Congress. Why? Because you need those calculations to "pump" nuclear weapons. They are needed to calculate both the geometry to make fusion bombs pos…
> Because you need those calculations to "pump" nuclear weapons. They are needed to calculate both the geometry to make fusion bombs possible at all and to calculate the effect of a given geometry. They are the reason US/Russia/China have the biggest and strongest weapons known to humanity. We have a couple new nuclear weapon designs, but not really going for bigger or stronger. Just packaging. We built the big power…
The military has already mastered fusion (power), and likely has mastered gravity in some form in secret. They aren’t using mainstream compute for these discoveries
Earlier quoted context omitted.
Not sure pricing to recoup costs is artificial.
The government backed monopoly to ensure that supply remains artificially restricted to ensure that the market will support the higher prices is