Earlier quoted context omitted.
I don't know if you guys do write ups, but cloudflare's write ups on outages is in my eyes the gold standard the entire industry should follow.
Cloudflare deploys stuff on Fridays, and it directly affected shopify, one of their major ecommerce customers. Until they fix their internal processes all writeups should be seen as purely marketing material.
Elevated errors across many models
161–170 of 170 posts
Re: Elevated errors across many models
#162503 is cool and yes, there is the "well if it's down how are they going to put that up" but in reality most downtimes you see are on the backend and not on the reverse proxies/gateways/cdns where it would be pretty trivial to add a issues/status header with a link to the service status page and a note.
Re: Elevated errors across many models
#163Re: Elevated errors across many models
#164There really should be an http header dedicated to "outage status" with a link to the service outage details page... clients (for example, in this case, your code IDE) could intercept this and notify users. 503 is cool and yes, there is the "well if it's down how are they going to put that up" but in reality most downtimes you see are on the backend and not on the reverse proxies/gateways/cdns where it would be prett…
Re: Elevated errors across many models
#165Earlier quoted context omitted.
I use it as much as my brain can handle and I never exceed my Max plan quota.
Just a warning for those not on the max plan; if you pay by the token or have the lower tier plans you can easily blow through $100s or cap your plan in under an hour. The rates for paying by the token are insane and the scaling from pro to max is also pretty crazy. They made pro have many times more value than paying per token and then they made max again have 25x more tokens than pro on the $200 plan. It’s a bit li…
For comparison’s sake, this is clear: https://support.cerebras.net/articles/9996007307-cerebras-co...
And while the Cerebras service is pretty okay, their website otherwise kinda sucks - and yet you can find clear info!
Re: Elevated errors across many models
#166Earlier quoted context omitted.
My poorly informed hope is that that we can have mixture of experts with highly tuned models on areas of focus. If I'm coding in language Foo, I only care about a model that understands Foo and its ecosystem. I imagine that should be self-hostable now.
my suspicion is that this is not how intelligence works. creativity comes from cross breeding ideas from many domains.
For coding, creativity is not necessarily a good thing. There are well established patterns, algorithms, and applications could reasonably be construed as "good enough" to assist with the coding itself. Adding a human language model over that to understand the user's intents could be considered an overlay on the coding model.
I confess that this is willful projection of my hope to be able to self-host agents on affordable hardware. A frontier model on powerful hardware would always be preferable but sometimes "good enough" is just that.
Re: Elevated errors across many models
#167Earlier quoted context omitted.
my suspicion is that this is not how intelligence works. creativity comes from cross breeding ideas from many domains.
Sure, but in the context I was considering, creativity itself wasn't a concern. For coding, creativity is not necessarily a good thing. There are well established patterns, algorithms, and applications could reasonably be construed as "good enough" to assist with the coding itself. Adding a human language model over that to understand the user's intents could be considered an overlay on the coding model. I confess th…
Re: Elevated errors across many models
#168Earlier quoted context omitted.
I think it's possible, but the current trend is that by the time you can run x level at home, they have 10-100x in the frontier models, so if you can run today's Claude.ai at home, then software engineering as a career is already over.
You can run quite powerful models at home on a maxed out Mac Studio. The difference between those and SoTA is more like 2x.
Re: Elevated errors across many models
#169Earlier quoted context omitted.
You can run quite powerful models at home on a maxed out Mac Studio. The difference between those and SoTA is more like 2x.
just had a quick look, but at this price, I could have Claude pro for 62 years...
I wouldn't pay for it for myself but I can see employers considering it.
Re: Elevated errors across many models
#170Earlier quoted context omitted.
Claude code cut me off a few days ago and I _seriously_ had no idea what to do. I’ve been coding for 33 years and I suddenly felt like anything I did manually would be an order of magnitude slower than it had to be.
you can’t say things like this on HN these days :)