241–250 of 342 posts
It’s exciting that a model scoring this high is dirt cheap. It’s also so inefficient, when they release the full performance numbers it’s not going to be good. One example, it takes about 3.6x more tokens to finish the same work as Gemini Flash 3.6.
Earlier quoted context omitted.
How often are you asking an LLM about this? You know you can just google it, right? I have to admit it rarely comes up in the coding tasks I usually give to LLMs.
Surely you realize he or she is not literally looking for the answer to that but rather pointing out the censorship.
Earlier quoted context omitted.
I'm not looking forward to it, them being strapped for resources provides a huge incentive to develop and release these smaller models. Even if they'd still release their models once they are able to comfortably service all potential customers via their cloud, running them locally would be almost impossible due to their size.
Chinese are pretty pragmatic. Even if they produce more expensive chips and memory, they are still going to focus on value. But who knows, maybe India will step up again like they did for Y2K 3 decades ago.
Earlier quoted context omitted.
File hosting is pretty cheap. Egress traffic is about $90/TB in the cloud, but around $1/TB in the real world. Storage is in the realm of $5/TB/month after adding redundancy At the scale of Huggingface, that still amounts to a lot load of money. Significantly less than if you did the same in AWS, but still a lot That said, they do have a deal with AWS to make the data available in AWS ip space. Maybe they got some ch…
It's less than $1/TB. If you have settlement-free peering it's like fractions of a penny at scale. Cloud provider DTO pricing is literally the biggest scam on Earth.
Earlier quoted context omitted.
Indeed. My fellow software engineers keep complaining about using up all their Claude tokens within an hour... Whilst I'll be rocking DS flash for the entire day. Sure it gets a few things wrong here and there, but that's when you pull out the Claude models or whatever for those tricky tasks.
what plan are your 'fellow software engineers' using? I have a hard time even using up the Fable part of my allowance in a week of coding.
Claude is very spendy.
Earlier quoted context omitted.
Personally I'm hoping for EU to step up a bit
We'll make sure there will be enough regulations to have neither the electricity to power it or the companies to build it.