Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open-weight AI is having its Kubernetes moment

tobi.knaup.me

Post reply on HN
Print view View original

261–270 of 346 posts

Re: Open-weight AI is having its Kubernetes moment

#261

Post by majormajor »

CamperBob2 wrote: post #258
formerly_proven wrote: post #237

Earlier quoted context omitted.

That was the literal reason given back then and it did not stick. https://en.wikipedia.org/wiki/Crypto_Wars https://en.wikipedia.org/wiki/Bernstein_v._United_States

That was also a very different SCOTUS bench.

Looks like Bernstein wasn't even a Supreme Court bench, the government loosened regs rather than appealing.

Whether or not a Trump admin would do the same is wildly difficult to predict. On one hand, Republican security hawks influence. On a similar hand, big US business interests. On the other hand, OTHER big US business interest. On yet another hand, some not-exactly-particularly-favored companies like Anthropic pushing for it.

If it made it to the Supreme Court it's not hard to see Gorsuch and Robert or another going for the "free speech" vs "security" reading here along with the 3 appointees of Democratic presidents, especially with no single clear US business interest or precedent there.

Re: Open-weight AI is having its Kubernetes moment

#262

Post by accountrequired »

CamperBob2 wrote: post #258
formerly_proven wrote: post #237

Earlier quoted context omitted.

That was the literal reason given back then and it did not stick. https://en.wikipedia.org/wiki/Crypto_Wars https://en.wikipedia.org/wiki/Bernstein_v._United_States

That was also a very different SCOTUS bench.

I'm in this timeline where SCOTUS did not rule on Bernstein

Re: Open-weight AI is having its Kubernetes moment

#263

Post by DennisP »

andsoitis wrote: post #257
DennisP wrote: post #220

Earlier quoted context omitted.

Of course advertising increases their profit. It does that by increasing their revenue even more than the cost of the advertising. For the rest of us, that giant increase in revenue is an increase in our healthcare costs.

Ah so sounds like your logic is: ban advertising -> less costs -> less revenue & lower patient costs -> same profit. I think I can spot a flaw in that logic.

That last step contradicts my previous comment.

Re: Open-weight AI is having its Kubernetes moment

#264

Post by CamperBob2 »

accountrequired wrote: post #262
CamperBob2 wrote: post #258

Earlier quoted context omitted.

That was also a very different SCOTUS bench.

I'm in this timeline where SCOTUS did not rule on Bernstein

Was it before or after the Federalist Society and other political actors successfully placed a lot of unqualified judges on the lower courts?

Re: Open-weight AI is having its Kubernetes moment

#265

Post by 2OEH8eoCRo0 »

ozgung wrote: post #126

Everyone is talking about banning Chinese models but nobody talks how it is feasible to ban them. I think it’s impossible simply because technically there is no such thing as a “Chinese model”. There is no way to tell apart an “American” model from a “Chinese” one by looking at their weights. Weights are just numbers and you can’t assign country of origin to numbers. One can find very easy workarounds to any naive at…

A Chinese model doesn't think that anything of note happened on June 4th.

Re: Open-weight AI is having its Kubernetes moment

#266

Post by nedt »

> Kubernetes did not win simply because its repository was public.

And here I am still using docker with compose because it's easier and works. Always saying I might be looking at swarm when needed, but then never really need it.

Just because you are using it doesn't mean everyone is and doesn't mean it has won. On the other hand yeah I want open models and I want them local as well.

Re: Open-weight AI is having its Kubernetes moment

#267

Post by kuschku »

AnduCrandu wrote: post #245
theshrike79 wrote: post #221

Earlier quoted context omitted.

...have you seen the current administration being grilled by congress members? They are actually properly unable to say "Biden won the 2020 election" because that's against Dear Leader's views. They will say anything similar like "was confirmed as...", but those exact words will NEVER come out of their mouth.

Yes, but do you have any indication that this applies to American LLMs?

Every time Grok gives the "wrong" answer, Elon Musk does another lobotomy on it.

So it certainly seems like at least some models are being censored.

Re: Open-weight AI is having its Kubernetes moment

#268

Post by shard972 »

nedt wrote: post #266

> Kubernetes did not win simply because its repository was public. And here I am still using docker with compose because it's easier and works. Always saying I might be looking at swarm when needed, but then never really need it. Just because you are using it doesn't mean everyone is and doesn't mean it has won. On the other hand yeah I want open models and I want them local as well.

[dead]

Re: Open-weight AI is having its Kubernetes moment

#269

Post by downrightmike »

mft_ wrote: post #174
hedora wrote: post #135

Earlier quoted context omitted.

Pre bubble prices (~= “we stop building data centers with subsidized credit / circular loans / hidden debt”), a 128GB halo strix ran for $1400, and 200-ish watts. Four of those in a cluster will run a 1T parameter frontier model: https://www.amd.com/en/developer/resources/technical-article... At 7 months of claude code subscription per node, the cluster pays for itself in 28 months. On a 5 year (60 month) depreciatio…

I’m happy to be proven wrong, but the limited examples I’ve seen of clustered Strix Halos are quite slow running large models (ie models too large to fit into the ram of a single machine) due to the slow networking between each one?

That is already being addressed with GPUs and special PCIe daughter cards that link them together faster than the PCIe on the MOBO could. SLI but better.
Post reply on HN