Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Corporate America is getting hooked on open-source AI

nytimes.com

Post reply on HN
Print view View original

151–160 of 302 posts

Re: Corporate America is getting hooked on open-source AI

#151

Post by epistasis »

majorchord wrote: post #38
syntaxing wrote: post #22

I swear, Qwen 3.8 27B @ Q8 is smarter than Sonnet 5 most of the time. Why wouldn’t corporate America self host at this point, especially with better options like Deepseek Flash and GLM 5.3 flash that’s a middle ground between Sonnet and Opus

Agreed. And conversely, American models can also just as easily be secretly influenced for bad things, or be more tightly controlled by the government, to corporate America's own detriment.

Post-IPO I'd trust the American models far far less than the Chinese models.

The most insidious advertising in the world is about to be surfaced as people use LLMs to look for product recommendations.

Re: Corporate America is getting hooked on open-source AI

#152

Post by WarmWash »

throwitaway222 wrote: post #60
cmiles8 wrote: post #26

Every larger company I talk to these days has an active project on moving away from OpenAI and Anthropic to open models. And they’re actively shifting, as the article says, so the threat is far from theoretical. Unless they both dramatically slash prices then they’re in big trouble. Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any ho…

If companies are really doing this, then we're saying they have no problems spending tens of millions to get somewhat decent TPS and then having their employees complain they are timesliced and getting lots of timeouts because their org has 500 employees?

At least accord to the MIT study last year, most employees are using their own AI subscriptions to do work.

Keep in mind that a vanishingly small number of workers are SWE's churning millions of tokens daily.

Re: Corporate America is getting hooked on open-source AI

#153

Post by hparadiz »

_doctor_love wrote: post #17

Easy prediction: LLMs will get shrunk down further and further until GenAI is just something that ships on a chip as part of your hardware. In the future it will seem quaint that we needed a network connection to talk to our LLM. Adoption of open-source models to my mind is a similar step in that direction. In all cases, the goal is to become untethered from a mercurial vendor.

We're gonna start baking in models like TTS with thousands of voices available in any language as a chip on device. They just need to hit 99% accuracy and then it's a done deal.

Re: Corporate America is getting hooked on open-source AI

#154

Post by phoghed »

pianopatrick wrote: post #118
cmiles8 wrote: post #26

Every larger company I talk to these days has an active project on moving away from OpenAI and Anthropic to open models. And they’re actively shifting, as the article says, so the threat is far from theoretical. Unless they both dramatically slash prices then they’re in big trouble. Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any ho…

Maybe open AI and Anthropic could just license their models to run on your own hardware. So a fixed cost instead of per token pricing or subscription with limits

Fixed costs are already available via PTU reservation and afaik most serious enterprise projects are using this

Re: Corporate America is getting hooked on open-source AI

#155

Post by piva00 »

cmiles8 wrote: post #26

Every larger company I talk to these days has an active project on moving away from OpenAI and Anthropic to open models. And they’re actively shifting, as the article says, so the threat is far from theoretical. Unless they both dramatically slash prices then they’re in big trouble. Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any ho…

Same experience, all my other friends in the industry report the same; at work we went from a huge push for ChatGPT last year to switching to Claude, back to ChatGPT when it became cheaper than Claude, and in parallel a deployment of open models being trialed with mechanisms to route to other models when needed (and based on pricing).

Over time I can imagine us becoming mostly open models on our deployments when hardware is more accessible and the need for expensive frontier models is constrained to very few use-cases that might demand their capabilities.

Re: Corporate America is getting hooked on open-source AI

#156

Post by hparadiz »

wnmurphy wrote: post #49
_doctor_love wrote: post #17

Easy prediction: LLMs will get shrunk down further and further until GenAI is just something that ships on a chip as part of your hardware. In the future it will seem quaint that we needed a network connection to talk to our LLM. Adoption of open-source models to my mind is a similar step in that direction. In all cases, the goal is to become untethered from a mercurial vendor.

Yeah, I'm looking forward to this actually. https://chatjimmy.ai/ blew my mind at how fast etched model weights can be. For on-device LLMs, there's a point of diminishing returns, meaning you don't need to have the latest frontier model for most operations.

I currently have a small TTS model running in the background on my machine through which my agent(s) speak to me as they work. If that can be baked into an ASIC along with a few thousand voices in every major language then it should just be a utility chip on your mobo for anything that needs it. And yes, I too, am looking forward to it.

Re: Corporate America is getting hooked on open-source AI

#158

Post by apefulsin »

pianopatrick wrote: post #118
cmiles8 wrote: post #26

Every larger company I talk to these days has an active project on moving away from OpenAI and Anthropic to open models. And they’re actively shifting, as the article says, so the threat is far from theoretical. Unless they both dramatically slash prices then they’re in big trouble. Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any ho…

Maybe open AI and Anthropic could just license their models to run on your own hardware. So a fixed cost instead of per token pricing or subscription with limits

This would require them to give you a copy of their models, which would quickly be leaked on the internet, and they know that, so it won't happen.

Re: Corporate America is getting hooked on open-source AI

#159

Post by WarmWash »

epistasis wrote: post #151
majorchord wrote: post #38

Earlier quoted context omitted.

Agreed. And conversely, American models can also just as easily be secretly influenced for bad things, or be more tightly controlled by the government, to corporate America's own detriment.

Post-IPO I'd trust the American models far far less than the Chinese models. The most insidious advertising in the world is about to be surfaced as people use LLMs to look for product recommendations.

It's wild that people are so lost in the sauce of social media that they have no qualms handing over all their data to an authoritarian ethno state with a single ruler who appointed themselves for life with unrestricted unilateral control over every aspect of the state. And here we are calling for collapse because mom might get recommended Gain instead of Tide.

Re: Corporate America is getting hooked on open-source AI

#160

Post by phoghed »

fatcatsbestcats wrote: post #62
simianwords wrote: post #50

Earlier quoted context omitted.

I know what happens in many big companies and not a single one is moving away from Anthropic/OpenAI/SpaceXAI. > Unless they both dramatically slash prices then they’re in big trouble False, they have already done so many times. > Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any hope at a successful IPO. False, margins are higher and…

I don’t know what your sources are, but I work on AI at a Fortune 100 and open models now make up >90% of our internal token spend. Used to be 100% closed before this summer.

Same, but not a whiff of open source/chinese models for anything other than someone fucking around with local LLM demos.

Not a tech company though, so maybe that differs and we’re just behind what’s en vogue. However we did get in on everything pretty early, building our ChatGPT RAG clone right about when azure got gpt-3.5-turbo on api

Post reply on HN