Been wishing my company was doing this. We are locked in with chatgpt for chat and claude for coding. I have a 36gb m4 max laptop but I'm not allowed to run anything on it even though it would be totally free. Absolute pain.
Corporate America is getting hooked on open-source AI
241–250 of 303 posts
Re: Corporate America is getting hooked on open-source AI
#242I'm not seeing it. Corporate America needs someone they can sue if anything goes sideways with AI given the rate of change and legal ambiguities. It took years/decades for actual, real, open source to be widely adopted in corporations for the same reasons.
The main indemnity that providers like GitHub Copilot provide is against being sued by the copyright holders whoes works were "transformed" to make the models. They generally don't offer that for the Chinese models, at least in my region. I can't see any reason other than back-room deals making it so: they're all using stolen works, and all could spit out memorized fragments. But if you're talking specifically about the fitness or otherwise of the actual software these models produce, that is generally handled with the use of sacrificial employees.
Re: Corporate America is getting hooked on open-source AI
#243This is not a viable strategy. You're effectively paying for hardware and/or cloud. Why do this when OpenAI and Anthropic are both significantly subsidizing costs to win the market? Talk to “AI” executives at large firms and 95% of them are clueless sales types that crawled their way to the top. Then again, it is basically a repeat of IBM, Microsoft, Oracle, etc. Same dumb executives making decision to not get fired…
The "AI" executives at large firms are mostly product folks with engineering backgrounds, not sales, which should make us even more worried.
Re: Corporate America is getting hooked on open-source AI
#244Every larger company I talk to these days has an active project on moving away from OpenAI and Anthropic to open models. And they’re actively shifting, as the article says, so the threat is far from theoretical. Unless they both dramatically slash prices then they’re in big trouble. Neither of them can afford to do that and both desperately need to convince the street that the opposite will happen if they want any ho…
They have good friends in the big ballroom to not allow you to use something cheaper and be locked in on them for your own safety
As a taxpayer, the only silver lining here is that we won't be paying for the ballroom... /s
Re: Corporate America is getting hooked on open-source AI
#245Earlier quoted context omitted.
> However the cold reality for both is that there is zero moat to a model anymore. The moat right now is a) the hardware, b) the electricity, c) the intelligence, and d) scalability. On hardware, it's very expensive to purchase anything which can provide a fraction of the performance of a subscription. Traditional accounting depreciation would imply that purchasing local hardware is a terrible financial decision. On…
Privacy is non-negotiable for corporate. Even without considering costs or country of origin, we've seen from OpenAI that claims of AI safety are worth less than the (virtual) paper they're printed on. All it takes is one incident, and all your company's internal data will start showing up in public users' chats. You can rely on a contract to prevent this, or you can guarantee it by using a locally hosted model you f…
> Privacy is non-negotiable for corporate.
Corporate doesn't care at all about privacy. It's why the run outlook and windows and let Microsoft scoop up all of their company secrets. It's why they hand every scrap of data they have on their customers to salesforce and surrender their data to Atlassian and use Confluence and JIRA over countless alternatives.
All companies care about is that when data breaches happen publicly they can point the finger at someone else.
Re: Corporate America is getting hooked on open-source AI
#246Spent most of today reworking a rack and rig of gpus for all of our internal ai work… our big server is 8 rtx 6000 pro and 3 psu, I definitely feel I made a mistake not upgrading our wall power to 240v but so far we have multiple 30amp 120v and with 3 PSU uninterrupted power we have been very stable. My big upgrade will be moving to epyc motherboard from threadripper so we get gen5x8 with bifurcation instead of what we are stuck with today gen5x4 due to bios limitations . What has been so encouraging though is first deepseek v4 flash at 200+ t/s for single user and much more in aggregate- now on qwen 3.8 flash next for image support and eyes on glm5.3 flash for some testing … next is realistically considering co location and quiet a sizable loan to scale this to real hardware instead of miner rip vibes
Re: Corporate America is getting hooked on open-source AI
#247Earlier quoted context omitted.
Ah, yes, I'm sure the article that moral paragon DHH wished to translate was not at all harmful, and that this was a good-faith effort on his part /s While I agree that Claude can be overly paternalistic at times, how should it respond to a request to translate, say, bomb-making instructions? It's reasonable to me that it might refuse this.
How do you know what was in the article? Also, you see zero distinction between hearing opinions on political topics you might find objectionable, and building a bomb to kill people?
Because he posted about it.
It was an incredibly racist post claiming “gypsies” are like invading wolves and that something more drastic must be done to get rid of them before they kill all the “sheep” in Copenhagen.
Re: Corporate America is getting hooked on open-source AI
#248I definitely see a future race of who can accelerate open models and their usage locally with realistic desktop hardware.
I fully await my ai in a usb box. The models are plateauing and some clever company is secretly working on this already I’m sure of it.
Imagine baking in a model weight set in ROM with an analog computer doing what otherwise takes way too much power in digital form.
Re: Corporate America is getting hooked on open-source AI
#249Earlier quoted context omitted.
Is this not true for everything then? All cloud services, all Internet providers, everything within M365, OneDrive and Databricks?
I have never heard of a cloud service of ISP actively taking corporate data and shoving it into other users inbox. If my company has a proprietary solution to a math problem that nobody else knows about but the AI service that we have been working with has access to it and Billy Main Competitor ALSO has that service and asks "how would one solve this math problem" the second the AI spills the beans, the suits in the…
> I have never heard of a cloud service of ISP actively taking corporate data and shoving it into other users inbox.
You'd never hear about if it the cloud service was taking your corporate data and using it for countless other things though. Insider trading, selling leads to your competitors, pushing ads to your clients/customers with offers of their own products, using trends in what your company and others are doing to guide development of their own products and services. Done carefully, you'd never be able to trace any of it back to them and it'd take a whistleblower for you to find out it happened in the first place.
I don't imagine any cloud service that has massive amounts of data which could easily make them a ton of money is just ignoring it.
Re: Corporate America is getting hooked on open-source AI
#250Been wishing my company was doing this. We are locked in with chatgpt for chat and claude for coding. I have a 36gb m4 max laptop but I'm not allowed to run anything on it even though it would be totally free. Absolute pain.
Why do you care for company stuff? Local models would be slower and weaker.