Protect your right to run local AI • Hacker News Board

Re: Protect your right to run local AI

#101

Post by simon_brender » Fri, Jul 03, 2026, 10:48 AM UTC

windexh8er wrote: post #9

SilverElfin wrote: post #4

Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.

They already are. Altman is basically begging the US to buy into OAI, that's just the start. Both OAI and Anthropic are going to have to go down this path or their financials will never work out. Open local models are where the enterprise will need to go for any of this to be cost feasible, but we can almost guarantee this will be a battle nobody using AI will have asked for. You can thank Dario and Sam for the dysto…

[flagged]

Re: Protect your right to run local AI

#102

Post by NonHyloMorph » Fri, Jul 03, 2026, 10:50 AM UTC

windexh8er wrote: post #9

SilverElfin wrote: post #4

Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.

They already are. Altman is basically begging the US to buy into OAI, that's just the start. Both OAI and Anthropic are going to have to go down this path or their financials will never work out. Open local models are where the enterprise will need to go for any of this to be cost feasible, but we can almost guarantee this will be a battle nobody using AI will have asked for. You can thank Dario and Sam for the dysto…

If you're assumptions turned out right what would be the benefit to preassume such an undertaking to succeed? As a warning of what to oppose, it imho conveys too much defeatist suggestiveness. Viewed as expression of a latent submissive desire (a perspective that might be offending, my apologies, but hopefully justifyable as food for thought/curiosity) a kent brookman "I for one welcome our new insect overlords" kind of vibe.

Re: Protect your right to run local AI

#103

Post by NonHyloMorph » Fri, Jul 03, 2026, 10:53 AM UTC

wesleywt wrote: post #90

operatingthetan wrote: post #34

Earlier quoted context omitted.

Voting isn't some vanguard against political corruption. Voting can and is easily manipulated with completely legal means.

Not voting does absolutely result in political corruption.

Both are not logically exclusive assumptions

Re: Protect your right to run local AI

#104

Post by harrouet » Fri, Jul 03, 2026, 10:53 AM UTC

thaumasiotes wrote: post #100

reinitctxoffset wrote: post #26

Earlier quoted context omitted.

It might just mean "please oppose the inevitable attempts to privatize AI governance". Nothing has ever been, directly or indirectly, deficit financed at this scale before. In notional or real terms, in history, by anyone. Now maybe there's an argument that it's a good investment: we are going to beggar the Treasury to buy 2CTA on CoWoS out of Taipei and DCs the size of Manhattan. I personally think we could have don…

> Nothing has ever been, directly or indirectly, deficit financed at this scale before. In notional or real terms, in history, by anyone. I find it unlikely that this is true. The obvious candidate for things financed through staggeringly large deficits would be war.

True because wars finance value destruction.

But with $1.4T announced capex for the Frontier AI labs, we're not far from the 2nd (illegal) war in Irak: $1.8T of direct military spending.

With that said, I don't know how Frontier Ai companies will ever recover this capex with a glorious $50B of revenues. Add to that that a GPU's lifetime is only a few years and you may see it as a deadend.

NB: did you know Uber destroyed $27B of value since inception? But it still exists. So Frontier AI might just do the same.

Re: Protect your right to run local AI

#105

Post by [deleted] » Fri, Jul 03, 2026, 11:00 AM UTC

prima-facie wrote: post #99

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

[deleted]

Re: Protect your right to run local AI

#106

Post by Grimblewald » Fri, Jul 03, 2026, 11:10 AM UTC

Eh, let em. If the US economy wants to self-sabotage, let them. Its a dying empire, lets its fall be hastened. I'm ready for china to fill the US vacuum. At least china controls it's billionairs (see jack ma saga) rather than the inverse.

Re: Protect your right to run local AI

#107

Post by indoorfish » Fri, Jul 03, 2026, 11:13 AM UTC

Grimblewald wrote: post #106

Eh, let em. If the US economy wants to self-sabotage, let them. Its a dying empire, lets its fall be hastened. I'm ready for china to fill the US vacuum. At least china controls it's billionairs (see jack ma saga) rather than the inverse.

This feels short-sighted unless you are ethnically han?

Re: Protect your right to run local AI

#108

Post by fc417fc802 » Fri, Jul 03, 2026, 11:14 AM UTC

worik wrote: post #91

throw93930 wrote: post #52

Earlier quoted context omitted.

[flagged]

> chinese models without safety filters (it could be used to create software exploits) Any decent coding setup can create software exploits. That bird has flown.

Awkward realities never stopped a determined legislator.

Re: Protect your right to run local AI

#109

Post by matheusmoreira » Fri, Jul 03, 2026, 11:14 AM UTC

prima-facie wrote: post #99

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

Don't doubt it. Situation is fluid. Anything could happen.

Re: Protect your right to run local AI

#110

Post by Marha01 » Fri, Jul 03, 2026, 11:14 AM UTC

voidUpdate wrote: post #65

elcritch wrote: post #23

Earlier quoted context omitted.

Mock it we might now, but 12 acres and (not too distant future) open weights AI models capable of driving open source robots for farm labor would be huge. No need for huge expensive purpose built tractors. Even if they’re slow you could have half a dozen running 24/7. It could provide independence for anyone with a modicum of resources.

I'd probably want something other than an LLM running farming machines. I'd rather a purpose build machine learning system that is actually designed to run them, not just a tractor that goes "you're absolutely right! I ignored all the rules you set for me and harvested the wheat 2 months early. It's not just stupid, it's irresponsible"

> I'd rather a purpose build machine learning system that is actually designed to run them

If generalist robotic models get good enough to accomplish many varied tasks effectively, training a separate comparable specialized system from scratch for every task would be highly cost-ineffective, even if, in theory, it could have slightly higher reliability.