Live data from Hacker News

Protect your right to run local AI

righttointelligence.org

21–30 of 222 posts

Re: Protect your right to run local AI

#21
post #19
post #2

There comes a time when voting becomes silly and ineffective.

Voting is always effective. In the worst case it communicates the magnitude of dismsissiveness while demonstrating your intention to claim agency.

In the worst case it generates symbolism; that is ultimately what you’re saying.

That symbolism is akin to prayer.

I am not casting prayer in a negative light, I’m simply categorising your voting concept.

Re: Protect your right to run local AI

#22

Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.

They already are. Altman is basically begging the US to buy into OAI, that's just the start. Both OAI and Anthropic are going to have to go down this path or their financials will never work out. Open local models are where the enterprise will need to go for any of this to be cost feasible, but we can almost guarantee this will be a battle nobody using AI will have asked for. You can thank Dario and Sam for the dysto…

there will always be higher valuation for company inventing model+1 . no one wants to use latest_model -1 when their competiton is using latest_model.

Re: Protect your right to run local AI

#23

"12 acres and an LLM"

Mock it we might now, but 12 acres and (not too distant future) open weights AI models capable of driving open source robots for farm labor would be huge.

No need for huge expensive purpose built tractors. Even if they’re slow you could have half a dozen running 24/7.

It could provide independence for anyone with a modicum of resources.

Re: Protect your right to run local AI

#24
post #19
post #2

There comes a time when voting becomes silly and ineffective.

Voting is always effective. In the worst case it communicates the magnitude of dismsissiveness while demonstrating your intention to claim agency.

Ah yes, voting is always effective. Thank goodness people in Germany kept voting in the early 1930s. Imagine what terrible things might have happened if they hadn't.

Re: Protect your right to run local AI

#25

Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.

This whole situation is very reminiscent of how Microsoft was trying to get Linux and open source banned when NT started losing market share on the server.

Re: Protect your right to run local AI

#26

I don't see any info about what laws or actions specifically are happening. Is there more info somewhere?

I can't tell from the site or the linked twitter handles. Their core ask for every state seems to be "Please support clear safe-harbor language for lawful local AI ownership, research, model modification, open-source publication, and local execution" rather than stopping or amending any specific bill/law. One they _could_ be referring to is the California AI Transparency Act which isn't compatible with open source li…

It might just mean "please oppose the inevitable attempts to privatize AI governance".

Nothing has ever been, directly or indirectly, deficit financed at this scale before. In notional or real terms, in history, by anyone.

Now maybe there's an argument that it's a good investment: we are going to beggar the Treasury to buy 2CTA on CoWoS out of Taipei and DCs the size of Manhattan. I personally think we could have done a little more engineering before deciding that the big blind was like, 5 trillion all counted, but it was going to be expensive no matter what.

What super weird is that we're running a project where the "penny" to the "dollar" is the Manhattan Project, and a couple of super weird dudes who do MDMA at Lighthaven now and again are like, in charge of it.

Re: Protect your right to run local AI

#27
For this to work there needs to be a standard protocol for model routing so that you as the user can decide where requests go. You may wish to use mainly local models but at some times for some tasks you'll need to route requests to cloud models.

I've designed the role-model protocol for this, allowing routing between any model, however to function optimally it needs consumer applications to use the protocol when sending requests: https://role-model.dev/concepts/how-role-model-works

Re: Protect your right to run local AI

#28
In the US at least, repealing a law takes the same number of votes as passing a new one. I don't follow the purpose of this, unless it's to pass a constitutional amendment or something. Or maybe just to get clicks on a website.

And I already have the right to local intelligence, because my GPUs are my private property, and if someone freely releases a beerware model then I can freely download it.

What am I missing?

Re: Protect your right to run local AI

#29
They could be more clear and more specific but I would not be surprised to see licensing for this as a means of creating yet another compliancre ceiling and quick cash for state government to pinch out of the productive elements of society (those pinching, mostly lawyers, being glorified parasites that offer nothing to productive society other than pay-to-win access to "justice" and serving as time-shared mouthpieces for plutocrats while claiming to represent everyone within whatever unit of representation they hold).

And when even very intelligent, but excessively conceited, people hear the echo of their own reason9ing from conversational autocorrect and assume it is somehow akin to intelligent life, the normies will go with whatever the plutocrats push with their media outlets too absorbed in their own domain specific knowledge (and cowed into intellectual laziness by other media products they consume eagerly) to ever subject it to much thought that Claude might not be Skynet after all.

Re: Protect your right to run local AI

#30

Earlier quoted context omitted.

This. They can see their valuations slipping. They hope that in a few/several years they will start reaping profits. However, in several years local hardware will be well suited to run models locally at 80-90% efficiency - for "free". You won't need frontier models for daily tasks in a few years. I'd guess.

> 80-90% efficiency wdym by that > for daily tasks which are?

128B-A16B class models at 10-50 tok/s should be plenty for most tasks done on computers
Post reply on HN