Live data from Hacker News

Protect your right to run local AI

righttointelligence.org

111–120 of 222 posts

Re: Protect your right to run local AI

#111

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

Don't doubt it. Situation is fluid. Anything could happen.

Its just so much easier to be a rebel for an imaginary cause then any of the real ones.

Re: Protect your right to run local AI

#112
post #79

Now the investors try to hold the bubble together by regulatory capture. They must really fear the worst. A bailout is going to cost their puppet in the White House even the last supporters in his base.

No chance. Every despot has a cadre of true believers, the types who believe their great leader is playing 4D chess or that its all part of a greater divine plan.

Re: Protect your right to run local AI

#113

Given the state of corruption in politics, I think Anthropic and OpenAI will likely bribe … oh wait I mean “lobby” … for bans on open source. Otherwise their imaginary trillion dollar valuations make no sense.

They already are. Altman is basically begging the US to buy into OAI, that's just the start. Both OAI and Anthropic are going to have to go down this path or their financials will never work out. Open local models are where the enterprise will need to go for any of this to be cost feasible, but we can almost guarantee this will be a battle nobody using AI will have asked for. You can thank Dario and Sam for the dysto…

> Altman is basically begging the US to buy

Where did you hear this? All the results I can find say the opposite that the US would buy anything.

Re: Protect your right to run local AI

#114

Pardon me, so they'll hunt down huggingface, ollama and china? I don't quite understand? What about the millenia of companies that provide apis for local llms and private companies that use local llms for privacy reasons? I don't even understand how you'd execute such a ruleset.

Dario and friends are fear mongering local models to get them banned.

“are”? Source? I've seen an absolute flood of “BREAKING:” claims online recently which are quotes from 3 years ago where all of their context is removed, or that quotes from 3 years ago are “because of GLM 5.2”, etc. https://www.techpolicy.press/transcript-senate-hearing-on-pr...

Re: Protect your right to run local AI

#116

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

And Adobe! I've always figured their heart can't really be in the business of running a cloud platform that has to decide what people can and can't edit.

Blackmagic Design too.

They are all desperate for Windows to run well on a chip with unified VRAM.

Re: Protect your right to run local AI

#117
post #116

Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.

And Adobe! I've always figured their heart can't really be in the business of running a cloud platform that has to decide what people can and can't edit. Blackmagic Design too. They are all desperate for Windows to run well on a chip with unified VRAM.

Well, we could expect anything from Adobe. An LLM subscription on top of the regular Adobe subscription sounds like the sort of thing they would do.

Do your local filters run slow? Does your movie render have no sass? Then sign-up for AaaS!

Re: Protect your right to run local AI

#118
post #116

Earlier quoted context omitted.

And Adobe! I've always figured their heart can't really be in the business of running a cloud platform that has to decide what people can and can't edit. Blackmagic Design too. They are all desperate for Windows to run well on a chip with unified VRAM.

Well, we could expect anything from Adobe. An LLM subscription on top of the regular Adobe subscription sounds like the sort of thing they would do. Do your local filters run slow? Does your movie render have no sass? Then sign-up for AaaS!

They effectively do have a generative AI plan on top of regular Creative Cloud. Generative credits auto-top-up I think?

But it must be an epic pain for them to maintain when they are really a software company, and AI tools really should be able to do most of their work locally. Affinity has some local model support for example.

I am sure they are going to have to maintain cloud support for those features for a long time, but it's all a much easier sell if you can also run it locally.

Post reply on HN