I'm more worried about getting cut off from hardware because Nvidia can make more money selling to datacenters than I am about getting cut off from software.
Inference isn't that hard, you can run on amd/ Intel if needed.
Protect your right to run local AI
171–180 of 222 posts
Re: Protect your right to run local AI
#172Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.
it would be so easy to rent GPUs in europe and use unbannable encryption (tor,i2p if needed) to get inference from them. that remaining as an option makes banning local AI pointless. if all else fails I'm sure china will be able to sell to NK some GPUs and we can get inference from them lmao
Re: Protect your right to run local AI
#173Earlier quoted context omitted.
Don't doubt it. Situation is fluid. Anything could happen.
Its just so much easier to be a rebel for an imaginary cause then any of the real ones.
The entire point is to stop it from needing to be a cause in the first place.
Trying to establish the right to run models locally while we still can makes more sense than waiting to see if they do try, then organizing too late.
Re: Protect your right to run local AI
#174Earlier quoted context omitted.
And you think Google, one of the biggest cloud providers, Microsoft, etc. are going to be onboard with local LLMs? I don't think so
Not sure about Google, but these Nvidia RTX Spark machines are specifically a Microsoft+Nvidia partnership. Microsoft is actually pushing hard on Windows security primitives for agents & local AI. At BUILD this year they used the phrase "unmetered local intelligence" more times than I can count. From their blog about the RTX Spark surface ultra > purpose-built to develop and run up to 1 trillion-parameter frontier AI…
Not forgetting Apple!
Re: Protect your right to run local AI
#175Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.
Can you use an LLM to teach you how to build a gun or use it to design a gun for you build? Can an LLM be used to generate images of young people for older perverts? If yes, then it's not very hard to make the argument that you need to be licensed in order to run an LLM on your local machine. Why wouldn't you want to be licensed? Are you against protecting children and public safety? Many students die from gun violence every year and massive amounts of minors are taken advantage of by human filth. Why would you be against protecting the most vulnerable in our society?
It will look good for politicians who pass legislation to "protect" the vulnerable. Potentially improving the chances of another term due to the marketing benefits of pushing such a law through. I think you are mistaken believing that this may never happen.
Re: Protect your right to run local AI
#176The petition does not have "District of Columbia" as an option for "In the US".
Citizens of the District of Columbia have no one to contact. Their laws are set by Congress and their delegate to Congress cannot vote. I suppose you could contact the President, that's basically the only representation they have for this type of legislation
Re: Protect your right to run local AI
#177Earlier quoted context omitted.
RATs do not require a datacenter to develop.
Ok? How is that relevant to the issue at hand?
That a government has a much easier time controlling who's renting a building with the energy consumption of small city than what everyone's coding on their laptop?
Re: Protect your right to run local AI
#178Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.
Can you use an LLM to teach you how to build a gun or use it to design a gun for you build? Can an LLM be used to generate images of young people for older perverts? If yes, then it's not very hard to make the argument that you need to be licensed in order to run an LLM on your local machine. Why wouldn't you want to be licensed? Are you against protecting children and public safety? Many students die from gun violen…
Yeah. I suspect parent either is very optimistic or does not know how restricted current batch of language models are already or does not recognize that, while it may some time to completely neuter, they do have time.
It seems that powers that be learned something from the world wide web deployment.
Re: Protect your right to run local AI
#179Laws restricting the use of local AI/LLMs are not going to happen, no matter how much Anthropic might want it. All the major OEMs are now counting on local LLMs to take off. Just look at the OEM support for the upcoming Nvidia RTX Spark platform: Asus, Dell, HP, Lenovo, Microsoft, MSI. All the big names in the industry will have, by the end of this year, Nvidia-powered machines made specifically for local LLM use.
If big biz wants it, it'll only run signed blob models and prolly send telemetry.
Point is.. if I want to run equivalent of GNU model with zero blobs or other corporate silliness, I should be able to.
Re: Protect your right to run local AI
#180Wait, state laws can restrict you using software on your own general-purpose computer? Does that infringe on freedom of speech?