405 sounds like a lot of B's! What do you need to practically run or host that yourself?
You cannot run it locally
Open source AI is the path forward
731–740 of 936 posts
Re: Open source AI is the path forward
#732Earlier quoted context omitted.
> NSF has had a bunch of different programs to allocate time on supercomputers to researchers at no cost, these days mostly run out of the Office of Advanced Cyberinfrastruture This would be the logical place to put such a programme.
The DoE has also been a fairly active purchaser of GPUs for almost two decades now thanks to the Exascale Computing Project [0] and other predecessor projects. The DoE helped subsidize development of Kepler, Maxwell, Pascal, etc along with the underlying stack like NVLink, NGC, CUDA, etc either via purchases or allowing grants to be commercialized by Nvidia. They also played matchmaker by helping connect private sect…
The DoE subsidized the development of GPUs, but so did Bitcoin.
But before that, it was video games, like quake. Nvidia wouldn't be viable if not for games.
But before that, graphics research was subsidized by the DoD, back when visualizing things in 3D cost serious money.
It's funny how technology advances.
Re: Open source AI is the path forward
#733Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…
[dead]
Re: Open source AI is the path forward
#734Earlier quoted context omitted.
No the preferred way to make modifications is using the the training code. One may also input a snapshot weighs to start from, but the training code is definitely what you would modify to make a change.
how do you train it in a different language by changing the training code?
By selecting different dataset. Of course this dataset does need to exist.
In practice building and curating datasets also involves a lot of code.
Re: Open source AI is the path forward
#735Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…
The feed certainly is, but I suspect most activity left on Facebook is happening in group pages. Groups are the only thing I still log in for as some of them, particularly the local ones, have no other way of taking part. They are also commonly membership by request and actively moderated. If I had the time (and energy) I might put some effort into advocating to moving to something else, but it will be an uphill batt…
The challenges of moving to alternative solutions
Re: Open source AI is the path forward
#736“The Heavy Press Program was a Cold War-era program of the United States Air Force to build the largest forging presses and extrusion presses in the world.” This ”program began in 1944 and concluded in 1957 after construction of four forging presses and six extruders, at an overall cost of $279 million. Six of them are still in operation today, manufacturing structural parts for military and commercial aircraft” [1].…
In the Netherlands, for instance, there is "the national supercomputer" Snellius: https://www.surf.nl/en/services/snellius-the-national-superc... I am not sure about its budget, but my impression as a user is that its resources are never fully used. At least, none of my jobs ever had to queue. I doubt that it can compete with the scale of resources that FAANG companies have available, but then again, I also doubt how…
Italy built the Leonardo HPC cluster, it's one of the largest in EU and was created by a consortium of universities. After just over a year it's already at full capacity and expansion plans have been anticipated because of this.
Re: Open source AI is the path forward
#737Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…
I agree with the overall sentiment, but it's is not necessarily the case that "the world has collectively decided to lose their minds with this AI crap". You only need a relatively small number of bad actors for this to be the case.
I think the situation highlights the need for better regulation
Re: Open source AI is the path forward
#738I think all this discussion around Open-source AI is a total distraction from the elephants in the room. Let's list what you need to run/play around with something like Llama: 1. Software: this is all Pytorch/HF, so completely open-source. This is total parity between what corporates have and what the public has. 2. Model weights: Meta and a few other orgs release open models - as opposed to OpenAI's closed models. S…
[deleted]
Re: Open source AI is the path forward
#739Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…
[dead]
[flagged]
Re: Open source AI is the path forward
#740Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…
I get your frustration of a scorched internet. But I don't think it's all that gloomy. Whether we like it or not, LLMs and some kind of a "down-to-earth AI" is here to stay, once the dust settles. Right now, it feels like everything is burning because we're in the thick of an evolving situation; and the Silicon Valley tech-bros are in a hurry to ride the wave and make a quick buck with their ChatGPT wrapper. (I can't speak of social networks, I don't have any accounts for 10+ years, except for HN.)
* * *
"In reading the history of nations, we find that, like individuals, they have their whims and their peculiarities; their seasons of excitement and recklessness, when they care not what they do. We find that whole communities suddenly fix their minds upon one object, and go mad in its pursuit; that millions of people become simultaneously impressed with one delusion, and run after it, till their attention is caught by some new folly more captivating than the first [...]
"Men, it has been well said, think in herds; it will be seen that they go mad in herds, while they only recover their senses slowly, and one by one."
— from MacKay's book, 'Extraordinary Popular Delusions and the Madness of Crowds'