Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open source AI is the path forward

about.fb.com

Post reply on HN
Print view View original

811–820 of 936 posts

Re: Open source AI is the path forward

#811

Post by rbits »

the8thbit wrote: post #12

"Eventually though, open source Linux gained popularity – initially because it allowed developers to modify its code however they wanted ..." I find the language around "open source AI" to be confusing. With "open source" there's usually "source" to open, right? As in, there is human legible code that can be read and modified by the user? If so, then how can current ML models be open source? They're very large matric…

You release all the technology and the training data. Everything that was used to create the model, including instructions.

I'm not sure if facebook has done that

Re: Open source AI is the path forward

#812

Post by justneedaname »

sgu999 wrote: post #801
have_faith wrote: post #746

Earlier quoted context omitted.

The irony of a bot account sliding into a convo about internet slop is not lost.

How do you know?

The comment history does read much like you'd expect from a bot, lots of short, generic statements that vaguely tie to the subject of the post

Re: Open source AI is the path forward

#813

Post by dspillett »

csomar wrote: post #785
sensanaty wrote: post #718

Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…

That's actually the preferred outcome. The open internet noise ratio will be so high that it turns into pure randomness. The traditional old venues (reputed blogs, small communities forums, pay for valued information, pay for your search, etc..) will resurface again. The Popular Web has been in a slow decline, time to kill it.

> The traditional old venues […] will resurface again.

… to be subsequently drowned out by AI “copies” of themselves, which in turn are used to train more AIs, until we don't have a Dead Internet¹ but a Habsburg Internet.

--

[1] https://en.wikipedia.org/wiki/Dead_Internet_theory

Re: Open source AI is the path forward

#814

Post by Zambyte »

dogcomplex wrote: post #636
ks2048 wrote: post #91

Earlier quoted context omitted.

How about using some of that money to develop CUDA alternatives so everyone is not paying the Nvidia tax?

Or just develop the next wave of chips designed for specifically transformer-based architectures (and ternary computing), and bypass the needs for GPUs and CUDA altogether

That would be betting against other architectures like Mamba, which does not seem like an obviously good bet to make yet. Maybe it is though.

Re: Open source AI is the path forward

#815

Post by phatfish »

hluska wrote: post #307
dmix wrote: post #95

Earlier quoted context omitted.

I don't think there's a shortage of capital for AI... probably the opposite Of all the things to expand the scope of government spending why would they choose AI, or more specifically GPUs?

Look at it from the perspective of an elected official: If it succeeds, you were ahead of the curve. If it fails, you were prudent enough to fund an investigation early. Either way, bleeding edge tech gives you a W.

If it succeeds the idea gets sold to private corporations or the technology is made public and everyone thinks the corporation with the most popular version created it.

If it fails certain groups ensure everyone knows the government "wasted" taxpayer money.

Re: Open source AI is the path forward

#816

Post by zelphirkalt »

pera wrote: post #765

I wish Meta stopped using the "open source" misnomer for free of charge weights. In the US the FTC already uses the term Open-Weights , and it seems the industry is also adopting this term (e.g. Mistral). Someone can correct me here but AFAIK we don't even know which datasets are used to train these models, so why should we even use "open" to describe Llama? This is more similar to a freeware than an open-source proj…

Facebook is one of the great when it comes to twisting words and appropriating terms in ways that benefit Facebook.

Re: Open source AI is the path forward

#817

Post by zelphirkalt »

Spivak wrote: post #613
seoulmetro wrote: post #567

Earlier quoted context omitted.

Yeah.. and Facebook said they would enforce censorship on their platforms to ensure content safety.. that didn't turn out so well. Now it just censors anything remotely controversial, such as World War 2 historical facts or even just slightly offensive wording.

You're really just arguing about the tuning. I get that it's annoying as a user but as a moderator going into it with the mentality that any post is expendable and bringing down the banhammer on everything near the line keeps things civil. HN does that too with the no flame-bait rule.

The banhammer can quickly become a tool of net negative though, when actual facts are being repressed/censored.

Re: Open source AI is the path forward

#818

Post by sensanaty »

Kiro wrote: post #802
sensanaty wrote: post #718

Meanwhile Facebook is flooded with AI-generated slop with hundreds of thousands of other bots interacting with it to boost it to whoever is insane enough to still use that putrid hellhole of a mass-data-harvesting platform. Dead internet theory is very much happening in real time, and I dread what's about to come since the world has collectively decided to lose their minds with this AI crap. And people on this site a…

And I don't understand why people lump all AI together as if a coding assistant is the same thing as AI generated spam and other garbage. I'm pretty sure no-one here is excited about that. I'm excited about the former since AI has massively improved my productivity as a programmer to a point where I can't imagine going back. Everything is not black or white and people can be excited about one part of something and ha…

Seeing some of the code my colleagues are shitting out with the help of coding "assistants", I would definitely categorize their contributions as spam, and has had nothing but an awful effect on my own time and energy, having to sift through the unfiltered crap. The problem being, of course, that the idiotic C-suite in their infinite wisdom decided to push "use AI assistants" as a KPI, so people are even encouraged to spam PRs with terrible code.

If this is what productivity looks like then I'm proud to be unproductive.

Re: Open source AI is the path forward

#819

Post by lolinder »

frabcus wrote: post #677
lolinder wrote: post #94

Earlier quoted context omitted.

Source versus weights seems like a really pedantic distinction to make. As you say, the training code and training data would be worthless to anyone who doesn't have compute on the level that Meta does. Arguably, the weights are source code interpreted by an inference engine, and realistically it's the weights that someone is going to want to modify through fine-tuning, not the original training code and data. The fa…

Meta could change the license of future releases of Llama and kill your business built on it. If the training data was openly available, even if you can't afford to res train a new version, a competitor like Amazon could do it for you

> Meta could change the license of future releases of Llama and kill your business built on it.

If you built a business on Llama 3.1, you're not going to suddenly go down in flames because you can't upgrade to Llama 4.

Even saying you really needed to upgrade, Llama 4 would be a new model that you'd have to adapt your prompts for anyway, you can't just version bump and call it good. If you're going to update prompts anyway, at that point you can just switch to any other competitor model. Updating models isn't urgent, you have time to do it slowly and right.

> If the training data was openly available, even if you can't afford to res train a new version, a competitor like Amazon could do it for you

If Llama 4 changed the license then presumably you wouldn't have access to its training data even if you did have access to Llama 3.1's. So now you have access to Llama 3.1's training data... now what? You want to recreate the Llama 3.1 weights in response to the Llama 4 release?

Re: Open source AI is the path forward

#820

Post by Kiro »

sensanaty wrote: post #818
Kiro wrote: post #802

Earlier quoted context omitted.

And I don't understand why people lump all AI together as if a coding assistant is the same thing as AI generated spam and other garbage. I'm pretty sure no-one here is excited about that. I'm excited about the former since AI has massively improved my productivity as a programmer to a point where I can't imagine going back. Everything is not black or white and people can be excited about one part of something and ha…

Seeing some of the code my colleagues are shitting out with the help of coding "assistants", I would definitely categorize their contributions as spam, and has had nothing but an awful effect on my own time and energy, having to sift through the unfiltered crap. The problem being, of course, that the idiotic C-suite in their infinite wisdom decided to push "use AI assistants" as a KPI, so people are even encouraged t…

I'm sorry that you work at a dysfunctional company.
Post reply on HN