Live data from Hacker News

Facebook scraped every Australian adult user's public posts to train AI

abc.net.au

81–90 of 267 posts

Re: Facebook scraped every Australian adult user's public posts to train AI

#81

Funny to think that the distillation of 16 years of Facebook posts is now considered "intelligence."

I don't know why that's funny, since that is the very essence of the ideal of democracy: the distillation or averaging of the sentiment of the masses yields truth. Some contributions are outliers in one way or another, and it's these outliers that live in many people's heads, but these extremes are ironed out by averaging against the masses.

Re: Facebook scraped every Australian adult user's public posts to train AI

#82
post #59

Earlier quoted context omitted.

I don't agree because it creates this dilemma for creators: you need to put your work out there to get traction, but if you put your work out there and anything public is fair game, then it will be sampled by a computer and instantly recreated at scale. This might even happen without the operator knowing whose work is being ripped off. Commercial art producers have always ripped off minor artists. They would do it by…

> but if you put your work out there and anything public is fair game, then it will be sampled by a computer and instantly recreated at scale. That's just how the internet works. Don't put something on the internet if you don't want it to be globally distributed and copied. > I personally know two artists who have sued major companies who ripped off their work for ads, and both won million-plus settlements. Ultimatel…

> That's just how the internet works. Don't put something on the internet if you don't want it to be globally distributed and copied.

Or we could be ethical and encourage others to be ethical.

Re: Facebook scraped every Australian adult user's public posts to train AI

#83

Earlier quoted context omitted.

I guess it's a gray area? It's more like a forum to me, of the pre-Facebook sort, more like Slashdot than reddit. And there's extremely strong moderation here that does the opposite of Facebook: It optimizes against controversy and vitriol rather than encouraging it. We end up with a bunch of nerds mostly talking shop and sometimes complaining about the job market, but that's still far less ragebaitey than most socia…

> And there's extremely strong moderation here that does the opposite of Facebook: It optimizes against controversy and vitriol rather than encouraging it. Well, that and hot grits you insensitive clod.

Oh god, now I feel old :P

Re: Facebook scraped every Australian adult user's public posts to train AI

#84

Funny to think that the distillation of 16 years of Facebook posts is now considered "intelligence."

Maybe the plan is to replace all FB users with bots but keep charging advertisers anyway.

"But how can anyone tell?"

Re: Facebook scraped every Australian adult user's public posts to train AI

#85
post #75

Funny to think that the distillation of 16 years of Facebook posts is now considered "intelligence."

What you get from the self-supervised training of a base model is more like "language fluency plus a web of crystallized-knowledge relationships." But also, ML model training is a bit like the stock market: the noise/stupidity in individual examples points in a bunch of random directions, and so ends up cancelling out; while the signal all points in the same direction, and so ends up captured in the distilled model.…

It's still wrong if the majority is wrong, isn't it? Like propaganda on major channels which praise the same thing, is consumed by a major part of the population which then assume that it's the right thing and continue the misinformation, which then propagates to the AI model.

Re: Facebook scraped every Australian adult user's public posts to train AI

#86
post #51

Earlier quoted context omitted.

Their algorithm sure does a good job at filtering those normal people out...

Maybe that says more about you and how you engage with it than it does the platform though.

Even if you don't engage with the content that gets recommended/shown in your timeline gets weird real quick.

I used to have an account for marketplace and our local neighborhood group and that's my experience.

Re: Facebook scraped every Australian adult user's public posts to train AI

#88

Funny to think that the distillation of 16 years of Facebook posts is now considered "intelligence."

Amusing but a large part of the training data other LLM models is social media platforms.

I mean hop on chat GPT right now and ask it to come up with any kind of novel joke. I can almost guarantee it will either be some kind of word play or other equally low hanging kind of pun that you would find on Reddit fifty replies deep.

Where's the Mensa member only social media dating platform for a properly erudite and snobbishly arrogant LLM to train on?

Re: Facebook scraped every Australian adult user's public posts to train AI

#90

I am very likely in the minority here, but I think AI SHOULD be trained on everything that is in the public sphere. I'd be disappointed if it wasn't trained on everything they had access to. If it is trained on private information, then I would have issue with it.

Why?

A statement that extraordinary would be interesting if it had some reasoning alongside it.

Also, Facebook posts aren't really "in the public sphere" / publicly accessible, but that's a nitpick.

Post reply on HN