Live data from Hacker News

Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

404media.co

271–280 of 320 posts

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#271
post #265

Earlier quoted context omitted.

People publish AI generated crap on Amazon because they make money from it and Amazon allows it because they also make money from it. People publish AI generated websites because they make money from it, and Google eagerly put blogspam on top because Google makes money from it. The shadow libraries make no money by sharing books, instead the librarians risk prison for doing it. So there is no incentive for them to in…

> The shadow libraries make no money by sharing books, instead the librarians risk prison for doing it. So there is no incentive for them to include AI spam books. There is also very little incentive for creators of AI spam books to try to have them included in the shadow libraries. That's just one incentive. There are others, like ideological battle (e.g. flood the last good information channels with generated mysid…

You seem to think that anybody can control the shadow libraries and flood them with AI-generated books. That's not how any of the current libraries work, so I don't know where you got that idea from. Have you used a shadow library and seen how they function, or are you merely deducting from superior knowledge?

Would you be able to flood a physical library with AI-generated books?

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#272

Earlier quoted context omitted.

It's a sign that mass-communication-for-everyone-at-scale isn't a great idea after all. We can just go back to small forums and private group chats. Let human-scale social norms rule instead of algorithmically-amplified grey goo.

No one can afford that. There's a reason why a lot of forums went downhill and got replaced by Reddit... moderating them is a constant effort (and Reddit at least takes over the legally mandated stuff like CSAM, piracy and basic anti-spam), admins are tired of skiddies exploiting phpBB or whatever vulnerabilities the very second they get public, you gotta deal with trolls DDoS'ing you for fun, and also users are lazy…

Yep, forums were small when the web was small. Once the web got bigger so did forums and the problems that came with it. After that the spam, hacking, and DDOS just got out of control. The tools for any one individual to make your life hell are just that much better these days.

Forums died all the time back then because the admin got tired of the mess. People these days would be far less tolerant of joining these small groups and pouring time into them, only to have them disappear a few months later.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#273
post #265

Earlier quoted context omitted.

> The shadow libraries make no money by sharing books, instead the librarians risk prison for doing it. So there is no incentive for them to include AI spam books. There is also very little incentive for creators of AI spam books to try to have them included in the shadow libraries. That's just one incentive. There are others, like ideological battle (e.g. flood the last good information channels with generated mysid…

You seem to think that anybody can control the shadow libraries and flood them with AI-generated books. That's not how any of the current libraries work, so I don't know where you got that idea from. Have you used a shadow library and seen how they function, or are you merely deducting from superior knowledge? Would you be able to flood a physical library with AI-generated books?

> You seem to think that anybody can control the shadow libraries and flood them with AI-generated books. That's not how any of the current libraries work, so I don't know where you got that idea from. Have you used a shadow library and seen how they function, or are you merely deducting from superior knowledge?

About two minutes of googling and testing shows that Library Genesis has an anonymous upload function.

I really doubt a pirate library will have the manpower to fully vet every upload. Especially with generative AI able to generate something that sorta looks right.

> Would you be able to flood a physical library with AI-generated books?

A physical library does not have the same characteristics as an online "shadow library," so the question is moot. For instance: a physical has a budget and staff and orders books to shelve, while a "shadow library" must rely on (illicit) donations.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#274
post #74

Earlier quoted context omitted.

They did do something: they blocked people using adblockers. Really we need some body like the UK ASA to say "you're liable for all these frauds, Google".

That sounds like a classic example of doing something and making the situation worse (aka almost every regulation ever) If advertising providers were de jure and de facto liable for fraud, then that will raise the bar for competing advertising providers, as if Google wasn't enough of a monopoly. Regulation almost universally benefits established players and stifles competition, which is why a lot of regulation is (se…

> That sounds like a classic example of doing something and making the situation worse (aka almost every regulation ever)

Such a weird take.. without regulation we would still have child labor, slave labor, cancer causing shit in basically everything, no seatbelts, even worse corruption in politics and companies, .. list goes on ..

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#275

Earlier quoted context omitted.

> the massively overpriced $15/m why do you consider this massively overpriced? 55% of it i believe goes to content creators and they make more from a subscription watch then an ad supported watch.

> why do you consider this massively overpriced? Because i struggle to imagine the ads i watch would amount to $15/m. So it feels like significant markup. A flat rate seems either upcharging, or subsidizing. Neither feel good as a consumer. I rather (and have) quit than pay them $15/m for a handful of ads. They started fighting a month back or w/e and i just stopped watching them for ~2 weeks. When i tried later, the…

Sidenote, i'd love to hear of platforms that are more creator first. Anyone have any recommendations for additional platforms that give money directly to creators?

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#276
post #273

Earlier quoted context omitted.

You seem to think that anybody can control the shadow libraries and flood them with AI-generated books. That's not how any of the current libraries work, so I don't know where you got that idea from. Have you used a shadow library and seen how they function, or are you merely deducting from superior knowledge? Would you be able to flood a physical library with AI-generated books?

> You seem to think that anybody can control the shadow libraries and flood them with AI-generated books. That's not how any of the current libraries work, so I don't know where you got that idea from. Have you used a shadow library and seen how they function, or are you merely deducting from superior knowledge? About two minutes of googling and testing shows that Library Genesis has an anonymous upload function. I r…

There are real people running the shadow libraries, they probably can't be "hacked" as easily as you think. Sure, you might sneak one spam book or two inside, but that won't have any impact.

This is the process of LibGen uploads:

> After successful uploading you need to fill the bibliographic data and submit the form, otherwise the file won't be actually added. The file will be accepted to the collection (and become widely distributed) once it gets necessary positive votes from the librarian team, usually it happens in a few days after uploading.

If it's easy to compromise the shadow libraries with AI generated content, I suggest you go ahead and do it for proof.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#277
post #232
post #179

Earlier quoted context omitted.

It certainly sounds like it's doing that. Though if you're an expert in a subject you ask it about, you can see when it transitions from "knowledge of the subject" to "Your uncle who made a living hustling pool and can tell a story made of nothing but whoppers of lies, sounding like the most honest person you've ever met." It's reasonable to assume it does the same thing over subjects you know less about.

It's really bizarre we ended up with the largest LLM deployment being around something it really doesn't do that well at (knowledge retrieval). Hopefully soon we'll see it reading the story itself, stripping out irrelevant ads/SEO, and summarizing it. I actually have a dream of one day going back to a flip phone where I'll get an AI call summarizing emails or messages that are important, as well as any relevant news…

> I actually have a dream of one day going back to a flip phone...

Do it. Sonim makes some absolute brick chonks of phones these days.

> ...where I'll get an AI call summarizing emails or messages that are important, as well as any relevant news stories where I can ask for more detail if needed.

I just try to not have unimportant emails come in, though eBay can't be convinced to turn off their damned shipping notifications (or I've not found how to do it). The 1st of the year is a very good time to start wrangling your inbox - every email that comes in is either of value, or you figure out how to eliminate it. Unsubscribe from everything you don't really care about.

And news summary emails are a thing. I route them and various Substack newsletters to my Kobo via Pocket.

> The Internet is amazing, but honestly I don't know that the degree to which I personally engage with it is the ideal cost/benefit as opposed to using an intermediary.

You get a lot of the benefits with far less use than most people assume sane.

I check email via mail clients, when my desktop computers are on. It doesn't come to my phone. I'm off instant messengers most evenings. And I turn my cell phone off at night (which also leads to, on the Sonim XP3+, about two weeks of useful battery life).

Just start.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#278
post #143

I wonder if we will get to a point where the web is so saturated with this junk that the web itself starts to lose its luster. If AI can dream up a million impressive wood carvings, it seems like the real carving I saw in person is the only one that is actually interesting.

This applies to discussion too. For instance, how many Reddit comments are bots? With the extreme groupthink present there, it wouldn't be a huge shock if it already makes up over half of the comments in popular subs.

I don't even have an account on Reddit these days, but still view it regularly.

On the popular subs if you read at least half the posts (not comments) you'll see "Op is a bot that reposts content". They typically have some algorithm that digs up old popular posts that haven't been posted in a while and reposted them. With the number of people complaining they are reposted crap I have my doubts their initial upvotes legit, instead getting enough bot votes to get them on the subs front page which then gains more natural votes.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#279
post #261

Earlier quoted context omitted.

Yeah, 25% is way too low a threshold for brainwashed to be useful to those at the top. They need at least 50%, 70% would be good but 90% is ideal. Society being defined as in peril is basically a rhetorical constant however. On a more serious note haven't societies long been based upon common brainwashing? The Bronze Age and before are fuzzier on the details but propaganda certainly existed then as well at a smaller…

I think this is a commonly shared miscalculation. In the grand scheme of things, relatively little is required to destabilize society. Technology advancements raise the danger potential almost exponentially when compared to late history, or even recent history. It doesn't take much to tip the course of history. The bronze age didn't require the same type of risk assessment that we have the burden of managing.

People don't seem to understand the massive amount of specialization that's occurred with humanity, especially since the start of the industrial revolution. The most distant you go in the past the more general your title was, for example farmer. Now you can have some extremely narrow field, say EUV lithography, and if you and the other 10 experts on it on the planet decide to go bonkers you could cost billions of dollars to the processor industry.

Re: Facebook Is Being Overrun with Stolen, AI-Gen Images That People Think Are Real

#280

This was one of the most obvious outcomes anyone could have and should have predicted. Even when people know an image is fake, it still seems to be able to sway them. The effect we've seen over the past few years is simply likely to become worse: more polarization, more extremism, more inter-group hostility, and more BS online.

Even when people know that things are ads they are influenced by them. The BS works for the same reason that ads work. It's like humans experience something (see an ad) and it makes them feel something (ad uses cute dog) and they remember that feeling the next time they see that brand/ad/initial stimuli. Like seeing something triggers a mini-replay in the brain.

Those ads are also filled with trickery to show a false idea of what something is really like. Things like photoshopped models, auto-tuning, filters, painting food to look a certain way, sound fx being added. The list is nearly endless.
Post reply on HN