Live data from Hacker News

Faking a JPEG

ty-penguin.org.uk

71–80 of 97 posts

Re: Faking a JPEG

#72

This makes me wonder if there are more efficient image formats that one might want to feed botnets. JPEG is highly complex, but PNG uses a relatively simple DEFLATE stream as well as some basic filters. Perhaps one could make a zip-bomb like PNG that only consists of a few bytes?

That might be challenging because you can trivially determine the output file sized based on the dimensions in pixels and pixel format, so if the DEFLATE stream goes beyond that you can stop decoding and discard the image as malformed. Of course, some decoders may not do so and thus would be vulnerable.

Is it a problem through ? I'm pretty sure that any check is on the weight of the PNG, not the actual dimension of the image.

PNG doesn't have size limitation on the image dimensions (4bytes each). So I bet you can break at least one scrap bot with that.

Re: Faking a JPEG

#73
post #55

the worst offender I saw is meta. they have facebookexternalhit bot (they sometimes use default python request user agent) that (as they documented) explicitly ignores robots.txt it's (as they say) used to validate links if they contain malware. But if someone would like to serve malware the first thing they would do would be to serve innocent page to facebook AS and their user agent. they also re-check every URL eve…

Since when is 10r/s flooding?

That barely registers as a blip even if you're hosting your site on a single server.

Re: Faking a JPEG

#74
post #62

I am bit confused about the context. What is exactly the point of exposing fake data to webcrawlers?

They crawl for data, usually to train a model. Poisoning the models training data makes it less useful and therefore less valuable

Re: Faking a JPEG

#75
post #73
post #55

the worst offender I saw is meta. they have facebookexternalhit bot (they sometimes use default python request user agent) that (as they documented) explicitly ignores robots.txt it's (as they say) used to validate links if they contain malware. But if someone would like to serve malware the first thing they would do would be to serve innocent page to facebook AS and their user agent. they also re-check every URL eve…

Since when is 10r/s flooding? That barely registers as a blip even if you're hosting your site on a single server.

In our case this was very heavy specialized endpoint and because each request used different set of parameters could not benefit from caching (actually in this case it thrashed caches with useless entries).

This resulted in upscale. When handling such bot cost more than rest of the users and bots, that's an issue. Especially for our customers with smaller traffic.

This request rate varied from site to site, but it ranged from half to 75% of whole traffic and was basically saturating many servers for days if not blocked.

Re: Faking a JPEG

#76
post #2

Given that current LLMs do not consistently output total garbage, and can be used as judges in a fairly efficient way, I highly doubt this could even in theory have any impact on the capabilities of future models. Once (a) models are capable enough to distinguish between semi-plausible garbage and possibly relevant text and (b) companies are aware of the problem, I do not think data poisoning will be an issue at all.

> Once (a) models are capable enough to distinguish between semi-plausible garbage and possibly relevant text

https://xkcd.com/810/

Re: Faking a JPEG

#77
Old man yells at cloud, then creates a labyrinth of mirrors for the images of the clouds to reflect back on each other.

Re: Faking a JPEG

#80
I don't understand the reasoning behind the "feed them a bunch of trash" option when it seems that if you identify them (for example by ignoring a robots.txt file) you can just keep them hung up on network connections or similar without paying for infinite garbage for crawlers to injest.
Post reply on HN