Creepy Crawlies
people.kernel.org
Creepy Crawlies
1–10 of 679 posts
Re: Creepy Crawlies
#2Off-topic, but anyone with which he did the plots?
Re: Creepy Crawlies
#3Off-topic, but anyone with which he did the plots?
looks like this https://github.com/rfonseca/xkcd-gnuplot
Re: Creepy Crawlies
#4Re: Creepy Crawlies
#5Re: Creepy Crawlies
#6How expensive would AI access be if every user paid their fair share instead of shoving it on the people doing the actual work?
Re: Creepy Crawlies
#7I've been noticing page views in the past several months with a much wider span of origin on my Blogger stats. Before I would get a few from several countries, but now I am getting views from tiny countries and obscure or outdated browsers and operating systems, which leads me to think scrapers could be using VPN services in various countries along with header anonymizers that mask the device that they are using.
Extensions like ModHeader, BrowserMask do this: https://github.com/apify/crawlee-python
https://github.com/mthcht/Masquerade-Spoofer
Great for AI scrapers, bad for hosters and everyone else.
Re: Creepy Crawlies
#8Given the nature of git, wouldn't all that HTML be highly cacheable? I get that's not free either, but it's got to be a lot less intensive than having cgit generate it every single time.
Re: Creepy Crawlies
#9Given the nature of git, wouldn't all that HTML be highly cacheable? I get that's not free either, but it's got to be a lot less intensive than having cgit generate it every single time.
That was my first thought, varnish (vinyl these days) in front of the website should dramatically reduce this as the git repo should be practically static for most of the content.
Re: Creepy Crawlies
#10Given the nature of git, wouldn't all that HTML be highly cacheable? I get that's not free either, but it's got to be a lot less intensive than having cgit generate it every single time.
That was my first thought, varnish (vinyl these days) in front of the website should dramatically reduce this as the git repo should be practically static for most of the content.
But there are "cubic bazillions" of possible URLs that are being requested. Even if they boil down to "only" some millions actual commits, their rendered HTMLs are all different.