Earlier quoted context omitted.
Charge site owners to protect the site from aggressive crawlers, charge crawlers/agents to bypass the protection. Like a good old fashioned protection racket
I guess it would be if Cloudflare was operating the bots.
A New Internet Business Model?
41–50 of 218 posts
Re: A New Internet Business Model?
#42I don’t know if I see a company extracting rent from other people as a win…
Re: A New Internet Business Model?
#43Re: A New Internet Business Model?
#44Re: A New Internet Business Model?
#45Everyone seems to be dismissing this without reading it. As a content publisher, I am very interested in any proposal that results in me getting residual payments from AI scrapers. That would indeed be a new internet business model. This is also being attempted by RSL with their “Crawler Authentication Protocol” ( https://rslstandard.org/guide/web-crawlers ) for demanding proof of licensing from scrapers and RSL Coll…
So you use a public resource and presumably like the upside that comes with sharing on it, but you want to limit uses now that someone has found one that you don't like, so you're fine with degrading that public resource?
You could always share things privately or behind a paywall if you don't want them available publicly. But people seem to want to have their cake and eat it too.
I get why a hosting provider would want to limit crawlers to save bandwidth. The "creator" angle is just greed.
Re: A New Internet Business Model?
#46I hope that the next big shift will be to undo the asymmetry that crept into the internet quickly after it first became popular. Let us host stuff at home. Let us run odd and strange and great systems wherever we are. Undo the cloud, undo the capture of the net – I'm old enough to remember when we just had a bunch of boxen under a desk somewhere, and it was pretty great.
Re: A New Internet Business Model?
#47Re: A New Internet Business Model?
#48Everyone seems to be dismissing this without reading it. As a content publisher, I am very interested in any proposal that results in me getting residual payments from AI scrapers. That would indeed be a new internet business model. This is also being attempted by RSL with their “Crawler Authentication Protocol” ( https://rslstandard.org/guide/web-crawlers ) for demanding proof of licensing from scrapers and RSL Coll…
It should be front and center, communicated clearly, and easy to understand. If I was an investor, the lack of clarity after reading a few paragraphs would concern me.
Re: A New Internet Business Model?
#49> As we think about our role at Cloudflare in this developing market, it's not about protecting the status quo but instead helping catalyze a better business model for the future of Internet content creation. That means creating a level playing field. Ideally there should be lots of AI companies, large and small, and lots of content creators, large and small. Not mentioned: there would be a single gatekeeper for the…
Re: A New Internet Business Model?
#50In short: we'll have the machines tell the creators what to create. > You could imagine an AI company suggesting back to creators that they need more created about topics they may not have enough content about. Say, for example, the carrying capacity of unladened swallows because they know their subscribers of a certain age and proclivity are always looking for answers about that topic. The very pruning algorithms th…
Would AI companies be willing to match that (even 50% match)? If not, we might just end up with low paid copyrighters / ghost writers churning out large amounts of content for LLMs in subject areas where they don't necessarily have expertise.