Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Pulling my site from Google over AI training

tracydurnell.com

Post reply on HN
Print view View original

11–20 of 102 posts

Re: Pulling my site from Google over AI training

#11

Post by bagpuss »

tivert wrote: post #5
jxramos wrote: post #3

> I’m going to start by pulling my websites out of Google search, then work on adding my sites to directories. Maybe I’ll even join a webring I'm curious, this is the first time I've heard of a webring, I'd like to learn more about these alternate discovery routes. Anyone have any concrete experience or recommendations to share?

Directory sites and webrings were artifacts of the early web, when search engines were pretty bad. They disappeared once search got better. https://en.wikipedia.org/wiki/Webring

don't forget Jimmy "Jimbo" Wales's Bomis webring thing, featuring the Bomis Babe Report!

Re: Pulling my site from Google over AI training

#12

Post by barbariangrunge »

As a substack author, with “permission is not granted to use any portion of this to train an ai” at the bottom of most of my posts, it’s bullshit that you have to do this sort of thing, and that it will almost certainly not work

This must be illegal, but how are all the little bloggers going to oppose it?

Re: Pulling my site from Google over AI training

#15

Post by arsome »

barbariangrunge wrote: post #12

As a substack author, with “permission is not granted to use any portion of this to train an ai” at the bottom of most of my posts, it’s bullshit that you have to do this sort of thing, and that it will almost certainly not work This must be illegal, but how are all the little bloggers going to oppose it?

I don't see why it would be illegal, AI reading it should be no different from anyone else.

Re: Pulling my site from Google over AI training

#16

Post by DanHulton »

chomp wrote: post #7

Author should update their robots.txt for Googlebot as well. It is not clear if noindex means "notrain" too. The entire webpage has to be read in and parsed for Google to extract that meta tag. However, robots.txt should stop the crawler before it proceeds to the rest of your site.

The author mentioned she was going to block Googlebot, only not yet, in order to make sure it can crawl the site again to get the 'noindex' instructions.

Re: Pulling my site from Google over AI training

#18

Post by sebzim4500 »

JohnFen wrote: post #9
tivert wrote: post #4

> Blocking bots that collect training data for AIs (and more) > In addition, I created a robots.txt file to tell “law abiding” bots what they’re not allowed to look at. I ought to have done this before but kind of assumed it came with my WordPress install (Nope.) > I specifically want to deter my website being used for training LLMs, so I blocked Common Crawl. Instead of blocking, it would be neater to present and al…

I was thinking about jamming along these lines, but the problem is that it's a game of whack-a-mole -- you have to keep up on what bots are active (robots.txt doesn't really help here, and focusing on Common Crawl is insufficient). My websites have been closed to the public since shortly after the release of ChatGPT, but I've been considering opening them up again, sort of. The not-logged-in experience being full of…

So if someone innocently reaches your site from google they will see a bunch of LLM generated misinformation?

You have a legal right to do this (assuming the LLM bullshit isn't libel) but I don't see how it could be considered a moral act.

Re: Pulling my site from Google over AI training

#19

Post by barbariangrunge »

arsome wrote: post #15
barbariangrunge wrote: post #12

As a substack author, with “permission is not granted to use any portion of this to train an ai” at the bottom of most of my posts, it’s bullshit that you have to do this sort of thing, and that it will almost certainly not work This must be illegal, but how are all the little bloggers going to oppose it?

I don't see why it would be illegal, AI reading it should be no different from anyone else.

I keep having to say this: An ai is not a person

Re: Pulling my site from Google over AI training

#20

Post by bryzaguy »

LordOfRiverRun wrote: post #13

Why the preference not to have Google train their AI using your website content?

One reason is the same as authors who don’t want their books trained and actors who don’t want their likeness trained. If that content is valuable it allows google to realize that value with no return to the creator.
Post reply on HN