Live data from Hacker News

OpenAI Finally Allows ChatGPT Complete Internet Access

gizmodo.com

1–10 of 118 posts

Re: OpenAI Finally Allows ChatGPT Complete Internet Access

#3

Will blocking User-agent: GPTBot in robots.txt work for this too?

This time it's not scraping the internet (like a robot) but actually acting as a direct user agent for the human typing their prompt, so I wouldn't be against them ignoring robots.txt.

Re: OpenAI Finally Allows ChatGPT Complete Internet Access

#4

Will blocking User-agent: GPTBot in robots.txt work for this too?

This time it's not scraping the internet (like a robot) but actually acting as a direct user agent for the human typing their prompt, so I wouldn't be against them ignoring robots.txt.

It's not a crawler, but it seems likely that OpenAI would take the point of view that as long it's going to a website, it may as well keep a cached copy to use for training later.

Re: OpenAI Finally Allows ChatGPT Complete Internet Access

#5

Will blocking User-agent: GPTBot in robots.txt work for this too?

This time it's not scraping the internet (like a robot) but actually acting as a direct user agent for the human typing their prompt, so I wouldn't be against them ignoring robots.txt.

That makes no sense. It’s still automated and not an actual human, and it’s still distilling information from the internet.

Re: OpenAI Finally Allows ChatGPT Complete Internet Access

#10

Earlier quoted context omitted.

This time it's not scraping the internet (like a robot) but actually acting as a direct user agent for the human typing their prompt, so I wouldn't be against them ignoring robots.txt.

That makes no sense. It’s still automated and not an actual human, and it’s still distilling information from the internet.

Your browser is also automating things, you're not resolving DNS and writing all the http requests by hand.
Post reply on HN