Perplexity is using stealth, undeclared crawlers to evade no-crawl directives
1–2 of 2 posts
Re: Perplexity is using stealth, undeclared crawlers to evade no-crawl directives
#2Dupe (885 points, 513 comments) https://news.ycombinator.com/item?id=44785636