Live data from Hacker News

Scan your website to see how ready it is for AI agents

isitagentready.com

111–120 of 190 posts

Re: Scan your website to see how ready it is for AI agents

#111

I'd rather have a site showing how well my site is protected from being accessed by AI agents would be preferable, and advises how I can lock it down further. Basically, the exact opposite of this.

Maybe we can start a new protocol where the html is encrypted, and the viewer must try 2^10 to 2^20 hashes before the decryption key is discovered. Same formula that BTC mining uses. It would be negligible cost for any single user but terribly expensive for crawling en-masse.

Anything that increases the entry time by a second or more is a pretty good way to make me (and probably others) just not bother with opening the website.

Re: Scan your website to see how ready it is for AI agents

#112
post #79

The absurd process of SEO hucksters trying to pivot their obsolete services into "GEO" as most ecommerce websites realize their entire value was a list of part numbers and prices.

"GEO" (optimizing for agent search) is the legitimate sequel to SEO though. I published a free macOS app three years ago to the app store and abandoned it. Over the last six months I received multiple emails per week from people asking where they can find it since it only shows up on the app store for older macOS. I finally asked people how they found out about my app, and 100% of the time it was because they asked C…

I mean, I can see the bones of the point you're trying to make, but:

* You describe your website as "crappy" yet ChatGPT was able to figure it out enough to get you traffic for an app you didn't maintain

* ... with the caveat that it thought made up theoretical features were actual features

So unless your website was "GEO"d by sheer accident, I really don't think this is a good example to cite as the demonstration of what you're saying.

Re: Scan your website to see how ready it is for AI agents

#113
post #104

Earlier quoted context omitted.

GEO?

"Generative Engine Optimization" a phrase as dumb as the idea. For 30 years marketers have been doing everything they can to avoid making sites useful for people, despite that being what Google rewarded from the start (e.g. relevant link text, page titles, and headings).

to be clear, marketers are not the only ones to blame for useless sites.

Re: Scan your website to see how ready it is for AI agents

#114
post #93

Earlier quoted context omitted.

I’m at a loss for how this works since agents just use a browser and see the same thing users see

So far I haven't seen crawlers or agents utilize the interactive map widget where the final useful data is located. I'm sure it will happen eventually. I can tell they're not using it because the page is getting hit by their user agents but my API is not.

If I have to use "interactive map widget" and you weren't the only supplier of the lifesaving thing I'd noped out of there faster than I arrived (and then blacklisted you in kagi to never come back again).

Your site, your choices.

But also: hostile design? My choice.

Re: Scan your website to see how ready it is for AI agents

#115
post #111

Earlier quoted context omitted.

Maybe we can start a new protocol where the html is encrypted, and the viewer must try 2^10 to 2^20 hashes before the decryption key is discovered. Same formula that BTC mining uses. It would be negligible cost for any single user but terribly expensive for crawling en-masse.

Anything that increases the entry time by a second or more is a pretty good way to make me (and probably others) just not bother with opening the website.

Usually the Anubis anti-bot things only take a second. But I stared at one for more than 30 seconds the other day when I tried to access one of the Linux kernel websites. Literally just a progress bar with a hash counter. I was on a modern iPhone, I don’t know why it took so long. maybe because my phone had low battery? But it’s infuriating that this is what the web has become.

The web is becoming more and more unusable every day. If your data is easy to access, it gets stolen and scraped, your site effectively DDOSed. If your site is hard to access nobody will visit.

Re: Scan your website to see how ready it is for AI agents

#116
post #16

Wrong way round. Should be "Is Your Agent Reality-Ready?" (Hint: no)

That depends. I used "AIs" to help me quickly sift though many accommodation, travel and entertainment options for my upcoming holiday (4 people, 2 weeks).

If the "AI" I was talking with couldn't see your offer, it naturally didn't exist for me in the assessment and choice phase I then did.

So I don't think it's universally a "no". Like it or not, LLMs are useful.

Re: Scan your website to see how ready it is for AI agents

#117

I'd rather have a site showing how well my site is protected from being accessed by AI agents would be preferable, and advises how I can lock it down further. Basically, the exact opposite of this.

Maybe we can start a new protocol where the html is encrypted, and the viewer must try 2^10 to 2^20 hashes before the decryption key is discovered. Same formula that BTC mining uses. It would be negligible cost for any single user but terribly expensive for crawling en-masse.

This is how Anubis operates, to some extent. The more suspicious your connection is, the harder and more frequent the proof of work.

The latency while browsing the web these days is brutal as a result; between Anubis and Cloudflare and the like.

Our prize for it will be the impending super intelligence our benevolent future overlords allow us to exploit, I suppose. /s

Re: Scan your website to see how ready it is for AI agents

#118
post #93

Earlier quoted context omitted.

So far I haven't seen crawlers or agents utilize the interactive map widget where the final useful data is located. I'm sure it will happen eventually. I can tell they're not using it because the page is getting hit by their user agents but my API is not.

If I have to use "interactive map widget" and you weren't the only supplier of the lifesaving thing I'd noped out of there faster than I arrived (and then blacklisted you in kagi to never come back again). Your site, your choices. But also: hostile design? My choice.

You shouldn't assume it's a hostile design. Do you think Google Maps is a hostile design? It's a similar use case.

Re: Scan your website to see how ready it is for AI agents

#119

AI industry: "AI agents will soon be able to do any white-collar human job!" Also AI industry: "Please make sure your website is adapted so that AI agents are able to use it."

It remains to be seen if companies are going to spend more effort in to making AI-accessible design than they do user-accessible design.

If the believers get what they want, soon there will be no more human users and all traffic will be driven by bots.
Post reply on HN