Earlier quoted context omitted.
Many if not most websites are paid for by eyeballs not by get requests. A bot is a bot is a bot. Respect robots.txt or expect to have your IPs banned.
It may not be very long before the big majority of web searches are via AI. If that happens, blocking AI will mean blocking most people too. You’d already be blocking me as I’d guess I now search via AI >90% of the time between perplexity, chatgpt, deep research, and google search AI.
If that's websites want, they should have that option.