Viewing profile — iranu

Thanks for the comment, great question. Quick clarification: the AI agent writes the config once and is out of the loop after that. You run crawls yourself or via cron. So the "aut…

Honestly, it feels like cloudflare bullying other sites into using their anti-bot services. great business model by charging owners and devs at the same time. Using AI per page to …

Hi HN, I built this. It's been in production across 500+ websites. We're a research group that studies online communications. We needed to scrape hundreds of sites regularly — news…