Viewing profile — zeppelin_7

If you were ever curious whether a site allows signed crawlers, you can use this tool. This tool respects the website's robots.txt directive. You will be surprised how many sites a…

I run a crawler (SitedexBot) that signs every request using Web Bot Auth. I was trying to debug my HTTP message signatures directory, and ended up making the tool free/open. No dat…

Even the registered bots seem like all over the place

[dead]

Btw, they are also getting aggressive with bans. Furthermore the process to repeal is broken in the UI, and there is no way to get support

[dead]

Simple way to programmatically spawn, pause, resume, message, handle permissions, and questions for Claude Code.