A short history of web bots and bot detection techniques
1–10 of 17 posts
Re: A short history of web bots and bot detection techniques
#2I liked the depiction of different TCP SYN packets ;)
Re: A short history of web bots and bot detection techniques
#3I needed a new github account the other day. The "are you human tests" were so hard that I almost gave up. I think a new way to do this will be needed soon.
Re: A short history of web bots and bot detection techniques
#4Does anyone know of a good reference on the topic of fingerprinting?
Re: A short history of web bots and bot detection techniques
#5Does anyone know of a good reference on the topic of fingerprinting?
https://github.com/gautamkrishnar/nothing-private
Recently used DDG browser it just cant get some sites to clear! Try the flame button. But still logged in after few browser data clearing.
Are company resorting to this kinda tactic to keep user remembered. Its a major booking for lodging site!!!
Qubes OS seems more and more attractive.
Re: A short history of web bots and bot detection techniques
#6> Orchestraion frameworks
Small typo here
Re: A short history of web bots and bot detection techniques
#7Does anyone know of a good reference on the topic of fingerprinting?
https://abrahamjuliot.github.io/creepjs/
https://github.com/abrahamjuliot/creepjs
Usually my go to. The readme, source code and GitHub issues are great source of information, and the website itself is useful to test against.
edit:
For anything network fingerprinting related, especially censorship related I usually browse https://github.com/net4people/bbs/issues
Re: A short history of web bots and bot detection techniques
#8I'm curious about how this world will evolve in the era of AI agents/MCP. It is not entirely unlikely that AI agents will have access to limited wallets etc to facilitate a broader set of use cases. In that case, a one shot solution to bot vs. human may not make sense, and a more nuanced human/bot-we-like/bot-we-don't-like may be needed by corporations. This would esp be the case for unofficial MCP servers that would use technologies like headless browsing etc to support an API.
Re: A short history of web bots and bot detection techniques
#9I'm curious about how this world will evolve in the era of AI agents/MCP. It is not entirely unlikely that AI agents will have access to limited wallets etc to facilitate a broader set of use cases. In that case, a one shot solution to bot vs. human may not make sense, and a more nuanced human/bot-we-like/bot-we-don't-like may be needed by corporations. This would esp be the case for unofficial MCP servers that would…
I'm not sure I understand the mental model you're basing your inferences on, but my model leads to a far different outcome:
If you've got a good enough bot and it's pre-qualified to spend money, then it can use the special "register as a bot" API and provide personal information and whatever else I want to understand that there is a "real human" behind the curtain. A credit card alone is not enough, they can be (trivially) stolen. The way I see it using agentic bots will ultimately require you to provide more personal details than an actual human would.
Re: A short history of web bots and bot detection techniques
#10How do systems like OpenAI Operator bypass bot protection for the entire web?