11–20 of 78 posts
>collating and creating these scrapes has absorbed an enormous amount of my time & energy due to the need to solve CAPTCHAs,... Have you considered automating this?
>collating and creating these scrapes has absorbed an enormous amount of my time & energy due to the need to solve CAPTCHAs,... Have you considered automating this?
The whole point of CAPTCHAs is to be difficult to automate. Or are you suggesting automating farming out the CAPTCHA solutions to cheap workers?
Earlier quoted context omitted.
Possession laws are pretty strict and hard to decode. I wouldn't want to be the test case in court. The idea of "poisoning" a dataset is an interesting theoretical. But in practice, I just want to judge the likelihood that the dataset is poisoned by the presence of images. If it is then there's not much I can do with it.
Yes, this absolutely needs to be clarified by Gwern. This is a very dangerous thing to link researchers to if it contains any illegal content.
It's an interesting issue, and a way investigators may be attacked, but it's their responsibility alone. There exists data. This is that data. The data may bite. Touch the data at your own risk.
gwern, you are an absolute force of nature when it comes to generating and collecting and presenting information in a useful way. Thank you.
Earlier quoted context omitted.
The whole point of CAPTCHAs is to be difficult to automate. Or are you suggesting automating farming out the CAPTCHA solutions to cheap workers?
I assumed it was a joke. But maybe not?
This is so cool. Thanks gwern. If someone's feeling bored, you're welcome to put the entire archive on a web server for us to look at...... Or maybe I'll just do it.
Author: thank you so much for taking the time to document this.
>collating and creating these scrapes has absorbed an enormous amount of my time & energy due to the need to solve CAPTCHAs,... Have you considered automating this?
The whole point of CAPTCHAs is to be difficult to automate. Or are you suggesting automating farming out the CAPTCHA solutions to cheap workers?
So far I've had some ok results along the lines of "91.7% of vendors who sold speed and MDMA also sold ecstasy" http://ryancompton.net/2015/03/24/darknet-market-basket-anal... I am working on extending this to markets besides evolution now.