Live data from Hacker News

1.5 TB of Dark Net Market scrapes

gwern.net

21–30 of 78 posts

Re: 1.5 TB of Dark Net Market scrapes

#23

This is why I love the internet. This article has given me a fascinating glimpse into a world I have no idea about. Author: thank you so much for taking the time to document this.

You should take the time to read his other posts. Gwern is one of the most fascinating people/websites I know of.

Re: 1.5 TB of Dark Net Market scrapes

#24
post #20

I've had a very slow-moving hobby project to parse and analyze a subset of this data: https://github.com/rcompton/black-market-recommender-systems So far I've had some ok results along the lines of "91.7% of vendors who sold speed and MDMA also sold ecstasy" http://ryancompton.net/2015/03/24/darknet-market-basket-anal... I am working on extending this to markets besides evolution now.

Just FYI, MDMA is ecstasy.

Re: 1.5 TB of Dark Net Market scrapes

#25

This is why I love the internet. This article has given me a fascinating glimpse into a world I have no idea about. Author: thank you so much for taking the time to document this.

Unrelated to the darknet, but this Twitter account evoked a very similar feeling in me (random snippets from userboards in the 80's and early 90's):

https://twitter.com/wwwtxt

Re: 1.5 TB of Dark Net Market scrapes

#26
post #8

Earlier quoted context omitted.

Possession laws are pretty strict and hard to decode. I wouldn't want to be the test case in court. The idea of "poisoning" a dataset is an interesting theoretical. But in practice, I just want to judge the likelihood that the dataset is poisoned by the presence of images. If it is then there's not much I can do with it.

Yes, this absolutely needs to be clarified by Gwern. This is a very dangerous thing to link researchers to if it contains any illegal content.

Um... Dark market

Re: 1.5 TB of Dark Net Market scrapes

#28
post #8

Earlier quoted context omitted.

Possession laws are pretty strict and hard to decode. I wouldn't want to be the test case in court. The idea of "poisoning" a dataset is an interesting theoretical. But in practice, I just want to judge the likelihood that the dataset is poisoned by the presence of images. If it is then there's not much I can do with it.

Yes, this absolutely needs to be clarified by Gwern. This is a very dangerous thing to link researchers to if it contains any illegal content.

Um.. It says Black Market right on the tin.

Re: 1.5 TB of Dark Net Market scrapes

#29
post #24
post #20

I've had a very slow-moving hobby project to parse and analyze a subset of this data: https://github.com/rcompton/black-market-recommender-systems So far I've had some ok results along the lines of "91.7% of vendors who sold speed and MDMA also sold ecstasy" http://ryancompton.net/2015/03/24/darknet-market-basket-anal... I am working on extending this to markets besides evolution now.

Just FYI, MDMA is ecstasy.

[deleted]

Re: 1.5 TB of Dark Net Market scrapes

#30
post #24
post #20

I've had a very slow-moving hobby project to parse and analyze a subset of this data: https://github.com/rcompton/black-market-recommender-systems So far I've had some ok results along the lines of "91.7% of vendors who sold speed and MDMA also sold ecstasy" http://ryancompton.net/2015/03/24/darknet-market-basket-anal... I am working on extending this to markets besides evolution now.

Just FYI, MDMA is ecstasy.

I chose that statistic to be a bit tongue-in-cheek, cf

> While 'ecstasy' is the popular name for MDMA, the functional definition of ecstasy is any pill represented as MDMA on the street. Ecstasy pills are notoriously unreliable in content, more so than most other street drugs, and commonly contain either caffeine, ephedrine, amphetamines, MDA, MDE, DXM, or--in rare cases--DOB, and don't necessarily contain MDMA or any psychoactive.

https://www.erowid.org/chemicals/mdma/mdma_basics.shtml

Post reply on HN