Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

1.5 TB of Dark Net Market scrapes

gwern.net

Post reply on HN
Print view View original

71–78 of 78 posts

Re: 1.5 TB of Dark Net Market scrapes

#71

Post by gwern »

joshmn wrote: post #70
gwern wrote: post #37

Earlier quoted context omitted.

I don't think that works. It's not remotely browsable or searchable. It would be quite challenging to put these scrapes up, anyway. They're regular wget crawls with a regular directory/file structure, the problem is that there's so much material and so many files that it can be almost impossible to find what you are looking for... (Plus you need to rewrite links into relative links to make everything render properly.…

Hmm. Now I'm thinking that I might end up using your idea (scraping the dark web) and using something like httrack[0] to do exactly that: structure. [0] https://en.wikipedia.org/wiki/HTTrack

I once tried using HTTrack, but I found it was doing too much magic under the hood and was hard to work with. As dumb as wget is (that blacklist bug is over 12 years old now!), it at least is understandable.

Re: 1.5 TB of Dark Net Market scrapes

#72

Post by deadmik3 »

gwern wrote: post #62
userbinator wrote: post #47

Earlier quoted context omitted.

DNM users almost universally loathe CP, and no market has ever dared to permit sales. These users are willing to do so many other illegal things, but the thought of being known as a pedophile or supporting pedophilia in any way, is completely abhorrent to them? Interesting datapoint.

It is interesting, isn't it? You might expect there to be a 'general factor of criminality/antisociality/violence' akin to how we find a general factor of intelligence in psychological things, but as far as I can tell, drug use or sales seems to be largely orthogonal to other kinds of crimes - most of the DNM users will never buy credit card dumps and rip off retailers (carding is disliked by a lot of DNM users, alth…

just cause someone wants to get fucked up doesn't mean they want to fuck other people up too

Re: 1.5 TB of Dark Net Market scrapes

#73

Post by joshmn »

gwern wrote: post #71
joshmn wrote: post #70

Earlier quoted context omitted.

Hmm. Now I'm thinking that I might end up using your idea (scraping the dark web) and using something like httrack[0] to do exactly that: structure. [0] https://en.wikipedia.org/wiki/HTTrack

I once tried using HTTrack, but I found it was doing too much magic under the hood and was hard to work with. As dumb as wget is (that blacklist bug is over 12 years old now!), it at least is understandable.

Thanks for saving me the headache :)

Re: 1.5 TB of Dark Net Market scrapes

#75

Post by tyho »

chm wrote: post #48
ez123 wrote: post #24

Earlier quoted context omitted.

Just FYI, MDMA is ecstasy.

I don't do MDMA personally but I have some friends who like going to raves with some chemical supplies. On the streets, some make it a point of honor to sell/buy only "MDMA" because "ecstasy" is "crap". The only precise name is MDMA. In my opinion the name users give to what they're ingesting is inconsequential. Most users have no idea what MDMA means anyway, nor would they know how to chemically identify if what the…

I wish researching the drugs you do and testing them as thougraly as possible was more widispread. I have managed to drill it into most people I meet in that context. Most are actually receptive and dispite public assumptions, do care about their long term health and what they put in their body. A small amount are not. In one case I tested somebody's 'MDMA' for them and told them that I was certian that there was no MDMA in it at all and they took it anyway.

Re: 1.5 TB of Dark Net Market scrapes

#76

Post by fineman »

njloof wrote: post #53
fineman wrote: post #7

Earlier quoted context omitted.

How about ascii art? Actually, this is an interesting topic. Poisoning a dataset. CP would work for private security investigators, and to poison against government investigators you could use leaked classified secrets. Could you work around this by operating on the files on VPS you don't own, streaming a very low-res ('Basilisk'-proof - https://en.wikipedia.org/wiki/BLIT_(short_story) ) remote desktop image.

Does ASCII art have victims? Other than its audience, I mean.

Technically it could be translated from more traditional pictures. (Instead of being an original creation.)

Re: 1.5 TB of Dark Net Market scrapes

#77

Post by tedks »

mikeash wrote: post #64
tedks wrote: post #63

Earlier quoted context omitted.

What is illegal in a download of an online drug marketplace? Are pictures of drugs banned where you live?

It's a general black market, not just drugs. For example, one of the sites described on that page is PEDOFUNDING, "A crowdfunding site for child pornography." Now the dump isn't supposed to contain any images, but it's hard to be 100% sure. In any case, whatever risk there might be seems to be clearly implied in the name and description there.

FreeeOW, that's what I get for skimming the list I guess.

Re: 1.5 TB of Dark Net Market scrapes

#78

Post by chm »

tyho wrote: post #75
chm wrote: post #48

Earlier quoted context omitted.

I don't do MDMA personally but I have some friends who like going to raves with some chemical supplies. On the streets, some make it a point of honor to sell/buy only "MDMA" because "ecstasy" is "crap". The only precise name is MDMA. In my opinion the name users give to what they're ingesting is inconsequential. Most users have no idea what MDMA means anyway, nor would they know how to chemically identify if what the…

I wish researching the drugs you do and testing them as thougraly as possible was more widispread. I have managed to drill it into most people I meet in that context. Most are actually receptive and dispite public assumptions, do care about their long term health and what they put in their body. A small amount are not. In one case I tested somebody's 'MDMA' for them and told them that I was certian that there was no…

    Most are actually receptive and dispite public assumptions,
    do care about their long term health and what they put in their body.
That's where I don't agree. If they really cared, they wouldn't ingest unknown chemicals. Actions speak louder than words. The only reason they keep on doing it is because their experiences so far have been good on average, without too much drama. It's sad but sometimes even the death of a close one is not enough to stop people from blindly trusting street pushers.

I don't personally have a problem with MDMA and I would try it if I could be assured it was pure, with regulated dosage. Purifying street bought drugs and carefully measuring dosages is surprisingly easy and doesn't require a lot of money (FWIW, I'm a chemist).

The absurdity of the situation, in my opinion, is that people are willing to blindingly trust some random (or even a well-known) pusher because the consequences of making due diligence are harsher, in their minds. What I mean is that it's much easier and on average much less dangerous to just ingest a pill than to make due diligence and possibly get caught, sent to prison, etc.

Post reply on HN