Live data from Hacker News

How to circumvent Sci-Hub ISP block

fragile-credences.github.io

41–50 of 196 posts

Re: How to circumvent Sci-Hub ISP block

#41

Earlier quoted context omitted.

Millions of individual torrents is not a great solution. Keeping them all seeded is basically impossible unless they run a seed for each one, at which point they might as well just host the files. Plus you'll never get the economy of scale that makes BitTorrent really shine. When you have a whole lot of tiny files that people will generally only want one or two of there isn't much better than a plain old website. A t…

There was that project some guy posted a while back that used a combination of sqlite and partial downloads to enable searches on a database before it was downloaded all the way. If you can fit PDFs somewhere into that you'd be golden. Or just use IPFS I suppose.

Isn't that essentially mapreduce? Either way, interesting and I'd love to see the link.

Re: How to circumvent Sci-Hub ISP block

#42
post #23

Just setup a VPN on some cheap cloud provider. There are lots of sites UK ISPs block even though the sites themselves are not illegal or host illegal content. For e.g. torrent indexing services (the content itself may be illegal but purely providing a search across that content is basically doing what Google do). The UK internet is heavily filtered/censored and so doing this is useful anyway. Business ISP connections…

I travelled last week, and was horrified by how much is blocked by the mainstream ISPs in the UK. Afaik, my (London) ISP does not block anything. No idea why, as all the others quote high court orders.

Many UK ISPs have "adult content" filters, which tend to be wide-reaching and block a lot more than just porn sites. But these are optional and can be turned off very easily.

There's a smaller set of non-optional blocks (pirate/torrent sites) which you need a VPN to get around.

Re: How to circumvent Sci-Hub ISP block

#43

Earlier quoted context omitted.

Millions of individual torrents is not a great solution. Keeping them all seeded is basically impossible unless they run a seed for each one, at which point they might as well just host the files. Plus you'll never get the economy of scale that makes BitTorrent really shine. When you have a whole lot of tiny files that people will generally only want one or two of there isn't much better than a plain old website. A t…

a plain old website or a publishing house with distribution services and syndication attached, but for a sane price. "a whole lot of tiny files" severely underestimates the scale at work. Libgen's coverage is relatively shallow, and pdf books tend to be huge, at least for older material. Scihub piggy backs on the publishers, so that's your reference. syndication , syndicate , quite apt don't you think? Libraries that…

If the sane price is an optional "Donate to keep this site going" link, then ok. But only free access, without authentication or payment, to scientific papers, is sane. IMHO.

Re: How to circumvent Sci-Hub ISP block

#45

Earlier quoted context omitted.

https://sci-hub.st does not work in the UK [edit: on Sky].

Works on BT broadband

Virgin says no.

Interestingly I get this:

Secure Connection Failed

An error occurred during a connection to sci-hub.st. SSL received a record that exceeded the maximum permissible length.

Error code: SSL_ERROR_RX_RECORD_TOO_LONG

Re: How to circumvent Sci-Hub ISP block

#46
post #30

Earlier quoted context omitted.

This only works if your ISP is using/abusing/hijacking DNS to censor your connections. If they're doing that you'd be better off using D-o-T or D-o-H, to protect your DNS from interference.

ISP rarely do anything else than DNS censoring (censoring by ip blackholing is for really grave stuff). Also i don't understand why you'd be "better off" using encrypted connection to a 3rd party DNS which can still lie to you. Just run a local resolver, it's so lightweight there's no real reason not to. (and honestly, the hypothetical delay isn't noticeable)

Sorry, am I missing something because I'm pretty sure the whole point of the article is that ISPs do block more than just DNS

Re: How to circumvent Sci-Hub ISP block

#47

Earlier quoted context omitted.

a plain old website or a publishing house with distribution services and syndication attached, but for a sane price. "a whole lot of tiny files" severely underestimates the scale at work. Libgen's coverage is relatively shallow, and pdf books tend to be huge, at least for older material. Scihub piggy backs on the publishers, so that's your reference. syndication , syndicate , quite apt don't you think? Libraries that…

If the sane price is an optional "Donate to keep this site going" link, then ok. But only free access, without authentication or payment, to scientific papers, is sane. IMHO.

Might this be a case where the best resolution would be to have the government (which is at least partially funding nearly all of these papers) step in and add a ledger of papers as a proof of investment?

The cost of maintaining a free and open DB of scientific advances and publications would be so incredibly insignificant compared to both the value and the continued investment in those advancements.

Re: How to circumvent Sci-Hub ISP block

#48

Earlier quoted context omitted.

Millions of individual torrents is not a great solution. Keeping them all seeded is basically impossible unless they run a seed for each one, at which point they might as well just host the files. Plus you'll never get the economy of scale that makes BitTorrent really shine. When you have a whole lot of tiny files that people will generally only want one or two of there isn't much better than a plain old website. A t…

a plain old website or a publishing house with distribution services and syndication attached, but for a sane price. "a whole lot of tiny files" severely underestimates the scale at work. Libgen's coverage is relatively shallow, and pdf books tend to be huge, at least for older material. Scihub piggy backs on the publishers, so that's your reference. syndication , syndicate , quite apt don't you think? Libraries that…

In Internet scale it's not a lot of data. Most people who think they have big data don't.

Estimates I've seen put the total Scihub cache at 85 million articles totaling 77TB. That's a single 2U server with room to spare. The hardest part is indexing and search, but it's a pretty small search space by Internet standards.

Re: How to circumvent Sci-Hub ISP block

#49
post #41

Earlier quoted context omitted.

There was that project some guy posted a while back that used a combination of sqlite and partial downloads to enable searches on a database before it was downloaded all the way. If you can fit PDFs somewhere into that you'd be golden. Or just use IPFS I suppose.

Isn't that essentially mapreduce? Either way, interesting and I'd love to see the link.

I believe this is the project mentioned

https://github.com/lmatteis/torrent-net

Post reply on HN