Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Sci-Bay: Google Scholar plus Sci-Hub

sci-bay.org

Post reply on HN
Print view View original

1–10 of 114 posts

Re: Sci-Bay: Google Scholar plus Sci-Hub

#3

Post by bringtheaction »

Just tested it by searching for “spline”. This is great! Can someone elaborate on how it was made? Specifically, how it integrates with Google Scholar. Is that done client side or server side? If server side how come it hasn’t been blocked by Google seeing as Google don’t seem to like robots using their regular search function so my guess would be they wouldn’t like it for Scholar either. Perhaps it is proxying requests and would also pass on any CAPTCHAs presented? Still in that case I would expect all requests to get hit with a CAPTCHA. Perhaps it just hasn’t had enough traffic yet?

Re: Sci-Bay: Google Scholar plus Sci-Hub

#5

Post by veridies »

k5hp wrote: post #4

Interesting that Hacker News allows links to pirate sites... This will probably get removed soon

I wouldn't think Hacker News would be in any trouble with this one. The link is to a noteworthy site, not to any infringing content; you'd have to take action and use a specific search term to find copyrighted content. And the implication of posting it is clearly that people should find it interesting and discuss it, not that they should use it to download articles.

Re: Sci-Bay: Google Scholar plus Sci-Hub

#7

Post by zeth___ »

veridies wrote: post #5
k5hp wrote: post #4

Interesting that Hacker News allows links to pirate sites... This will probably get removed soon

I wouldn't think Hacker News would be in any trouble with this one. The link is to a noteworthy site, not to any infringing content; you'd have to take action and use a specific search term to find copyrighted content. And the implication of posting it is clearly that people should find it interesting and discuss it, not that they should use it to download articles.

And it's not like searching in google scholar, getting the doi and putting it in scihub was any great hardship before.

Re: Sci-Bay: Google Scholar plus Sci-Hub

#9

Post by shakna »

petra wrote: post #6

How did you integrate scholar in sci-bay ? Does scholar have an API ? And about the future, how do you see google responding?

I don't know how they are doing it, but Google Scholar does not have an API, and scraping is against their TOS.

> Don’t misuse our Services. For example, don’t interfere with our Services or try to access them using a method other than the interface and the instructions that we provide.

Despite this, there is scholar.py [0], which can extract files from Google Scholar, though it explicitly doesn't work around the rate limits.

[0] https://github.com/ckreibich/scholar.py

Post reply on HN