Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

Post reply on HN
Print view View original

161–170 of 275 posts

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#161

Post by kemotep »

croes wrote: post #158
pantropy wrote: post #143

Earlier quoted context omitted.

Technically speaking none of Goodreads material or content is being used publically, the only information displayed on the site is freely available (Title, Author) and not Goodread's property. You could try to argue that this falls under "create derivative works from any materials or content accessible on the Service" but even then it seems really flimsy to say that recommending books based on Goodread reviews is an…

I visit your garden and take 1 apple from your tree I visit your garden and take 1000 apples from your tree. Not that different.

Not only am I taking 1,000 apples, but I use those 1,000 apples to start my own orchard and encourage people to come to it instead of yours.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#162

Post by simianparrot »

kemotep wrote: post #161
croes wrote: post #158

Earlier quoted context omitted.

I visit your garden and take 1 apple from your tree I visit your garden and take 1000 apples from your tree. Not that different.

Not only am I taking 1,000 apples, but I use those 1,000 apples to start my own orchard and encourage people to come to it instead of yours.

Yeah but if I program a drone swarm to automate this process it’s for the greater good — more apples for everyone!

And I only charge a tiny subscription for access to all my drone-managed orchards, you can eat as many apples as you want. But don’t steal any and start your own orchard or I sue.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#163

Post by fridental »

I've entered books from The Expanse and Lockwood & Co series and its output was not really overwhelming: - other books from the series (duh, I don't need a recommender for that recommendation) - Hobbit, Harry Potter, Azimov etc (duh, I like scifi and surely I've already read all the classic works).

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#165

Post by MichaelBosworth »

voidUpdate wrote: post #124

Does this break part 4 of the Goodreads TOS? "[...] you agree not to sell, license, rent, modify, distribute, copy, reproduce, transmit, publicly display, publicly perform, publish, adapt, edit or create derivative works from any materials or content accessible on the Service. Use of the Goodreads Content or materials on the Service for any purpose not expressly permitted by this Agreement is strictly prohibited." Al…

What expectation of confidentiality are you ascribing to people having posted publicly accessible opinions on the internet?

Out of curiosity, is your point about TOS out of concern for the poster or for Goodreads?

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#167

Post by paulnpace »

exe34 wrote: post #160
esskay wrote: post #135

Earlier quoted context omitted.

Fairly meaningless in this day and age. Also IIRC scraping legality depends heavily on jurisdiction. Some places take a more permissive view of accessing publicly available information, even if a site's TOS forbids bots. In the US there’s a major precedent [0] which held that scraping public-facing pages isn’t a CFAA "unauthorized access" issue. That’s a big part of why we’ve seen entire venture-backed scraping compa…

it's only legal if you have a team of lawyers though. the law still applies to the rest of us.

It is the future: I own nothing, and I've never been happier. They can sue me and take nothing.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#168

Post by paulnpace »

diffeomorphism wrote: post #141

The robots.txt is pretty explicit that this scraping is "disallowed" https://www.goodreads.com/robots.txt So legalities aside, this seems unethical.

It is truly criminal that such a bright and brilliant model of ethics, Amazon, should endure such an attack.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#170

Post by tonyhart7 »

voidUpdate wrote: post #145
pantropy wrote: post #143

Earlier quoted context omitted.

Technically speaking none of Goodreads material or content is being used publically, the only information displayed on the site is freely available (Title, Author) and not Goodread's property. You could try to argue that this falls under "create derivative works from any materials or content accessible on the Service" but even then it seems really flimsy to say that recommending books based on Goodread reviews is an…

I'd be impressed if a youtuber could read 3 billion reviews and recommend books to you based on that

what about youtuber that build a machine that scrape 3 billions books and make recommendation based on the data????
Post reply on HN