Do you have any thoughts on how SASRec compares with the SVD-based Cinematch algorithm?
Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
241–250 of 275 posts
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#242Care to share the scrapped data? I would love to play around with it.
Not sure if I can. At the very least book descriptions most likely could not be distributed. There is an academic dataset with around 200M reviews though: https://cseweb.ucsd.edu/~jmcauley/datasets/goodreads.html
[deleted]
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#243Earlier quoted context omitted.
Fairly meaningless in this day and age. Also IIRC scraping legality depends heavily on jurisdiction. Some places take a more permissive view of accessing publicly available information, even if a site's TOS forbids bots. In the US there’s a major precedent [0] which held that scraping public-facing pages isn’t a CFAA "unauthorized access" issue. That’s a big part of why we’ve seen entire venture-backed scraping compa…
So if you are legally allowed to "adapt, edit or create derivative works from any materials", what's the point of the TOS?
The TOS specify the circumstances in which the corp may take action that is unrelated to the legal system. Just because they can't sue you (and easily win) for scraping, doesn't mean they can't block you if they notice you doing it.
Google for example has a TOS and is well known for permanently banning accounts for real or imagined or AI-generated violations of it. Google banning you for breaking TOS doesn't mean you broke the law, just that you broke their rules, which apparently include a clause against being in the wrong place at the wrong time.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#244Awesome site and speed! My advice from someone who has built recommendation systems: Now comes the hard part! It seems like a lot of the feedback here is that it's operating pretty heavily like a content based system system, which is fine. But this is where you can probably start evaluating on other metrics like serendipity, novelty, etc. One of the best things I did for recommender systems in production is having di…
Speaking of TF-IDF I once added it “after” the recommendations to downscore items that were too popular and tended to be recommended too much/with too many other items (think Beatles/iphone) and inversely for more niche items. It might be too costly too do depending on how you generate the recommendations though.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#245Care to share the scrapped data? I would love to play around with it.
Not sure if I can. At the very least book descriptions most likely could not be distributed. There is an academic dataset with around 200M reviews though: https://cseweb.ucsd.edu/~jmcauley/datasets/goodreads.html
So you're ok with stealing the data yourself but not ok with providing it to others, ironic.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#246Earlier quoted context omitted.
Technically speaking none of Goodreads material or content is being used publically, the only information displayed on the site is freely available (Title, Author) and not Goodread's property. You could try to argue that this falls under "create derivative works from any materials or content accessible on the Service" but even then it seems really flimsy to say that recommending books based on Goodread reviews is an…
I visit your garden and take 1 apple from your tree I visit your garden and take 1000 apples from your tree. Not that different.
For every apple I take, you still have your apple on the tree, because my apple is only a copy of yours.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#247I love this site, and the approach! Great seeing someone making good use of Goodreads data. Sadly my experience with the book recommender isn't too great because of the 64 book limit. If I import either the most recent or least recent 64 book, 95% of the books it recommends to me are books I've read. Though it was helpful for spotting a few books I've read that I didn't log on Goodreads. Guess I'm pretty consistent.
I think I will expand the input books limit (sadly requires retraining) and or the output books limit of 30.
I ended up playing with it more and found the recommended useful! I just removed a bunch of books of a certain theme, then got a bunch of good recs for the theme that remains.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#248Super cool tool!
Feature request: Be able to import all my goodreads books, unread as well. Not only 64. Most of the recommendations were already on my shelf.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#249Earlier quoted context omitted.
Fairly meaningless in this day and age. Also IIRC scraping legality depends heavily on jurisdiction. Some places take a more permissive view of accessing publicly available information, even if a site's TOS forbids bots. In the US there’s a major precedent [0] which held that scraping public-facing pages isn’t a CFAA "unauthorized access" issue. That’s a big part of why we’ve seen entire venture-backed scraping compa…
From that article: > However, after further appeal in another court, hiQ was found to be in breach of LinkedIn's terms, and there was a settlement. So why would the same not apply here?
A settlement means there was no legal ruling and no precedent set. The entire case is legally moot.
In America, you can simply pay to not lose any lawsuit ever, and thus never have to face legal consequence or changes to the law you don't like.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#250[deleted]