it would be a really nice product experience if you could click on a book (in the recommendations), then get recommendations for that book, and so on
Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
261–270 of 275 posts
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#262it would be a really nice product experience if you could click on a book (in the recommendations), then get recommendations for that book, and so on
Do you just adding the similar button that the input books have to the output books?
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#263I've entered books from The Expanse and Lockwood & Co series and its output was not really overwhelming: - other books from the series (duh, I don't need a recommender for that recommendation) - Hobbit, Harry Potter, Azimov etc (duh, I like scifi and surely I've already read all the classic works).
Hi, I just added something called maximal marginal relevance which should give you much less repetitive recommendations.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#264Earlier quoted context omitted.
Yes I would say the handling of series is probably the biggest problem. Once my test metrics got to a point I was happy with and my quality spot checks passed (can I follow the models recommendations from one generic history book to Steven Runciman, also making sure popular books don't always dominate the results), I was ready to release because I had been working on this project for so long. The solution is probably…
Not just series, but I seem to mostly get a list of other books from the same authors. The recommendations from other authors are good, but as far as I can tell I’ve read every single one of them. Continuing to aggressively add everything it recommends eventually does seem to result in some interesting books I wasn’t familiar with, but I also end up with more and more books that are of zero interest to me. For what i…
I just introduced something [1] which should give you much less repetitive recommendations if you want to try again.
[1] https://www.cs.cmu.edu/~jgc/publication/The_Use_MMR_Diversit...
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#265I would love to be able to filter the resulting list by removing certainly all books that in the same series but I think removing all books by authors that I have already listed would be great to get new things that I haven't already read. The resulting recommendations maybe included 1 new book for me.
I did not add what you requested exactly because I think in many cases authors have written less popular books that people may not be aware of but if you try again you should see less highly repetitive things like 5 of the same series in a row in the results.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#266Import doesn't work for me.
Can you access your profile page in incognito (ie is your account public)? Alternatively, if you have more than 5000 books in your shelf, that might break it. I just tried a number of users and I was able to import them all.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#267Import doesn't work for me.
Can you access your profile page in incognito (ie is your account public)? Alternatively, if you have more than 5000 books in your shelf, that might break it. I just tried a number of users and I was able to import them all.
Ah. My fault. I put the whole URL in the User ID box instead of just the User ID.
Do you know how your model compares to Cinematch's SVD? Does your model use only books rated highly or also include low rated ones?
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#268Earlier quoted context omitted.
Fairly meaningless in this day and age. Also IIRC scraping legality depends heavily on jurisdiction. Some places take a more permissive view of accessing publicly available information, even if a site's TOS forbids bots. In the US there’s a major precedent [0] which held that scraping public-facing pages isn’t a CFAA "unauthorized access" issue. That’s a big part of why we’ve seen entire venture-backed scraping compa…
Tell that to judyrecords with the same smug attitude. Your textbook versus reality conceptualization of things is dogshit. It’s exploitation to do what OP did. You’re endorsing it and minimizing the ethics and this certainly shall poison the well from which you drink. Godspeed.
You ok bud? You sound unhinged here. You post doesn't even make sense in context of the one you were replying to.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#269Earlier quoted context omitted.
Can you access your profile page in incognito (ie is your account public)? Alternatively, if you have more than 5000 books in your shelf, that might break it. I just tried a number of users and I was able to import them all.
Ah. My fault. I put the whole URL in the User ID box instead of just the User ID. Do you know how your model compares to Cinematch's SVD? Does your model use only books rated highly or also include low rated ones?
I am not familiar with Cinematch, is there a writeup about it? When training I used every input book and did not include ratings as a feature. In the future I want to experiment with treating 1 or 2 star ratings as negative feedback.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#270I tried to import my book list with "Import goodreads" button and inputting https://www.goodreads.com/user/show/68515148-andrew but it said "import failed, see console"
Hi, I just realized that the confusion here was that you are only supposed to input the numeric user ID. I just limited the form to numbers only and updated the description to make this more clear.