I have "too many books" to add more to books I like and I've read almost all of the recommendations...
Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
191–200 of 275 posts
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#192Does this break part 4 of the Goodreads TOS? "[...] you agree not to sell, license, rent, modify, distribute, copy, reproduce, transmit, publicly display, publicly perform, publish, adapt, edit or create derivative works from any materials or content accessible on the Service. Use of the Goodreads Content or materials on the Service for any purpose not expressly permitted by this Agreement is strictly prohibited." Al…
If it's on the internet, and people can access it, then it's public. I would have no expectations for what people do with public data; that just seems like setting yourself up for disappointment.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#193Does this break part 4 of the Goodreads TOS? "[...] you agree not to sell, license, rent, modify, distribute, copy, reproduce, transmit, publicly display, publicly perform, publish, adapt, edit or create derivative works from any materials or content accessible on the Service. Use of the Goodreads Content or materials on the Service for any purpose not expressly permitted by this Agreement is strictly prohibited." Al…
Fairly meaningless in this day and age. Also IIRC scraping legality depends heavily on jurisdiction. Some places take a more permissive view of accessing publicly available information, even if a site's TOS forbids bots. In the US there’s a major precedent [0] which held that scraping public-facing pages isn’t a CFAA "unauthorized access" issue. That’s a big part of why we’ve seen entire venture-backed scraping compa…
Tell that to judyrecords with the same smug attitude.
Your textbook versus reality conceptualization of things is dogshit. It’s exploitation to do what OP did. You’re endorsing it and minimizing the ethics and this certainly shall poison the well from which you drink. Godspeed.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#194Wow I wonder how fun conversations in the afterlife with Aaron are going to be for the OP. There are ways to improve broken systems. Pimping them out with glee is not one of them in my book.
Everything about this concept I hate and it’s difficult not to conflate that with the creator. I make comparisons and equivocations. This is an ethical discussion akin to “Can you enjoy Bill Cosby comedy knowing he was a Rapist” and I’m not being glib.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#195Earlier quoted context omitted.
Unethical behavior does not become good just because it happens to hurt "bad people" (or more accurately, companies bought by bad people).
Using a sword to stab someone is evil, therefore, stabbing someone who is stabbing me with a sword is evil?
Another factor is that Amazon is big enough that crawling a minor website under their umbrella for a noncommercial project is unlikely to notably affect them.
Stabbing people with swords is evil, unless they are so big that to them it's at worst a light poke with a fork
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#196Honestly, with this I see same results as with any other recommendation system - I type some nice Sci-fi/Fantasy I read, it give me generic Sci-Fi fantasy I already read. Even those I really didn't like.
I add those I like to the list, ignoring those I didn't, and in the end I just end up with recommendations I already read and didn't like.
I feel like wasted my time yet with another smart recommendation system.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#197so sick!! always wanted to do something like this but would use it for my saas (https://bookhead.net), so i'm hesitant to scrape goodreads due to their terms of service.
in addition to the goodreads data, i think it would be interesting to add an author's favorite books by scraping their paris review interviews (and other interviews) and using that as a "review" because i've learned about so much good stuff through an artist mention.
and in a retail context, i've always wondered if a recommendation engine like this could have its own "flavor" based on a specific store's customer buying history. like if a bookstore's customers were weighted in the algorithm so that their similarities scores were given preference. much of what a bookstore carries is based on their customers' taste. you could use the goodreads etc as the base recommendations and then train it on a bookstore's sales history.
a project like this is a bit outside of my expertise but i have a tiny bit of knowledge about it, and now i have a lot more to learn after seeing this. if anybody has any good book recommendations (hehe) or papers i should read to learn about these sort of systems, please let me know!
thank you for sharing!!
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#198Earlier quoted context omitted.
I've been trying to convince myself I'd be able to live like Diogenes, sleep in the streets, bathe in the sea and just generally survive off scraps - but I think that only works if other people can afford to throw away scraps.
If you live in the west it’s no problem - the amount of waste there is insane
It won't be after the billionaires own everything and the rest are living off scraps already.
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#199This seems like it should be an easy task for an AI to implement. For example, the question "what is the most helpful rated negative review of the book 'Original Sin' by Jake Tapper?" There are obvious and prominent "helpfulness" ratings of reviews, but they don't seem to be scraped, at least not by Gemini. Additionally, Gemini reports seemingly inaccurate or minimal effort information:
"It is difficult to pinpoint a single "most helpful" negative review of Original Sin by Jake Tapper, as helpfulness ratings on platforms like Amazon or Goodreads are dynamic and subjective, and the provided search results *do not include specific user reviews with their respective helpfulness votes*."
Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model
#200The problem with recommender engines is they're always recommending the most popular books that are in the same vein as what you've already read. So you're always getting pop-culture pap and not actually-interesting, somewhat more niche and unrelated books that are only tangentially related. The recommendations I got were all pop-psych stuff and other titles by the authors I've already read.