Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

book.sv

Post reply on HN
Print view View original

271–275 of 275 posts

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#271

Post by costco »

tristor wrote: post #72

Two bugs to know about. First, you are using a deprecated API call that fails in Firefox. Second, you are using an HTTP endpoint that fails to upgrade to HTTPS to call the GoodReads API, which also fails with HTTPS-Only enabled in both Chrome and Firefox. The idea seems good, but since I can't import my GoodReads successfully, it's hard for me to try

OK, I think the problem was that you are only supposed to input the user ID number. I just limited the form to numbers only and updated the description to make this more clear.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#272

Post by zeroonetwothree »

It would be nice to have a way to filter to authors not included in the input. Generally it’s not hard for me to realize that if I like one book by an author I might like another. Finding different authors is where I need help.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#273

Post by mhb »

costco wrote: post #269
mhb wrote: post #267

Earlier quoted context omitted.

Ah. My fault. I put the whole URL in the User ID box instead of just the User ID. Do you know how your model compares to Cinematch's SVD? Does your model use only books rated highly or also include low rated ones?

I am not familiar with Cinematch, is there a writeup about it? When training I used every input book and did not include ratings as a feature. In the future I want to experiment with treating 1 or 2 star ratings as negative feedback.

You can start reading here: https://en.wikipedia.org/wiki/Netflix_Prize

Netflix used to have a great recommendation engine based on what you liked/disliked. It included all of their members ratings. They had a contest in which they offered $1M to anyone who could improve their algorithm by 10%. The winning team used some kind of customized version of Singular Value Decomposition. The algorithm is public.

I think it is essential to use the negative ratings.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#274

Post by zeroonetwothree »

Svoka wrote: post #196

Honestly, with this I see same results as with any other recommendation system - I type some nice Sci-fi/Fantasy I read, it give me generic Sci-Fi fantasy I already read. Even those I really didn't like. I add those I like to the list, ignoring those I didn't, and in the end I just end up with recommendations I already read and didn't like. I feel like wasted my time yet with another smart recommendation system.

Yes, it is missing some kind of negative feedback.

Re: Show HN: I scraped 3B Goodreads reviews to train a better recommendation model

#275

Post by tristor »

costco wrote: post #84
tristor wrote: post #72

Two bugs to know about. First, you are using a deprecated API call that fails in Firefox. Second, you are using an HTTP endpoint that fails to upgrade to HTTPS to call the GoodReads API, which also fails with HTTPS-Only enabled in both Chrome and Firefox. The idea seems good, but since I can't import my GoodReads successfully, it's hard for me to try

I use `fetch` on relative endpoints so that's odd. There shouldn't be any external API calls on my website other than whatever the Cloudflare captcha uses. I also use HTTPS-only in Chrome and did not experience any issues. I just tested Firefox with HTTPS-only on/off and Safari on my phone and I was able to import shelves for multiple users. Are you sure that you do not have any privacy settings on (can you access yo…

I was able to replicate the user-facing error, but the errors originally logged in the console are now resolved, but instead it seems to blow up inside of Firefox with `AbortError: Actor 'Conduits' destroyed before query 'RuntimeMessage' was resolved 2 ConduitsParent.sys.mjs:383 _raceResponses resource://gre/modules/ConduitsParent.sys.mjs:383`

This looks like you might be using concurrency in your JS for the import and a timeout is being hit?

Post reply on HN