Brewing a Better Rating System
blog.steepster.com
Brewing a Better Rating System
1–10 of 38 posts
Re: Brewing a Better Rating System
#2I feel like this really combines the best of the granular 4 star systems with the specificity of a percentage rating. Really good stuff, I'd be interested to hear a follow up with user feedback on this approach and how it holds up long term.
Re: Brewing a Better Rating System
#3I love that the sliding meter shows tick marks for your previous rankings of other teas - the UI reflects that your judgement of a particular tea is relative to your other experiences.
Re: Brewing a Better Rating System
#4Hi, I'm Mike from Steepster. We thought we'd share our new ratings system we just deployed with HN as we think it's relevant for products with customer reviews, ratings, etc. It's our attempt to combat the 4.3 dilemma (discussed here recently: http://news.ycombinator.com/item?id=883890).
Background: Steepster is a community site for tea drinkers to share their tasting notes, get recommendations, and discover new teas.
Feedback appreciated!
Re: Brewing a Better Rating System
#5This is THE best implementation of a ratings system I've seen. Very good job.
Re: Brewing a Better Rating System
#6[deleted]
Re: Brewing a Better Rating System
#7Hi, I'm Mike from Steepster. We thought we'd share our new ratings system we just deployed with HN as we think it's relevant for products with customer reviews, ratings, etc. It's our attempt to combat the 4.3 dilemma (discussed here recently: http://news.ycombinator.com/item?id=883890 ). Background: Steepster is a community site for tea drinkers to share their tasting notes, get recommendations, and discover new tea…
Mike, great job on this. Very informative. I have 2 questions for you:
1. is your slider from the jQuery UI or other js framework?
2. in regards to combating the 4.3 dilemma, have you found the average ratings on steepster to be lower? maybe its too early to tell, but I'd love to see some sort of curve on your ratings distribution in a future post ...
thanks
Re: Brewing a Better Rating System
#8Hi, I'm Mike from Steepster. We thought we'd share our new ratings system we just deployed with HN as we think it's relevant for products with customer reviews, ratings, etc. It's our attempt to combat the 4.3 dilemma (discussed here recently: http://news.ycombinator.com/item?id=883890 ). Background: Steepster is a community site for tea drinkers to share their tasting notes, get recommendations, and discover new tea…
Mike, great job on this. Very informative. I have 2 questions for you: 1. is your slider from the jQuery UI or other js framework? 2. in regards to combating the 4.3 dilemma, have you found the average ratings on steepster to be lower? maybe its too early to tell, but I'd love to see some sort of curve on your ratings distribution in a future post ... thanks
Thanks, callmeed.
1. Yep, slider implementation is jQuery UI.
2. It is too early to tell, but we're definitely planning to share a follow up. As mentioned in the post, we had a simple thumbs up/down for ratings and were seeing a greater than 90% positive average, so we were definitely experiencing that bias. Just today, albeit with a much too small sample size, we're starting to see a more diverse mix of averages. We still expect to have that positive skew but because we're now operating with a 100 point scale in the UI, we hope the granularity will help users distinguish subtler differences in rating.
Re: Brewing a Better Rating System
#9In this context, it looks like the user has incentive to rate (to get better suggestions), but on rating in general:
Why even ask people how they feel?
Depending on the content, you can analysis how they use it to get a much more accurate rating. For video: Did they watch the entire thing? Did they leave after a few seconds? Did they share it somehow?
That (slightly off-topic) being said, this looks great.
Re: Brewing a Better Rating System
#10I love that the sliding meter shows tick marks for your previous rankings of other teas - the UI reflects that your judgement of a particular tea is relative to your other experiences.
Exactly. I think the tick marks are the killer feature here. Great idea!