Live data from Hacker News

Does the internet have a 1 star review problem?

news.ycombinator.com

11–20 of 27 posts

Re: Does the internet have a 1 star review problem?

#11

What you’re describing is the natural quality of community driven data. Not only do users not have critic credibility, there’s nothing to lose, they’re almost anonymous. I can’t think of a non oppressive way to regulate unhinged ratings. On sites like here or Reddit, I’ve noticed users do a pretty consistent job of policing through karma. But I’ve also seen comments get downvoted because again, low credibility, human…

> On sites like here or Reddit, I’ve noticed users do a pretty consistent job of policing through karma.

They do a decent job at downvoting/flagging spam and obvious harassment.

However, if you post something that is just ever so slightly unpopular or polarizing, you will receive the same torrent of downvotes. This makes it very hard to discuss things where you don't agree with the majority.

I would assume reviews have the same problem. Even if you had a wonderful time at a ressort, it's unlikely that this is true for evrery guest. Some guests will have a poor experience, and if they post about it they will be called a liar.

Re: Does the internet have a 1 star review problem?

#12
post #10

No, it has 5 star problem. It is way too common and misleading to give average service or products 5 stars... This ruins the entire point of rating system and makes it nigh unusable...

I'm terrified at some of the suggestions here. Weighting negative reviews across all the fake 5 star reviews on Amazon? Seriously? The 1-3 star reviews are the only way to get remotely at the truth of a product. The problem is that you can't just take the number. You have to evaluate the text and compare it across other reviews manually and individually based on your own preferences and needs.

Re: Does the internet have a 1 star review problem?

#13
Do you remember that Black Mirror episode where people rated each other?

https://en.wikipedia.org/wiki/Nosedive_(Black_Mirror)

Anyway, the problem with 5 star based rating is that everything below 5 star will actually hurt your rating, so it become sort of binary: 5 Star is OK, everything else is bad.

Re: Does the internet have a 1 star review problem?

#14
post #2

What you can do against such blackmail: Allow comments. The owner can then explain it.

This is the answer. A good review system will allow owner comments on each review, even ones without text. Google Maps is quite good in this - even if the place has lower rating, if the owner comments sensibly on each negative review, that's a huge plus.

Re: Does the internet have a 1 star review problem?

#15
post #10

No, it has 5 star problem. It is way too common and misleading to give average service or products 5 stars... This ruins the entire point of rating system and makes it nigh unusable...

On certain platforms, the average is 4.9 stars. The platform used to be nice, now it's filled with counterfeits and low quality items that look nothing as promised.

This item has 4.7 stars: https://shopee.com.my/product/110830198/5438249668?smtt=0.0....

It's a Monopoly game by the "Paker Brothers". I see 5 star reviews that say "board has been ripped, street names are wrong, tokens are made of cheap plastic, delivery a week late. But I got what I paid for." There's several which praise it for good quality. Come on, I can see "Company of Distribution of Electricity" from your video.

It has a 100% authenticity guarantee by the platform too.

Re: Does the internet have a 1 star review problem?

#16
post #2

What you can do against such blackmail: Allow comments. The owner can then explain it.

In most systems that do this, my 1 star review is countered by another 1 star review.

I had a contractor fail to do the simplest possible task (write a XML layout for a login screen). Gave him a 1 star. He threatened to give me a 1 star too if I didn't change the review, and did so as promised.

However, I have seen owners explain that certain reviews were part of a targeted attack to damage the owner's reputation, so I think it's the fairest approach.

Re: Does the internet have a 1 star review problem?

#17
Contributing to manage a small hotel (imagine it as a middle level one, nothing fancy, nothing bad, a very average one, with affordable prices), I can confirm that bad user reviews are very often "inaccurate" in the sense that they are heavily influenced by the on-the-spot (hopefully momentary) irritation of the guest at this or that (often a very minor thing or an absolutely ridicolous request) or even because they simply had a hard day and something was a little less than pure perfection in the check-in process or similar.

Being "average" and having "average" prices, we tend to have a few 5 star reviews, many 3 and 4 star reviews and a handful of 1 or 2 star one, of course.

Last 1 star review we had was about a couple that around 23:00 on a saturday night (having checked in at 20:00) lamented that they could hear the noise of an air conditioning machine (true, for some reason there was a vibration that could be heard from the room in the silence of the night) and pretended that we should fix it right now and then, immediately, refusing to move to another room (perfectly silent) that was offered to them because "it was too late".

Surely enough the next day there was a 1 star review, of course without saying that a room change was immediately offered.

The one before this was a couple years before (literally):

>Terrible

>The light on the bedside wasn't working.

What I noticed since the advent of these booking/review sites are two things:

1) the customers instead of asking for a room change or telling immediately to the reception whatever is wrong stay silent and then a day or two after post the bad review, often just the valuation without comments, so that there is no way for us to understand what "triggered" the 1 star

2) a number of people (could it be because they use smartphones and they mis-click on something?) post (good or bad) reviews that are clearly related to other hotels, I have a 4 star one (so, a good one) stating how the location is perfect, near the falls (there are no falls that I know of in a 200 km radius from here) though the swimming pools are a tadbit dated (we have no swimming pool) and it is a pity that check-in is not possible after 23:00 (we are open 24/7)

Re: Does the internet have a 1 star review problem?

#18
The internet and our society has a problem with nuance. Surprisingly people have different backgrounds, different experiences and different expectations.

I always try to filter out all the positive reviews from Americans when travelling in Italy or France as Americans tend to view things more positively, romanticize average food and places and in general cant really judge the quality of the establishments in those countries.

On the other hand I very much value americans commenting on Michelin* and similarly priced restaurants as americans visiting these places usually have more experience (and obviously $) dining in such places and can objectively judge quality of the food.

Re: Does the internet have a 1 star review problem?

#19

What you’re describing is the natural quality of community driven data. Not only do users not have critic credibility, there’s nothing to lose, they’re almost anonymous. I can’t think of a non oppressive way to regulate unhinged ratings. On sites like here or Reddit, I’ve noticed users do a pretty consistent job of policing through karma. But I’ve also seen comments get downvoted because again, low credibility, human…

> On sites like here or Reddit, I’ve noticed users do a pretty consistent job of policing through karma. They do a decent job at downvoting/flagging spam and obvious harassment. However, if you post something that is just ever so slightly unpopular or polarizing, you will receive the same torrent of downvotes. This makes it very hard to discuss things where you don't agree with the majority. I would assume reviews ha…

Sorting by "controversial" can occasionally be illuminating.

This of course depends on whether or not mods remove unpopular opinions, and/or ban people providing them.

Re: Does the internet have a 1 star review problem?

#20
I ignore all 1 star and 5 star reviews. They both are rubber stamping a binary vibe instead of giving real reviews. The SaaS vendors who penalize less than 5 star reviews are as much to blame as the angry folk who give 1 star reviews for minor reasons. When reading reviews, I look at people who took some actual time to make comments and give ratings in the middle.

So the answer is yes - the internet in general has a review problem, but knowing that upfront can at least help parse the information.

Post reply on HN