Live data from Hacker News

Fake Amazon Tech Book Reviews Are Hurting My Book

blogs.perl.org

41–50 of 124 posts

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#41
post #37

Earlier quoted context omitted.

That's awful. Has no one automated the process of checking for bogus reviews and reporting them?

How do you tell a bogus review from a real one, except by having it actually read by a human? This would be pretty expensive.

Expensive or not, Amazon has an obligation to make sure their review system has high integrity and is not "gamed" or no one will trust Amazon reviews anymore.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#42
post #37

Earlier quoted context omitted.

That's awful. Has no one automated the process of checking for bogus reviews and reporting them?

How do you tell a bogus review from a real one, except by having it actually read by a human? This would be pretty expensive.

Reviews that all mention the same book, or even have little or no content, and have the same rating are suspicious and easily detectable by a trivial scan and compare against existing reviews. A harder problem is when the bogus review content becomes more "clever" (e.g. random rating differences, "entropy" in the content e.g. by misspellings, etc.).

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#43

Much like search engines combat black hat SEO, amazon and reviews systems can do the same. It would not be to hard too for amazon. Use reviews that are a 'Verified Purchase' and highly 'helpful' reviews as a training/test set. Then machine learn a weighting to every review based on the (product, reviewer, other reviews, etc features...) The outcome could actually hinder tactics like this for products that game the sy…

In this case, the positive fake reviews are for verified purchases of ebooks that are relatively cheap... I'd suggest reviews from accounts more than 2 years old, with over 5 reviews, and more than $500 spent would probably be a better baseline for training.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#44
post #37

Earlier quoted context omitted.

That's awful. Has no one automated the process of checking for bogus reviews and reporting them?

How do you tell a bogus review from a real one, except by having it actually read by a human? This would be pretty expensive.

Probably apply ML techniques. Similar to how spam is classified - build a classifier that determines the likelihood of a review being bogus, then flag it for human review if it exceeds a certain threshold.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#45
post #23

In light of that recent article about computer-generated prose being in many cases indistinguishable from human-written, I'd say those fake reviews are likely written by a computer. Notice that they're mostly of the form "I didn't think I'd be interested in [TOPIC] but [TITLE] was really interesting and really helped me learn about [TOPIC]."

That's an interesting thought. I'm pretty sure I could write up a nice grammar to chunk out "interesting" reviews of books. Instead of whining about my book getting buried by fake reviews, maybe I should chuck it and cache in on said reviews!

If you can't beat them, join them! Of course your comment was meant sarcastically, but I wonder if authors(of genuine books not the spammy ones) might turn to posting fake reviews and justify it by saying that they have no other choice.

We can see this happening in the case of SEO with many white hat sites employing black/gray hat techniques simply to maintain their current positions in Google.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#46
post #31

Earlier quoted context omitted.

There should be very obvious ways to identify "review bots" - especially given that reviews are tied to an amazon accounts purchase and browsing history. That they don't have an efficient algorithm for this sounds more like they don't really care and never bothered with it.

I'd say it's more likely that this is a complex problem, and will take a bit of time and computing power to work through... Amazon has hundreds of thousands of products with tens of millions of reviews... correlating that with log history for each review will take a lot of time... not just to run, but to write any automated process, and work through resolving it. It seems to me that Amazon seems to be pretty responsi…

> I'd say it's more likely that this is a complex problem, and will take a bit of time and computing power to work through...

It is a complex problem - but amazon has a serious advantage over other sites that have to deal with such issues (i.e. Twitter) - in that they have significantly more information on each user. I don't think Amazon is short on computing power either.

Taking into account order and browsing history, product review trends, linguistic similarities in review posts etc. They should be able to get very low error rates in identification.

Further unlike something like twitter feeds, it's quite possibly to silently de-prioritize abusive reviewers and associated products. Really, I'm quite surprised at how bad of a job they are doing - most of these cases are so blatant and obvious they should not require an author and a live representative to resolve.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#47
post #37

Earlier quoted context omitted.

That's awful. Has no one automated the process of checking for bogus reviews and reporting them?

How do you tell a bogus review from a real one, except by having it actually read by a human? This would be pretty expensive.

The good news is that you don't need to read all the books, because many bogus reviews tend to be written by the same "customers". Simply seeing a correlation of bad books getting good reviews, would result in those "customers" losing their ranking power from their reviews.

What's bad (really bad) here, is that not only are the books that are being ranked highly absolute crap, but they are crap in different categories. I.E. A "book" on swift, that was apparently "written", in a few hours, shoved onto Amazon, falsely ranked up - now ranks ahead of a 700 page opus on Perl, in the Perl category.

That's a total fail on Amazon's part, and really, really disappointing.

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#48
post #23

In light of that recent article about computer-generated prose being in many cases indistinguishable from human-written, I'd say those fake reviews are likely written by a computer. Notice that they're mostly of the form "I didn't think I'd be interested in [TOPIC] but [TITLE] was really interesting and really helped me learn about [TOPIC]."

That's an interesting thought. I'm pretty sure I could write up a nice grammar to chunk out "interesting" reviews of books. Instead of whining about my book getting buried by fake reviews, maybe I should chuck it and cache in on said reviews!

Are you really suggesting the best solution is to make the reviews more broken and useless?

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#49
post #37

Earlier quoted context omitted.

That's awful. Has no one automated the process of checking for bogus reviews and reporting them?

How do you tell a bogus review from a real one, except by having it actually read by a human? This would be pretty expensive.

Amazon Mechanical Turk?

Re: Fake Amazon Tech Book Reviews Are Hurting My Book

#50

How about writing high-quality responses to the bad reviews? I have seen this done by some authors and it usually stops the meaningless reviews, since each additional spam review only creates a new opportunity for the author to present their marketing perspective via comment. If this were a novel, economically hostile and unsubstantiated feedback would be considered economic warfare.

This is a romantic idea, but the obvious problem is that bad computer generated reviews are cheap and easy to produce, so there are naturally too many of them for the author to reply to individually.
Post reply on HN