Earlier quoted context omitted.
So does this mean something like crowd sourced scoring of sentiment does better than algorithmic detection? Or do people suck just as badly?
Short answer: yes, crowd sourcing would work better. Long answer: It's difficult to determine how good/bad people actually are at detecting the correct sentiment, as data sets containing phrase/sentence sentiment pairs are often created by majority decision of human taggers. E.g. 7 people are given the same training examples and whatever most of them choose is then used as "correct" answer (gold standard). This might…
I think letting a number of people read the text and choosing the majority vote as the text's sentiment might not actually be a very bad way of determining that.