Earlier quoted context omitted.
I wrote "Obama sucks" and got Dogwhistle, Low Score, Low Effort, Objectionable Phrases, and Negative Tone. I wrote "Trump sucks" and got Low Score, Low Effort, Negative Tone. Definitely a double standard baked in
Double standard, or legitimate difference? Maybe Trump empirically sucks more? (This is the sort of debate I really don't think tooling can fix.)
A tool like this COULD work, but I think the issue with this one is that it's built on top of an existing LLM with heaps of internet debate and their underlying ideals and what is and isn't acceptable baked in.
What a tool like this needs is heaps of honestly / fairly judged comments and feedback, and an extensive test suite that ensures neutrality by, for example, taking the same comment and like in this case changing names around - if it treats both sides the same then it passes.