There is a class of prediction markets that are useful and seem immune to most of these problems : play money prediction markets. I've been enjoying them for years; I feel they provide a useful service to understand what is going on in the world, and they don't seem to provide the perverse incentives that we are seeing here. Oh, and they seem to work just as well.
These "competitive forecasting" platforms seem very interesting. What do you need to be good at this sort of skill?
- things rarely change,
- noise dominates most measurements,
- a good story is not evidence,
- it is very rarely possible to know things more certainly than 10--90 %.
Phrases to look up are "confirmation bias", "availability heuristic", "uncertainty calibration", "outside view", "Fermi method".