Isn't the stock market a prediction market as well?
No, a stock is a share of ownership in a company. Now yes, people bet on the derivative value of those ownership shares... but that also happens to basically every asset. If a stock is a prediction market, then so is corn, and gold, and your home.
Polymarket bad because it's accessible to everyone, futures trading on the CME good because it's only available to the rich?