They likely rely on a localStorage which isn't available in private mode.
Why doesn't Firefox allow localStorage, and just delete it when you leave the site?
I’m curious to know the answer here as well. I’m not a Firefox user, but given how common it is for sites to use localstorage, this is a really surprising design decision.