Earlier quoted context omitted.
Pretend your headphones only moved with 8-bit resolution. There is no possible way the experiment could derive a useful conclusion, but you might trick yourself into thinking it did. Especially if your sample size was 10,000 people. More realistically, the participant might choose music for which no 24-bit recording exists. It's very important to control for every variable. It's actually not possible to gather info a…
More realistically, the participant might choose music for which no 24-bit recording exists. Well, obviously we'd need to have a limited set of music selections for which we have 24-bit recordings. As you suggest, I expect the biggest impact on playback fidelity is going to be other factors like the noise in the system (likely a PC) and such. But the flip side of it is that's also a good real world test. If the only…
Hey, that's a great point! Hadn't considered that.
Proving "most people can't tell the difference between 24-bit and 16-bit in real-world settings" is less compelling than proving "no one can ever tell the difference," but it's still very relevant.