Earlier quoted context omitted.
If the difference between samples is VERY large, you don't need a very large sample size. In other words, we're trying to find the chance that the result we got was due to chance. Let's say you have numbers like these: A: 11, 11, 12, 12, 13, 13, 13, 13, 13, 13, 14, 15 B: 90, 92, 93, 94, 94, 95, 95, 96, 97, 99, 99, 101, 101 What is the chance that those two samples come from the same distribution? On the other hand, i…
That sounds intuitively reasonable. Is there a cononical reference argument that you're aware of?
Most people just look at the number of subjects in a study, but not the p-values