"Sometimes students don't fit in"? Is that really your description of what a kid who wants to be a good student in a bad neighborhood often suffers at the hands of his classmates?
The claim that good schools are good because of small class sizes and higher teacher pay, that it is as simple as that and that there is "really no debate" is false. Pointing out that A and B are not the only factors, it's not as simple as that, that there is plenty of debate, and describing an additional factor beyond just A & B is not "dismissing" A and B.
Consider the scenario I described: a large school district with multiple neighborhoods where the admin, funding, class sizes, teacher pay, etc., are the same but the student bodies differ. You might be able to equalize outcomes by giving the lower-performing school smaller classes and better-paid teachers, or you might not, but even if you did, you would then have to explain why a school with smaller classes and better-paid teachers wasn't doing any better than one without those features. The answer would remain the same: because there are other factors that matter, too. It's not as simple as just smaller classes and better pay for teachers, and there is plenty of debate about what factors matter and how much.