The stats on college attendance would seem to be against you since about 70% of the population doesn't do it or doesn't finish a 4 year degree. Those are normal people. The 30% that do attend college and finish with at least a Bachelor's are the minority.
Yes, school is a social environment for learning, that has value, but it's hardly the only way to obtain that. Outside of school, there are local clubs and hobbie groups, forums and blogs such as this on the Internet, alternate paths such as the military, etc. There are all kinds of ways to be around people who enjoy the same things you do, or are trying to learn the same things you are without going to school.
By saying thats a benefit of school you're implying that it's not obtainable elsewhere. School just isn't that important if you really want to learn, it's more valuable for those that lack motivation and need someone to make them learn.