I believe it. Oddly enough, it's lonely even when there are a couple of you. This is one of the main reasons we do YC in batches. The startups all become one another's friends, because they're all in the same situation. I think it's well worth the inconvenience of moving in order to have a large group of energetic and sympathetic peers. That's the deal with college, after all.
Personally, I have been trying to get picked up by a startup so I have an excuse and a means to move to a better area. How would others here recommend meeting people?