For example, I live in Thunder Bay, Ontario, and there are a lot of grants specific to our region because we're considered a northern community. Since we're smaller, there's less competition, and more people will be willing to help you and promote your startup.
Also, if you're startup is involved in medical research, definitely consider Thunder Bay because there is a big medical research community and it's one of the areas the city is trying really hard to build up.
Take a look at these websites for more information: http://www.nwoinnovation.ca/ http://www.tbrri.com/ (for medical related startups)
Lastly, the cost of living in places like Thunder Bay (in particular housing) is much more affordable.