I live in Detroit, own a 4bed/2bath and bike to work everyday for a mortgage that's less than 1/4 of the rent median SF 1br. SF is a cartoon world. Yes salaries are less here, but I feel so much more at ease owning my place and can live a pretty comfortable life. If worst comes to worst, there is always remote work.
I live in Baltimore, which is only a notch above Detroit in people's minds (we're talking perceptions here...). I work remotely and can afford to live a life I'd only dream about in Brooklyn, NY: Great apartment, great neighborhood, and enough disposable income left over for travel and other activities.
Baltimore seems like a great place. Plus you have the advantage to ultra-commute to DC if you need to.