If you're a New Yorker the answer should always be "No".
Probably fine if you're not planning to hang out with the faux-elite in the Meatpacking District.
If you have to do it, this is the only appropriate way to rock shorts in the city: http://leroyjenkinslimited.com/2013-summer/