You'd do well to wear a suit to any job interview. Programmer or not, startup or not, walking into an interview in a suit conveys a sense of professionalism. First impressions are hard to change. So start off well. Also, I'd take the advice of those who who say "Wear sandals and a t-shirt" with a grain of salt - I suspect that the majority of people who give that advice are not (and haven't ever been) in a position t…
You're assuming that a suit always provides a good impression. That's not automatic, especially if you're interviewing at a small, casual company that is trying to maintain a specific kind of casual, fun work culture. Like, say...a startup.
Even companies looking to maintain a casual, fun work culture should appreciate their candidates attempting to present themselves in a professional way. If an interviewer casts someone in a negative light because they wore a suit... I'll go out on a limb and risk getting flamed by saying that this person probably shouldn't be responsible for hiring in the first place.