Between my experiences at several jobs:
-In office music
-In office shower. Somewhere to store extra clothes and items
-In office kitchen (and a good one at that)
-Bike rack
-Basic bike tools on-hand at office
-Easily accessible set of basic hand and small power tools in office. Stuff happens. You need them.
-Motorcycle parking
-Chair budget. Get what you want/need to work best
-I liked Pixar's office/cube budget, although I've never worked for them, search for it.
-Ability to have whatever keyboard/mouse/display/computer best suited me. Don't make me use the shitty company's logo mousepad if I want something else. Don't force an IDE on me. If I use textmate, allow me to use that. If I'm a vim or emacs guy, allow that. Results matter- not my IDE.
-Give me a software budget, or better yet no budget at all. If I want software that is tangentially related to my work, I should be able to get it
-Massive company library. Geeks love books/knowledge. Being able to take these home is good. Being able to order anything and add to it is even better.
-Food and drinks available.
-Cabs home if needed- no questions asked.
-Ability for me to receive packages at work (that may not be work related). When I have an office I *always* ship my packages there as to not miss them.
-I loved being able to do laundry at betahouse.
-Encourage and pay for employees going to social events, even if they aren't 100% tied to their daily work functions. Social employees are worth much more.
-A 'quiet room' where someone can work/study/sleep without being bothered. A nap/dark room is a good idea too if you can fit it space-wise.
-Your office layout matters. Think how you position people and how the arrangement of power sits. I liked sitting right beside the CEO at my first startup (and we were 20 people, so this wasn't a given). I count him as a good friend because of this.
But also, don't skimp on basic benefits either. Make sure everyone is financially sound. If someone has something they need bailed out of, let them know you are there. The last thing you want is some employee worrying about the bills from replacing a major appliance that blew up at home. Issue small loans, or better yet, convenient bonuses on a need-only basis. Make sure your employees are healthy. Find out what they actually feel about their health insurance. Most younger employees will not care, but a few will. Listen to them. You want them healthy and happy- their families too. Most companies these days skimp on partner healthcare and no longer support the needs of a family.
Other small things that we miss now in society do matter to people.
-Anniversaries, birthdays and important dates to that person. Doing more that just posting to facebook is a way to show thoughtfulness. This can just be a card.
-Even in politically correct 2010 and with many of us working at home, we do have holidays that we appreciate having noticed. Small gifts are very noticed.
-Just as you want your employee to go above and beyond, think about how you can go above and beyond for them. This will come back to you.