You should be able to evaluate someone's ability to program without ever asking them to write any code, or without them ever having even heard of the language you're going to have them programming in. I've never met a programming language that I couldn't learn and be competent at in about a week. Everything about programming has nothing to do with particular languages. The "you need 5 years of java experience" is the…
However i think in order to evaluate someones ability to program, you do need to ask them to program. The language may not matter too much but the ability to think coherently and organize a solution is a skill that can't get easily picked up in a week.