This is really interesting, I've been wanting to learn more about Torch for a while but have been reluctant to commit to learning Lua.
I use it more and more for hobby projects. Combine it with LuaJIT (which torch uses) and you have the fastest interpreted language around. Give it a try.