Automatic Colorization

I was just thinking yesterday while reading https://news.ycombinator.com/item?id=13678255 (Street life in london) that I would like to see it colorized.

You can colorise your own photos by using this web form on Algorithmia: http://demos.algorithmia.com/colorize-photos/

In my experience most colorisation looks very smudgy, does not "colour in between the lines", and generally seems to make things look sepia with low contrast - however I'd like to see this problem investigated more to see how good it can get - perhaps we could end up doing similar things for astral objects?