Note that this is much more dangerous than visiting a website. ANSI escape sequences can seriously mess with your system, RCE included.
Are you being hyperbolic or do you seriously think the attack surface area of ANSI escape sequences is 'much more' than, say, Javascrpt?