I used to use construction 'headphones'. They do nothing but dampen outside noise - no music. It's a pretty good solution ... but a solution to a stupid problem because the right solution is more productive working conditions.
It certainly would be conspicuous.