Earlier quoted context omitted.
They also say, 'Liberty', 'In God We Trust', & 'E Pluribus Unum'. Lots of writing on government-issued materials is false, ceremonial, outdated, or overridden by later acts. If it really bothers you, you can file that off your pennies before spending them at 5¢ value. We won't mind.
I would check 18 U.S. Code §331 (fraudulently defacing currency) before doing that.
But also, when was the last prosecution for defacing a coin in the United States?
What sort of monster would call the police on a fellow person for passing a damaged penny?
How would the prosecution's burden of proof be met?
(Be a currency hacker, like Satoshi or Woz – https://hackaday.com/2012/08/03/woz-prints-and-spend-his-own... – not someone whose actions are limited by obscure dead-letter laws.)