The US not only has SWIFT, the US government basically controls it; they’re the ones who cut off Russia. In my experience the US was probably slightly ahead of the UK in terms of cards being accepted everywhere rather than needing cash. All of my utility bills have been on electronic autopay for years along with all of my other bills and I write a paper check probably less than once a year.
I don’t know what a “physical email” is. I occasionally receive bills in the postal mail (mixed in with all the spam our postal service likes to deliver every day as some sort of sick and twisted jobs program) but they usually have a QR code I can scan to pay them online.
Social security numbers are de facto national identification numbers. The US is a federation of fifty states so photo ID cards are issued at the state level, similar to how your national ID in Europe will be issued by Spain or Estonia rather than the EU itself. But you can use a passport or even get a passport card instead if you really want to.
“E-government” is a broad subject. In some use cases (internet voting) I don’t trust it one bit. In other use cases (filing and paying taxes or instant background checks), we have it covered. And in yet other use cases (buying health insurance), it was actually easier to do online before the government took it over, at least in my experience. My previous state set up an online system to file for unemployment during COVID but then lost millions of taxpayer dollars to overseas scammers who would steal the identities of residents at random and file for unemployment in their names; a better system probably could have been implemented if it wasn’t done at the last minute and with zero verification.