Earlier quoted context omitted.
In the U.S. it is quite common for grocery stores to have a small bank branch inside them for exactly the reason you cite.
Grocery stores or Walmart?
Wal-marts cash checks, do money transfers, and provide debit cards which act as a pseudo-bank account since they can be used with direct deposit etc.