Earlier quoted context omitted.
This is a bit out of date. These days basically any ATM allows foreign cards, just in time for Japan to finally switch to electronic payments in a big way (in particular PayPay).
Yes. The payments landscape has shifted pretty dramatically in Japan over just the past 3 years. It used to be that you had to worry about getting cash, IC cards, refilling said IC cards, going to an actual bank with your passport, etc. Now all you need is an iPhone (although I hear Android phones from outside Japan still can't use suica).
An Indian friend of mine (who lives in the US) told me it's similar to when he visits family in India; none of the digital transit cards work for him because the system won't accept his US payment cards.
(I have an Android phone which has the right FeliCa hardware, but it's disabled in software so Google doesn't have to pay the licensing for it.)