Tell HN: Wells Fargo completely offline • Hacker News Board

Re: Tell HN: Wells Fargo completely offline

#101

Post by tatersolid » Thu, Feb 07, 2019, 11:03 PM UTC

legohead wrote: post #94

clairity wrote: post #75

for those who haven't taken the plunge, now is a good time to move to a credit union, regional bank, or online bank: - for instance, in cali: https://www.golden1.com/ - high interest accounts: https://www.bankrate.com/banking/checking/best-checking-acco... - good rate online bank: https://empower.me/ get better service, lower/no fees, and good convenience without all the economy-damaging selfishness and hubris.

I imagine a credit union would be susceptible to the same type of thing (single location/point of failure) due to their smaller sizes.

Credit unions and small banks outsource almost all of their core systems to companies like Fiserv. Literally thousands of banks and CUs all ride their infrastructure

Re: Tell HN: Wells Fargo completely offline

#102

Post by dakial1 » Thu, Feb 07, 2019, 11:03 PM UTC

mabbo wrote: post #12

nemothekid wrote: post #7

Apparently there was a fire in a Datacenter - theres a thread on /r/sysadmin by an insider. https://np.reddit.com/r/sysadmin/comments/ao4g2y/wells_fargo...

Incredible. They had all their mission-critical infrastructure in a single data center. How many billions of dollars do they make per year? And they can't afford even a tiny bit of redundancy? If I were a customer, I'd use this as a sign that this company is not technically competent enough to manage my money.

Maybe this had something to do with it... https://searchdatacenter.techtarget.com/news/4500243727/Well...

Re: Tell HN: Wells Fargo completely offline

#103

Post by amaccuish » Thu, Feb 07, 2019, 11:03 PM UTC

deevolution wrote: post #26

Bullish on bitcoin b/c of its highly resilient characteristics. Might not process as many transactions per second and it might pollute more than the average bank, but sure as hell dont need to worry about a natural disaster or freak incident single handedly taking out the entire network.

There's always one...

Re: Tell HN: Wells Fargo completely offline

#104

Post by rixrax » Thu, Feb 07, 2019, 11:04 PM UTC

And I’m not surprised they don’t have a services status page either that many modern companies do offer[0][1][2].

[0] https://api.twitterstat.us [1] https://help.netflix.com/en/is-netflix-down [2] https://developers.facebook.com/status/dashboard/

Re: Tell HN: Wells Fargo completely offline

#105

Post by [deleted] » Thu, Feb 07, 2019, 11:05 PM UTC

mabbo wrote: post #12

nemothekid wrote: post #7

Apparently there was a fire in a Datacenter - theres a thread on /r/sysadmin by an insider. https://np.reddit.com/r/sysadmin/comments/ao4g2y/wells_fargo...

Incredible. They had all their mission-critical infrastructure in a single data center. How many billions of dollars do they make per year? And they can't afford even a tiny bit of redundancy? If I were a customer, I'd use this as a sign that this company is not technically competent enough to manage my money.

[deleted]

Re: Tell HN: Wells Fargo completely offline

#106

Post by danpalmer » Thu, Feb 07, 2019, 11:05 PM UTC

mabbo wrote: post #12

nemothekid wrote: post #7

Apparently there was a fire in a Datacenter - theres a thread on /r/sysadmin by an insider. https://np.reddit.com/r/sysadmin/comments/ao4g2y/wells_fargo...

Incredible. They had all their mission-critical infrastructure in a single data center. How many billions of dollars do they make per year? And they can't afford even a tiny bit of redundancy? If I were a customer, I'd use this as a sign that this company is not technically competent enough to manage my money.

The comment says that they have failovers in place, the just didn’t work correctly.

Re: Tell HN: Wells Fargo completely offline

#107

Post by patio11 » Thu, Feb 07, 2019, 11:07 PM UTC

nodesocket wrote: post #95

patio11 wrote: post #49

Earlier quoted context omitted.

(I work at Stripe.) This does not impact Stripe customers at this time. Specifically, the Stripe API and Instant Payouts are functionally normally. (We're aware of the issues Wells Fargo is experiencing, and have an incident response spun up internally.)

Interesting, I would have thought if the bank API that backs Stripe is unavailable, there would be impacting issues such as payouts.

Speaking generally: Stripe provides an abstraction layer, such that there may not be a 1:1 mapping between features of our platform that you use and particular providers. We also have technical and operational teams, such that when an underlying financial rail has a problem we deal with it so customers do not have to.

Re: Tell HN: Wells Fargo completely offline

#108

Post by linker3000 » Thu, Feb 07, 2019, 11:08 PM UTC

regularfry wrote: post #87

arkades wrote: post #58

Earlier quoted context omitted.

The resultant 12% oxygen is 60% of normal atmospheric air. It's still breathable, if you're an average healthy person with healthy cardiac and pulmonary function, sitting at rest - but it's not healthy, it's enough that you're going to start seeing systemic responses. The reduction in partial pressure of oxygen being sucked into the lungs will also cause an increase in the partial pressure of carbon dioxide and inert…

Possibly more importantly, the "venting" is not what you'd call a gentle breeze. "Explosive atmosphere replacement" is a better description. Solid things will go airborne at speed.

Won't somebody think of the hard drives.

Re: Tell HN: Wells Fargo completely offline

#109

Post by [deleted] » Thu, Feb 07, 2019, 11:10 PM UTC

reaperducer wrote: post #25

bitxbitxbitcoin wrote: post #17

Earlier quoted context omitted.

The next worst thing for electronics after fire - water! Or are there non liquid fire suppression systems such as pulling all the oxygen out of a room (if there aren't any people in it)?

are there non liquid fire suppression systems such as pulling all the oxygen out of a room Yes. One place I worked (not a tech company, but with tons of electronics), when the fire alarms went off we had xx seconds (I don't remember the number) to get out of the building before something called Intergen was vented into the room to somehow suck all of the oxygen out, and if we were still inside we'd be dead. It must b…

[deleted]

Re: Tell HN: Wells Fargo completely offline

#110

Post by gniv » Thu, Feb 07, 2019, 11:10 PM UTC

benj111 wrote: post #100

mabbo wrote: post #12

Earlier quoted context omitted.

Incredible. They had all their mission-critical infrastructure in a single data center. How many billions of dollars do they make per year? And they can't afford even a tiny bit of redundancy? If I were a customer, I'd use this as a sign that this company is not technically competent enough to manage my money.

What kind of redundancy are we talking about here? You can't really roll back say 10 minutes of transactions, so are you maintaining 2 parallel systems? How do you keep them perfectly in sync? This isn't my area of expertise by a long shot, but it occurs to me this is probably hard, especially when your codebase started in the 60s, and has been accreting ever since.

Yes it’s hard but there are mature solutions. See Google Spanner for example.