Live data from Hacker News

Gmail having issues

google.com

281–290 of 460 posts

Re: Gmail having issues

#281
post #162

Earlier quoted context omitted.

How do the public gmail addresses compare to the enterprise (used to be G Suite, now Google Workspace) ones?

Anecdotally, my enterprise account seems unaffected.

Also anecdotally, during the outage, test messages from my non-gmail account to my standalone/non-enterprise gmail accounts consistently bounced; test messages from my non-gmail account to my G Suite Business-associated account went through.

Re: Gmail having issues

#282

Earlier quoted context omitted.

I don’t work at Google, I’m at a different big tech that’s in the news frequently. Sharing inside info on an ongoing incident is a great way to get fired. Big tech companies are way different than startups where everyone can do a bit of anything. There are people whose job it is to handle that communication. You make their job a lot harder if you disclose information. The company is so big that as an engineer you may…

Stop being such a corporate slave. These companies wouldn’t hesitate to kick you out on the street if they had to

He literally just said they wouldn't hesitate to kick you out on the street if they had to

Re: Gmail having issues

#283

As quite a few googlers appear to read and write on HN, I'd really welcome an insider info on what's going on the last few days. Sure there will be some internal turmoil going on right now, but isn't there some non-confidential info to share? Can't imagine this will hurt the image of google neither in the short nor long run, quite the opposite.

In lieu of an actual Googler, how about some educated speculation? It blows my mind that Google can even have problems like this. Aren't their apps highly distributed across tons of CDNs? Don't they have world class Devops people that roll out changes in a piecemeal fashion to check for bugs? How exactly can they have an issue that can affect a huge swath of their customers across countries? Insight appreciated.

Ex-Googler here.

Yes, apps are highly distributed. Yes, roll-outs are staggered and controlled.

But some things are necessarily global. Things like your Google account are global (what went down the other day). Of course you can (and Google does) design such a system such that it's distributed and tolerant of any given piece failing. But it's still one system. And so, if something goes wrong in a new and exciting way... It might just happen to hit the service globally.

When things go down, it's because something weird happened. You don't hear about all the times the regular process prevented downtime... because things don't go down.

Re: Gmail having issues

#284

Remember, free and open source software is more reliable: ( https://www.gnu.org/software/reliability.en.html ) "One reason is that free software gets the whole community involved in working together to fix problems. Users not only report bugs, they even fix bugs and send in fixes. Users work together, conversing by email, to get to the bottom of a problem and make the software work trouble-free." And Service as a Sof…

Funny how you always see this comment in this type of thread

Re: Gmail having issues

#285

Earlier quoted context omitted.

This is the Nightmare Scenario for mailing lists. Many of them auto-unsubscribe after a bounce.

I said this in another comment but this seems like a naive way to react to an "address does not exist error" that they've already delivered to before. The only legit scenario in which that happens is when the user deletes the address, which is a rare event (pretty much always The underlying issue (wherever this occurs) seems to be lack of nuance regarding error codes when people try to implement robust systems. Diffe…

Aside - I'm not an expert but systems like MailChimp will get very worked up if your list has lots of undeliverable addresses on it. This can trigger an audit of your list which prevents sending, etc. These audits seem to take quite a while, in my very limited experience.

Re: Gmail having issues

#286
post #272

Earlier quoted context omitted.

I don’t work at Google, I’m at a different big tech that’s in the news frequently. Sharing inside info on an ongoing incident is a great way to get fired. Big tech companies are way different than startups where everyone can do a bit of anything. There are people whose job it is to handle that communication. You make their job a lot harder if you disclose information. The company is so big that as an engineer you may…

What you're saying makes sense but I don't think it really applies to anything the OP said. The "non-confidential" qualifier indicates to me that they only want people to share what they can responsibly.

And the parent post’s point is that there are people whose job it is to specifically share that information, and so we should let them do their job. They are the domain expert in this particular task.

Re: Gmail having issues

#287

Earlier quoted context omitted.

Out of all the companies Google might be relying on in their back-end, I think Oracle is probably pretty far down the list.

I can’t imagine what part of Google’s history would lead someone to believe there was any third party system in their production stack anywhere.

Well, google did use a bunch of off the shelf technologies in the early days, but now it is obvious that there is no vendor on earth that could supply the infrastructure to run Gmail.

Re: Gmail having issues

#288
post #102

Earlier quoted context omitted.

I speculate that for many companies, work from home has been at most, less impacting than they thought. However, I'd speculate that in this instance, when you get that .0001% problem, less hands on deck makes work from home aspects less easier. Akin to remotely fixing somebodies PC over standing behind them. With that premise I'd speculate in this instance that whilst not the root cause, may of been a small ripple th…

You might be right for the smaller company where physical access to the machines in the data center is necessary at a certain point in the troubleshooting process. I work at such a place myself. I would guess, however, that Google moved beyond that quite some time ago. It's simply not practical, with or without having offices with people in them.

All the access to the services is remote, but I'd say having the entire team in the same room does help coordinate incident response.

Re: Gmail having issues

#289

Earlier quoted context omitted.

Out of all the companies Google might be relying on in their back-end, I think Oracle is probably pretty far down the list.

I can’t imagine what part of Google’s history would lead someone to believe there was any third party system in their production stack anywhere.

Now their corporate/finance stack on the other hand... shudder.

Re: Gmail having issues

#290

Earlier quoted context omitted.

I don’t work at Google, I’m at a different big tech that’s in the news frequently. Sharing inside info on an ongoing incident is a great way to get fired. Big tech companies are way different than startups where everyone can do a bit of anything. There are people whose job it is to handle that communication. You make their job a lot harder if you disclose information. The company is so big that as an engineer you may…

Stop being such a corporate slave. These companies wouldn’t hesitate to kick you out on the street if they had to

> These companies wouldn’t hesitate to kick you out on the street if they had to

> Sharing inside info on an ongoing incident is a great way to get fired

You're not disagreeing.

Post reply on HN