Live data from Hacker News

Xg2xg: Lookup table of similar tech and services for ex-Googlers

github.com

71–80 of 133 posts

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#71
post #68

Earlier quoted context omitted.

It’s funny because inside google borgmon is deprecated for new projects and has been since nine years at least. Of course google has stretched “deprecated” to its limits.

I keep seeing that Borgmon is deprecated but no references to what the replacement is like. Can someone please share even a high level summary? Is the replacement a high cardinality event store like Facebook’s Scuba [0]? [0] https://research.fb.com/wp-content/uploads/2016/11/scuba-div...

The replacement (Monarch) is similar to borgmon except:

* All metrics have an associated type. Eg. Response time (milliseconds). That's great because units for derived metrics can be dynamically computed. Eg. Bytes/second.

* The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed (eg. 95 percent latency across 1000 tasks can be calculated in real-time).

* The config system is a mess and nobody likes it. Borgmon uses a DSL which is obscure, but almost identical to Prometheus. Monarch has various different config frontends (mostly around the idea of running code to produce an expanded protobuffer config) which all suck. Luckily because there isn't a strong requirement for rules to aggregate data, you don't need much config for most services - just say "scrape everything and keep it for a year".

* There are "levels" of storage at different speeds. In memory, on disk, etc. You have to configure where to put what data. You can also downsample (eg. Change scrape interval to 5 mins after a week).

* Metric names follow a directory-like heirachy. Since tasks can easily have 10k exported metrics, that's pretty important. No need to scrape the ones that aren't relevant.

* It has a shinier UI.

* It has support for exemplars. So to answer the question "Give me an example of a request which saw this high request latency". With not much added code to the monitored service, a small number of exemplars are captured and aggregated in a way that median and outlier exemplars are available. They're super useful for finding out the cause of random slow performance.

* It is run as a service. Rather than code that every team has to run, the new thing is a single instance for all teams in Google. That in turn means it can be more complex, have more dependencies, etc, without being a burden on the user.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#72

This is pretty misleading: a lot of the presented open source equivalents are nothing like the original. For example, comparing HDFS to Colossus is... optimistic? Having used / worked on/with both, the similarity is roughly that they both store bytes. This would be a lot less misleading if there were annotations and if the "open source/real world" didn't mix together other large companies' products with open source.…

Yeah, HDFS is a toy in comparison. It's barely comparable to the original GFS, which was retired... Almost a decade ago?

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#73
post #61
post #55

What does Google (or others) use for an intranet or team documentation? We're using Quip and it is just a black hole where documents go to die, never be seen again no matter how badly you want to find it.

Can't tell for Google, but Confluence is widely adopted (still I love to hate on it)

The challenge with Confluence - and all documentation systems for that matter - is that it needs a manager, someone who makes sure it's maintained, old / outdated pages get removed, the landing page is neat, and authors are encouraged to keep it updated.

I can imagine that can quickly become a fulltime job though. Still, a formal role of documenter / archivist in a bigger software endeavour should be considered.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#75
post #37
post #29

Earlier quoted context omitted.

So do you get to go home 45-90 minutes earlier then? I think that is what the original comment was questioning.

Most software companies in the Bay Area have flexible time. Just like everywhere else, Google SWEs don't punch a clock. You go home when you feel you've done as much as you can for the day.

I'm jealous; my current job is billed by the hour, so I have to be able to describe every hour I've worked. Mind you that's usually a fixed 8 hour / day logged on project X, so having to write them down isn't a problem. But I can't go home early without feeling guilt; I mean I can, but that also means I have to do overtime sometime else in the month, to make sure the hours all check out at the end of the month.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#76
post #39
post #29

Earlier quoted context omitted.

So do you get to go home 45-90 minutes earlier then? I think that is what the original comment was questioning.

"Free food" mainly means free breakfast, lunch, coffee and snacks. Hardly anyone I know stays late for dinner.

It is nice to know you're being taken care of in the (hopefully rare) cases you do have to work late. And there's probably people working in ops that have an evening shift.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#77
post #10

Great list, and interesting for non-Googlers too. I'd replace, though: Google -> Real World free food -> :( With: free food -> free time

the free food option at google and now my current startup is a huge time saver. It doesn't come at the expense of free time.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#79
post #37

Earlier quoted context omitted.

Most software companies in the Bay Area have flexible time. Just like everywhere else, Google SWEs don't punch a clock. You go home when you feel you've done as much as you can for the day.

I'm jealous; my current job is billed by the hour, so I have to be able to describe every hour I've worked. Mind you that's usually a fixed 8 hour / day logged on project X, so having to write them down isn't a problem. But I can't go home early without feeling guilt; I mean I can, but that also means I have to do overtime sometime else in the month, to make sure the hours all check out at the end of the month.

You have to describe every hour, but not necessarily work every hour.
Post reply on HN