Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Xg2xg: Lookup table of similar tech and services for ex-Googlers

github.com

Post reply on HN
Print view View original

91–100 of 133 posts

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#91

Post by njepa »

smueller1234 wrote: post #69
randomsearch wrote: post #60

Earlier quoted context omitted.

Isn’t the purpose of the free food to make you spend more time at work? Seems logical that the alternative is more time at home.

Free food is what you make of it. If your income as a Google engineer is so tight that you have to make sure you get the most out of breakfast and dinner, go for it (but also maybe have a long hard think). The culture may well vary between sites, but this idea that Google (and others) exclusively employ fresh college grads and try to embrace then 24x7 just isn't true. We have families just like anyone else, and they…

That is mostly the food part though. I don't think anyone is questioning whether having a quality cafeteria at work is a good idea. It is the incentive to stay at work, especially dinner which can make working late become not working late enough. I am not sure what you mean by the cost? I can't imagine people would care about that.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#92

Post by vthriller »

londons_explore wrote: post #71
wikibob wrote: post #68

Earlier quoted context omitted.

I keep seeing that Borgmon is deprecated but no references to what the replacement is like. Can someone please share even a high level summary? Is the replacement a high cardinality event store like Facebook’s Scuba [0]? [0] https://research.fb.com/wp-content/uploads/2016/11/scuba-div...

The replacement (Monarch) is similar to borgmon except: * All metrics have an associated type. Eg. Response time (milliseconds). That's great because units for derived metrics can be dynamically computed. Eg. Bytes/second. * The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed (eg. 95 percent latency across 1000 tasks can be calculated in real-time). * The…

> The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed

I'm having hard time figuring out how query language might affect exectuion time. Granted, I've never seen borgmon in action, so the first question should probably be: how different its query language is from what Prometheus offers? If it's more on imperative side than declarative one then your point might actually make sense to me as it is.

> You can also downsample (eg. Change scrape interval to 5 mins after a week).

Does it allow different aggregation methods (avg/sum/max/whatever) for different metrics, like Carbon does?

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#93

Post by JOnAgain »

endymi0n wrote: post #84
shereadsthenews wrote: post #19

Earlier quoted context omitted.

It’s funny because inside google borgmon is deprecated for new projects and has been since nine years at least. Of course google has stretched “deprecated” to its limits.

A close source told me only half joking that at Google, when you start any new service, you‘ve got the choice between about a dozen backing services, of which half are deprecated and the other half are not officially supported yet...

I don’t think he was joking at all

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#94

Post by puzzle »

endymi0n wrote: post #84
shereadsthenews wrote: post #19

Earlier quoted context omitted.

It’s funny because inside google borgmon is deprecated for new projects and has been since nine years at least. Of course google has stretched “deprecated” to its limits.

A close source told me only half joking that at Google, when you start any new service, you‘ve got the choice between about a dozen backing services, of which half are deprecated and the other half are not officially supported yet...

The actual proverb, by an engineer (Paul C), is "there are two ways of doing things at Google: the deprecated one, and the one that doesn't work yet". Usually the deprecation occurred when a service outlived the original requirements and was no longer a great fit or not very usable. A good example were Babysitter and GWQ, which were eventually obsoleted by Borg.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#95

Post by mempko »

romka2 wrote: post #89

There is no listed equivalent of RecordIO. What do people use for high-reliability journals? When I needed something like RecordIO to store market data, I couldn't find anything. So I implemented https://github.com/romkatv/ChunkIO . I later learned of https://github.com/google/riegeli (work in progress), which could've saved me a lot of time if only I found it earlier. I think my ChunkIO is a better though.

Would Riak's Bitcask format fit the bill here?

https://riak.com/assets/bitcask-intro.pdf

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#96

Post by Itaxpica »

londons_explore wrote: post #71
wikibob wrote: post #68

Earlier quoted context omitted.

I keep seeing that Borgmon is deprecated but no references to what the replacement is like. Can someone please share even a high level summary? Is the replacement a high cardinality event store like Facebook’s Scuba [0]? [0] https://research.fb.com/wp-content/uploads/2016/11/scuba-div...

The replacement (Monarch) is similar to borgmon except: * All metrics have an associated type. Eg. Response time (milliseconds). That's great because units for derived metrics can be dynamically computed. Eg. Bytes/second. * The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed (eg. 95 percent latency across 1000 tasks can be calculated in real-time). * The…

The fact that Monarch configs can be written in Python instead of Borgmon is a huge win for our team; being able to write and debug our own alerting rather than have to bug SREs every time has been worth the switch alone.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#97

Post by Itaxpica »

randomsearch wrote: post #60
QuercusMax wrote: post #25

Earlier quoted context omitted.

Not sure why you think free food is traded for free time. Free food helps me use my time at work more effectively. I usually have breakfast and lunch with teammates, and it's a mix of socialization and work-related conversations. Half an hour in the free cafe > 45-90 minutes going someplace to buy food.

Isn’t the purpose of the free food to make you spend more time at work? Seems logical that the alternative is more time at home.

Free food was originally introduced to Google in part because there were so few food options near the Mountain View campus that people were driving a half hour each way to spend twenty minutes eating. So yes, the goal was to get people to spend more time at work, but the alternative was “time spent sitting in traffic” rather than “time spent at home”.

(The other major driver behind food was supposedly the fact that the founders were PhD students and had found that some of their best ideas had arisen from informal discussions with other researchers over lunch, so they wanted to create an environment where employees had that same opportunity)

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#98

Post by shereadsthenews »

vthriller wrote: post #92
londons_explore wrote: post #71

Earlier quoted context omitted.

The replacement (Monarch) is similar to borgmon except: * All metrics have an associated type. Eg. Response time (milliseconds). That's great because units for derived metrics can be dynamically computed. Eg. Bytes/second. * The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed (eg. 95 percent latency across 1000 tasks can be calculated in real-time). * The…

> The query language can fairly efficiently compute metrics at query time rather than needing everything precomputed I'm having hard time figuring out how query language might affect exectuion time. Granted, I've never seen borgmon in action, so the first question should probably be: how different its query language is from what Prometheus offers? If it's more on imperative side than declarative one then your point m…

I think what he is saying is that it is easier to do something ad hoc in Monarch since it is a global service with unified storage and retrieval. A Googler can join the data of Gmail and Ads easily if they want, whereas combining the borgmon data of those services is either not possible or it involves downloading CSVs and performing the join externally.

> Does it allow different aggregation methods (avg/sum/max/whatever) for different metrics, like Carbon does?

All of these methods are available[1]. Stackdriver Monitioring is the public face of Monarch.

1: https://cloud.google.com/monitoring/api/ref_v3/rest/v3/proje...

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#99

Post by joshstrange »

anton_kosyakov wrote: post #82
jaytaylor wrote: post #26

Is there something comparable to the web-based IDE called Cider? Now that Amazon took cloud9 (c9.io) out of the market, it seems like there is a sizeable void. I want web-based Spacemacs or Evil! Or even just intelli-j.

You should check out Gitpod ( https://www.gitpod.io ). It was launched recently and provides disposable, ready-to-code development environments for GitHub projects: https://dev.to/svenefftinge/introducing-gitpod-frictionless-... IDE is based on Theia ( https://theia-ide.org ), i.e. VS Code with cloud-first mindset.

Hmm, I was looking at Gitpod's pricing page and I do not at all like that clicking on the "Gitpod for teams" link takes me immediately to github to auth my account, uh no thanks.

Re: Xg2xg: Lookup table of similar tech and services for ex-Googlers

#100

Post by shereadsthenews »

romka2 wrote: post #89

There is no listed equivalent of RecordIO. What do people use for high-reliability journals? When I needed something like RecordIO to store market data, I couldn't find anything. So I implemented https://github.com/romkatv/ChunkIO . I later learned of https://github.com/google/riegeli (work in progress), which could've saved me a lot of time if only I found it earlier. I think my ChunkIO is a better though.

That appears to be exactly RecordIO. It even has transposition. Is there a reason that doesn't meet your requirements?

Edit: it even includes an open source implementation of Cord, which they've renamed to Chain for some reason.

Post reply on HN