Live data from Hacker News

Why and how GitHub is adopting OpenTelemetry

github.blog

21–30 of 113 posts

Re: Why and how GitHub is adopting OpenTelemetry

#21
I’m now gravely concerned about GitHub after reading this.

So now I should be excited about telemetry and that GitHub uses this in their systems?

This raises alarm bells into if I should be using them for my repositories at all.

Unsure if I should trust GitHub after this now.

Downvoters: I don’t understand here? So I should be excited about telemetry? Why?

Re: Why and how GitHub is adopting OpenTelemetry

#22
post #12

A lot of very confused weird comments here. This article is about a fairly large sized tech company adopting a fairly recent but increasingly mainstream & popular tool that helps them understand their operations. It'll give them a standard way to see what their computers are doing, across their various systems. OpenTelemetry is one of the key emerging cloud standards, and I expect many many many many more articles li…

Agreed. This comment section is bizarre for HN. It's sort of like getting scared that "Prometheus" collects "metrics". Or that "Kafka" tracks "events".

These aren't scary things.

Re: Why and how GitHub is adopting OpenTelemetry

#23
post #12

A lot of very confused weird comments here. This article is about a fairly large sized tech company adopting a fairly recent but increasingly mainstream & popular tool that helps them understand their operations. It'll give them a standard way to see what their computers are doing, across their various systems. OpenTelemetry is one of the key emerging cloud standards, and I expect many many many many more articles li…

Even other responses to your comment are confused. The primary use case is to trace requests that go through your backend of distributed microservices. The fact that it can also be used to collect PII-adjacent data as in sibling's example is about as relevant as the fact that it uses the HTTP protocol. I didn't see any similar comments raging against the HTTP protocol on the last curl post that came through here.

People here are blindly rage-triggered by the word "telemetry" without even taking 2 seconds to glance through to see what it actually is.

Re: Why and how GitHub is adopting OpenTelemetry

#24
post #12

A lot of very confused weird comments here. This article is about a fairly large sized tech company adopting a fairly recent but increasingly mainstream & popular tool that helps them understand their operations. It'll give them a standard way to see what their computers are doing, across their various systems. OpenTelemetry is one of the key emerging cloud standards, and I expect many many many many more articles li…

Agreed. This comment section is bizarre for HN. It's sort of like getting scared that "Prometheus" collects "metrics". Or that "Kafka" tracks "events". These aren't scary things.

"Telemetry" has come to be associated with activities that definitely qualify a product as spyware (though they've become fairly common—thanks, "data-driven" marketers).

From reading the OpenTelemetry site, that doesn't seem to be their main, stated purpose, but thefounder's post in another part of the thread leads me to think it may, in fact, see that kind of use, too.

[EDIT] damn, sorry, downvoters, for explaining the reason this is getting knee-jerk negative reactions from people, when someone expressed confusion about it. Again, I think the main reason is the word used, and what it's mostly associated with now, among some folks.

Re: Why and how GitHub is adopting OpenTelemetry

#25
post #12

A lot of very confused weird comments here. This article is about a fairly large sized tech company adopting a fairly recent but increasingly mainstream & popular tool that helps them understand their operations. It'll give them a standard way to see what their computers are doing, across their various systems. OpenTelemetry is one of the key emerging cloud standards, and I expect many many many many more articles li…

Wait, you said:

> I haven't heard of a single case of them being used for user tracking or behavioral analytics.

and then you said:

> That we will start to see the potential to harvest these records for analytics…

So this can be used to gather analytics of any sort of data, such as spying then? This is still worrisome.

Re: Why and how GitHub is adopting OpenTelemetry

#26

I think it would be great to show the performance impact of these SDKs because it is one of the really important aspects of monitoring (being non-intrusive).

Look into envoy/istio - e.g. these introduce side-processes (sidecars) where your process talks to, and these create the traces for you at some perf cost. There are proxies for some of the existing services - like mysql - https://www.envoyproxy.io/docs/envoy/latest/configuration/li...

I haven't used it myself, I've used census, and now looking into OpenTelemetry (though from the least finished version - C++). Had mixed success with it in the past, but trying again. Also not looking at all into side-cars, etc. - We compile all our internal tools, so adding this inside is where I'm getting into.

I've had several times (while at Google), being asked by an SRE that I would call on issues, and they would request to bump the sample tracing from minimal defaults (was it 1 in 100,000 or million - forget) sometimes to 1:1 - for say 30 seconds. This way they'll receive on their end (in their systems that we use) flags to sample too, and at the end get full logs.

Usually the whole trace is visible in few minutes. There were few UI's (nothign like zipkin/jaeged/others outside) - some of them with very "imgui"-like hacky (in good sense) view - like programmer art all over (which I loved - it was much more condensed than standard zipkin/jaeger).

You could've marked something as important, and it'll retain for longer period - otherwise - poof - soon gone. Also it would collect info sometimes directly from the machine it was in (rather than wait to populate).

Obviously, I don't know the details - I was just an user, or more like - allowing (when oncall) trace sampling to be bumped by the SRE - so they would get more info. It's what hooked me actually, because how else would one get everything end-to-end.

Surprisingly it's also useful for single apps, where you have threads (or concurrency tasks, like with TBB/ConCRT) doing nested parallel_for's or spawning jobs, and you want to get idea what's going on. The only tricky bit is how to get your "context" propagated from one thread to another (also not readily done).

It's one thing that the "golan" got right with their context for example.

So it's really awesome, but probably really hard to get right the first few times.

Re: Why and how GitHub is adopting OpenTelemetry

#27

I’m now gravely concerned about GitHub after reading this. So now I should be excited about telemetry and that GitHub uses this in their systems? This raises alarm bells into if I should be using them for my repositories at all. Unsure if I should trust GitHub after this now. Downvoters: I don’t understand here? So I should be excited about telemetry? Why?

I believe you (and many others here) have misunderstood the article. They are talking about telemetry on their backend systems to track performance metrics and the like. Not the usual telemetry that HN loves to argue about.

Re: Why and how GitHub is adopting OpenTelemetry

#28

Earlier quoted context omitted.

Agreed. This comment section is bizarre for HN. It's sort of like getting scared that "Prometheus" collects "metrics". Or that "Kafka" tracks "events". These aren't scary things.

"Telemetry" has come to be associated with activities that definitely qualify a product as spyware (though they've become fairly common—thanks, "data-driven" marketers). From reading the OpenTelemetry site, that doesn't seem to be their main, stated purpose, but thefounder's post in another part of the thread leads me to think it may, in fact, see that kind of use, too. [EDIT] damn, sorry, downvoters, for explaining…

Every tool is also a weapon, obviously. We haven't stopped making hammers because they can be used to hit people.

Re: Why and how GitHub is adopting OpenTelemetry

#29

I’m now gravely concerned about GitHub after reading this. So now I should be excited about telemetry and that GitHub uses this in their systems? This raises alarm bells into if I should be using them for my repositories at all. Unsure if I should trust GitHub after this now. Downvoters: I don’t understand here? So I should be excited about telemetry? Why?

[deleted]

Re: Why and how GitHub is adopting OpenTelemetry

#30

Earlier quoted context omitted.

"Telemetry" has come to be associated with activities that definitely qualify a product as spyware (though they've become fairly common—thanks, "data-driven" marketers). From reading the OpenTelemetry site, that doesn't seem to be their main, stated purpose, but thefounder's post in another part of the thread leads me to think it may, in fact, see that kind of use, too. [EDIT] damn, sorry, downvoters, for explaining…

Every tool is also a weapon, obviously. We haven't stopped making hammers because they can be used to hit people.

It's why people are making these assumptions about the term "telemetry". In certain circles it usually means spyware. One of those circles includes front-end web, which is pretty well-represented on HN.

[EDIT] and, especially, that's why they're jumping to the conclusion that github is gearing up to do more spying on its users, which is the part that I think people are bothered by, not the existence of this software package.

Post reply on HN