Cloudflare Experiencing Latency Issues • Hacker News Board

Re: Cloudflare Experiencing Latency Issues

#31

Post by jgrahamc » Thu, Dec 16, 2021, 9:35 PM UTC

tentacleuno wrote: post #12

jgrahamc wrote: post #8

Should be cleared up now. Sorry about that.

I really like it when people in your position at such a big company post on here, even if it is a brief comment like this. Thank you!

I would have posted faster but I was too busy doing my own little bit of debugging which consisted of

    1. dig @1.1.1.1 jgc.org
    2. nc -v 104.22.11.223 80
    3. curl -v https://jgc.org/cdn-cgi/trace
    4. curl -v https://jgc.org/

Hmm #1 was fast so network is routing OK. Hmm #2 was fast so TCP is OK. Hmm #3 was fast so I know (because I worked on that code) that this code path is good. Hmm #4 is slow so that means component X is slow but still working.

Of course, in parallel I'm in a conference call with about 40 other people who have actual access to monitoring and systems and other things who can see exactly where things are.

But I was damn close with four commands and gave me confidence in what people were saying. But, I have to say, Cloudflare's internal distributed tracing system is pretty cool because I got sent a trace and you could see right where the slowdown was.

Re: Cloudflare Experiencing Latency Issues

#32

Post by tailspin2019 » Thu, Dec 16, 2021, 9:37 PM UTC

jgrahamc wrote: post #31

tentacleuno wrote: post #12

Earlier quoted context omitted.

I really like it when people in your position at such a big company post on here, even if it is a brief comment like this. Thank you!

I would have posted faster but I was too busy doing my own little bit of debugging which consisted of 1. dig @1.1.1.1 jgc.org 2. nc -v 104.22.11.223 80 3. curl -v https://jgc.org/cdn-cgi/trace 4. curl -v https://jgc.org/ Hmm #1 was fast so network is routing OK. Hmm #2 was fast so TCP is OK. Hmm #3 was fast so I know (because I worked on that code) that this code path is good. Hmm #4 is slow so that means component X…

Now you're just showing off :)

Re: Cloudflare Experiencing Latency Issues

#33

Post by ziddoap » Thu, Dec 16, 2021, 9:38 PM UTC

Buttons840 wrote: post #30

sneak wrote: post #23

Earlier quoted context omitted.

In my experience, a lot of Americans interpret direct, no-wasted-word statements as aggressive or confrontational. Euphemism and indirect implication is the norm in American communication, much to my dismay. It can wrap around to extremes sometimes, too. https://sneak.berlin/20191201/american-communication/

This reminds me of the younger generation sometimes perceiving messages ending in a period as rude. I'm also sometimes surprised by how effectively a simple statement like "I don't want to spend money on that" can shut down even a pushy salesman. Or even the simple "No." can work wonders.

>This reminds me of the younger generation sometimes perceiving messages ending in a period as rude.

I've never seen any comments regarding a single period, but I've seen comments (and sometimes agree with them) regarding the perceived rudeness when ending messages in ellipses.

"Good job..." seems almost sarcastic compared to "Good job.".

Re: Cloudflare Experiencing Latency Issues

#34

Post by jedilord » Thu, Dec 16, 2021, 9:39 PM UTC

sneak wrote: post #29

jedilord wrote: post #26

Earlier quoted context omitted.

This is a fair statement. Didn't use to be this way - I blame the participation trophy era of kids.

You're engaging in it yourself right now by using euphemism/implication to suggest a certain type of person instead of just saying "whiny, overly sensitive children" (which I assume is what you mean). You should remove the plank from your own eye, first. You don't get to blame others for your voluntarily chosen courses of action.

You're fast! Good job. I present you with a trophy.

Re: Cloudflare Experiencing Latency Issues

#35

Post by stillicidious » Thu, Dec 16, 2021, 9:40 PM UTC

jgrahamc wrote: post #31

tentacleuno wrote: post #12

Earlier quoted context omitted.

I really like it when people in your position at such a big company post on here, even if it is a brief comment like this. Thank you!

I would have posted faster but I was too busy doing my own little bit of debugging which consisted of 1. dig @1.1.1.1 jgc.org 2. nc -v 104.22.11.223 80 3. curl -v https://jgc.org/cdn-cgi/trace 4. curl -v https://jgc.org/ Hmm #1 was fast so network is routing OK. Hmm #2 was fast so TCP is OK. Hmm #3 was fast so I know (because I worked on that code) that this code path is good. Hmm #4 is slow so that means component X…

I'm glad commenting on HN takes priority over notifying your enterprise customers.

Re: Cloudflare Experiencing Latency Issues

#36

Post by jgrahamc » Thu, Dec 16, 2021, 9:41 PM UTC

stillicidious wrote: post #35

jgrahamc wrote: post #31

Earlier quoted context omitted.

I would have posted faster but I was too busy doing my own little bit of debugging which consisted of 1. dig @1.1.1.1 jgc.org 2. nc -v 104.22.11.223 80 3. curl -v https://jgc.org/cdn-cgi/trace 4. curl -v https://jgc.org/ Hmm #1 was fast so network is routing OK. Hmm #2 was fast so TCP is OK. Hmm #3 was fast so I know (because I worked on that code) that this code path is good. Hmm #4 is slow so that means component X…

I'm glad commenting on HN takes priority over notifying your enterprise customers.

We have whole teams of people to get status up and inform people and support them.

Re: Cloudflare Experiencing Latency Issues

#37

Post by stillicidious » Thu, Dec 16, 2021, 9:42 PM UTC

jgrahamc wrote: post #36

stillicidious wrote: post #35

Earlier quoted context omitted.

I'm glad commenting on HN takes priority over notifying your enterprise customers.

We have whole teams of people to get status up and inform people and support them.

And yet I'm learning about this outage from HN. How did that happen?

Re: Cloudflare Experiencing Latency Issues

#38

Post by jgrahamc » Thu, Dec 16, 2021, 9:44 PM UTC

stillicidious wrote: post #37

jgrahamc wrote: post #36

Earlier quoted context omitted.

We have whole teams of people to get status up and inform people and support them.

And yet I'm learning about this outage from HN. How did that happen?

Suggest subscribing on https://www.cloudflarestatus.com/ as that was updated long before I came to HN to say anything (which was only after the incident was resolved).

Re: Cloudflare Experiencing Latency Issues

#39

Post by sneak » Thu, Dec 16, 2021, 9:44 PM UTC

ziddoap wrote: post #33

Buttons840 wrote: post #30

Earlier quoted context omitted.

This reminds me of the younger generation sometimes perceiving messages ending in a period as rude. I'm also sometimes surprised by how effectively a simple statement like "I don't want to spend money on that" can shut down even a pushy salesman. Or even the simple "No." can work wonders.

> This reminds me of the younger generation sometimes perceiving messages ending in a period as rude. I've never seen any comments regarding a single period, but I've seen comments (and sometimes agree with them) regarding the perceived rudeness when ending messages in ellipses. "Good job..." seems almost sarcastic compared to "Good job.".

    Good job.

seems almost patronizing in comparison with

    good job

Then again, I grew up on IRC.

Re: Cloudflare Experiencing Latency Issues

#40

Post by [deleted] » Thu, Dec 16, 2021, 9:45 PM UTC

jedilord wrote: post #34

sneak wrote: post #29

Earlier quoted context omitted.

You're engaging in it yourself right now by using euphemism/implication to suggest a certain type of person instead of just saying "whiny, overly sensitive children" (which I assume is what you mean). You should remove the plank from your own eye, first. You don't get to blame others for your voluntarily chosen courses of action.

You're fast! Good job. I present you with a trophy.

[deleted]