Live data from Hacker News

Never trust a system that seems to be working

twitter.com

291–300 of 376 posts

Re: Never trust a system that seems to be working

#292
post #70

Earlier quoted context omitted.

Experienced sysadmins see the occasional chatter of problems in logs and emails as the pulse of the system, the EKG hooked up to the patient letting you know how things are going. The right level of logging is usually enough to be annoying but not so annoying you need to reduce it. That means you're hopefully thorough enough in the logging that you're reporting what you care about and the things you see are the the t…

> because that only scales so far (but surprisingly far for diligent admins) Surprisingly far. We log terabytes of data a day, most of it is unnecessary. I've been trying to tell people that it is not a good idea but so far I've had limited success. It's easy for people to just "printf" everything (we are lucky if logging libraries are used with proper levels). Right now, we have the most expensive 'add' operation in…

I don’t know if we worked for the same company but your logging pipeline sounds almost identical to the logging pipeline at my last company. That said, logs are definitely abused often, usually all it takes is an engineer to say to themselves “well, I know this gets logged 1000x a second per host, but, someday during an outage I could potentially use this!”, without realizing that one log call can cost thousands or more a month. Tools like ElastAlert unfortunately dont help in that it makes people comfortable using logs as a fail signal. It seems like the best way to get teams to limit their logging is to give them the exact dollar amount their log call costs; ie, “this one log line accounts for 5% of all log traffic, well that costs $X a month, and it’s only been queried for N times”

Re: Never trust a system that seems to be working

#294

Earlier quoted context omitted.

the rest of the world uses green. Only if you define the rest of the world to mean the very small percentage of places in the world you have been. From Wikipedia: In some countries, instead of "don't walk", a depiction of a red man or hand indicating when not to cross, the drawing of the person crossing appears with an "X" drawn over it. Some countries around the Baltic Sea in Scandinavia duplicate the red light. Ins…

I've been to all continents except maybe Australia. Only North America has the weird white light for pedestrians and a red palm (which also blinks, which is very counter-intuitive). I can assure, most countries of the world use red and green icons of man standing/walking for pedestrians.

It's a retrofit of the older WALK/DONT WALK signs.

Re: Never trust a system that seems to be working

#297

This is why 4-20 mA is a common signaling standard in industrial automation. 4 mA means zero and 20 mA means one. 0 mA means broken transmitter !

Also issue with golang (+ protobufs) where you can't distinguish a populated zero value from the default "not present" value.

Thats why JavaScript has both undefined and null!

Re: Never trust a system that seems to be working

#298

Earlier quoted context omitted.

the rest of the world uses green. Only if you define the rest of the world to mean the very small percentage of places in the world you have been. From Wikipedia: In some countries, instead of "don't walk", a depiction of a red man or hand indicating when not to cross, the drawing of the person crossing appears with an "X" drawn over it. Some countries around the Baltic Sea in Scandinavia duplicate the red light. Ins…

I've been to all continents except maybe Australia. Only North America has the weird white light for pedestrians and a red palm (which also blinks, which is very counter-intuitive). I can assure, most countries of the world use red and green icons of man standing/walking for pedestrians.

I've been to all continents except maybe Australia

Maybe Australia? You don't remember if you've been to Australia?

Congratulations! I've never been so drunk that I didn't know which continent I was on.

Re: Never trust a system that seems to be working

#299

Quoted post unavailable.

You've been using HN repeatedly for ideological battle. We ban accounts that do that, so please stop doing that. It's not what this site is for, and it destroys what it is for.

https://news.ycombinator.com/newsguidelines.html

Re: Never trust a system that seems to be working

#300

As I and others have previously pointed out [1] foone uses they/them pronouns and feels particularly frustrated when their posts get featured on HN, because users here seem unable to honor this simple preference of theirs. It looks like they deleted their tweet out of frustration with todays latest round of misgendering. I hope people on HN will learn to respect all members of our community. Yes that involves not ass…

Quoted post unavailable.

We've banned this account for ideological flamewar. Please don't create accounts to break HN's rules with.

https://news.ycombinator.com/newsguidelines.html

Post reply on HN