Live data from Hacker News

The school for sysadmins who can’t timesync good

libertysys.com.au

11–20 of 33 posts

Re: The school for sysadmins who can’t timesync good

#12
Oh dear... I've been triggered by that reference to the HP-UX boxes at Queensland police in the early 2000s... yes, it was as bad as can be imagined... no, actually, it was worse.

A large number of them were out-of-date and at their end-of-life. HP was charging a super premium for keeping them in support beyond their normal end-of-life period... some reseller pointed this out as a justification for why it would be cheaper to replace them than to keep them in support. It back-fired: QLD police just took them out of support without replacing the hardware. State-level critical infrastructure running on obsolete equipment with no vendor support....

Re: The school for sysadmins who can’t timesync good

#13
post #10
post #8

Earlier quoted context omitted.

I cheat and have an authoritative NTP server locally and then override dns for pool.ntp.org and friends. Then at least if I’m off we’re all off together.

For bonus points, hook up a GPS with a PPS output to the local one so it's stratum 1.

I do this, with all the trimmings (running in kernel space, PTP simulation, etc). I appreciate that a good estimation of the time inside the non-deterministic OS is being made, but I haven't quite wrapped my head around what it means to extract the time from that non-deterministic OS.

How big is that unmeasured error?

Re: The school for sysadmins who can’t timesync good

#14
Archive.org links for the series in case the site goes down due to the HN Hug of Death:

Part 1 - The Problem with NTP: https://web.archive.org/web/20210627035347/https://libertysy...

Part 2 - How NTP Works: https://web.archive.org/web/20210627035910/https://libertysy...

Part 3 - Installation and Configuration: https://web.archive.org/web/20210308233351/https://libertysy...

Part 4 - Monitoring and Troubleshooting: https://web.archive.org/web/20210308233515mp_/https://libert...

Part 5 - Myths, Misconceptions, and Best Practices: https://web.archive.org/web/20210308232954mp_/https://libert...

Re: The school for sysadmins who can’t timesync good

#15
post #4

Nice comprehensive series but couldn't get to page 4 -site timed out. On the windows side of things, I'm more familiar with "w32tm" and "net time." My time sync post has the highest amount of views on my site from people googling "how to set time clock on domain" so their cell phones match their computers at work. Would be interesting to see how the windows protocols differ from nix.

The Win32 daemon only provides coarse time adjustment. Basically doing an ntpdate to adjust the clocks once per day or so. Good enough for domain logins, but a couple orders of magnitude worse than the regular NTP protocol. Of course on Linux most of the arcane details of the ntp daemon aren't relevant because most distros end up running SystemD with timesyncd instead. I discovered this when all of my T1 time sources…

> The Win32 daemon only provides coarse time adjustment.

True in XP (it was a crappy SNTP implementation), but it was rehauled significantly in Windows 10/Server 2016 and above because of Azure requirements. It can now guarantee accuracy within 1 second at all times and even higher when the NTP server is local (https://docs.microsoft.com/en-us/windows-server/networking/w...)

Re: The school for sysadmins who can’t timesync good

#17
My adventures in ntp resulted in finding out that different ntp servers handle leap seconds differently. Googles will gradually stretch the second out over time, which violates the NTP standard of just adding or subtracting the second. So if your setup depends on very accurate time, make sure you know what NTP servers you're using.

Re: The school for sysadmins who can’t timesync good

#18
It’s a good read, and I really wish time was always that simple. Sometimes you have multiple platforms on different clock systems and distributed systems running across them. Did you know google and amazon smear leap seconds? GPS/Galileo/that-China-one don’t have leap seconds (but all are different TAI offsets) but that Russian GPS one does have leaps. They all have slightly different versions of utc.

Most of the time none of that matters and you can just install chronie and point it to whatever.pool.ntp.org and you’re off to the races. But boy does it suck when you have to to know.

Re: The school for sysadmins who can’t timesync good

#20

Oh dear... I've been triggered by that reference to the HP-UX boxes at Queensland police in the early 2000s... yes, it was as bad as can be imagined... no, actually, it was worse. A large number of them were out-of-date and at their end-of-life. HP was charging a super premium for keeping them in support beyond their normal end-of-life period... some reseller pointed this out as a justification for why it would be ch…

It definitely got better when MOG moved lots of tech people into their own agency. So, so much better. Like, a whole department of people not answerable to anyone but their COO, who had basically no idea how to support agencies.

I inherited an "enterprise environment" to look after that had attempts to talk to on prem NTP services via VPN, but that had failed over time. Cybersec had closed the route without notice and the environment eventually drifted out of sync and was completely unable to get updates. It hadn't had any updates for 3 years. There were still other elements of the VPN that could talk to parts of both networks used between two big agencies supported. That system was classified as sensitive. Also, the firewall hadn't had a definitions review in 4 years. .Net Core alpha release was being used.

Fortunately I was able to nuke the whole thing because of the low number of users.

Post reply on HN