This is fascinating. I am curious how sites like this (and others such as Pingdom, 'up time' checkers, etc) handle scheduled tasks that have to run at high frequencies? Cron on one machine? Celery beat?
10 send any due notifications
20 SLEEP 2
30 GOTO 10
The actual loop [1] is of course a little more complicated, and is being run concurrently on several machines.
[1] https://github.com/healthchecks/healthchecks/blob/09a99d3e9c...