Live data from Hacker News

Due to failure in the IT system, it is not possible to run any trains today

ns.nl

151–160 of 365 posts

Re: Due to failure in the IT system, it is not possible to run any trains today

#151

While having algorithms and computers dictating every aspect of train movements, crew scheduling, resource allocation is efficient and in a sense optimal, I think there's something compelling to be said about having a system that can survive with human-rememberable patterns when such an optimizer fails. That it can fall back on (or have at the core) simple patterns that people can still operate without algorithmic in…

The train schedule as seen by passengers stays the same for years, often to the rail number in stations. What changes are the crews, wagons, locomotives, possibly routes on the railway (switches and reactions to delays and failures.) A friend of mine worked at an app used by a railway's personnel to know where to go next. The app was not particularly complicated but the backend, which has been running for ages, took a long time to run. I don't know the details.

Re: Due to failure in the IT system, it is not possible to run any trains today

#152

This reminds me of the story one of my university teachers used to introduce himself. He was the most brilliant educator I've had, really passionate about making sure people could actually follow and so humble. The course was called "Digital and Computer Technology" and it was a first year course teaching you to build a CPU starting from logic gates and then program it with assembly. He said that when he had recently…

'Those who can, do; those who can't, teach' -George Bernard Shaw

There's a common extension to this about teaching colleges -

'Those who can, do; those who can't, teach; those who can't teach, teach teachers.'

Re: Due to failure in the IT system, it is not possible to run any trains today

#153
post #62
post #14

My curiosity is killing me as to what exactly went wrong. And as someone living in The Netherlands I'm also kind of mad at the apparent fragility of this huge chunk of our infrastructure. If this had happened on a work day, it would have been a real national emergency, rather than just a huge national inconvenience. I would appreciate one of those post-outage "what happened" reports like with the AWS and Facebook out…

From the notice: > It affected the system that generates up-to-date schedules for trains and staff. ...boy oh boy did trying to look into what NS uses for crew scheduling ever send me down a rabbit hole. I don't know if the systems have changed but while poking around online I found this[1] doc about the Netherlands' timetable revamp around 2006 and it talks about the complexity of TURNI-- their on-the-fly crew sched…

I worked in defence on systems that did similiar and i remmember the one my company inherited and wow and wow it was the most complex, nested peice of SQL stored procs i have ever witnessed. It did the job, but it took HOURS to run. We had to re-write it completely to make any changes. But thats what happens when you let companies like Accenture at a system of yours! You pay them the big bux to be sueable, and they milk you like a cow.

Re: Due to failure in the IT system, it is not possible to run any trains today

#154

This reminds me of the story one of my university teachers used to introduce himself. He was the most brilliant educator I've had, really passionate about making sure people could actually follow and so humble. The course was called "Digital and Computer Technology" and it was a first year course teaching you to build a CPU starting from logic gates and then program it with assembly. He said that when he had recently…

'Those who can, do; those who can't, teach' -George Bernard Shaw

Maybe if we paid those who teach better, we'd attract the best of the best to teach. Instead we drive good people out by making the job unbearable.

Re: Due to failure in the IT system, it is not possible to run any trains today

#155
post #118

Earlier quoted context omitted.

Think Oracle, with business logic on top. (JDEdwards, Oracle, SAP) were the OGs of BI. (and bloat, and McKinsey infiltration into many a large F100+) -- They are old school, entrenched, but yu would jump off a cliff supporting any of this legacy stuff. It will persist as the inertia on huge systems is heavy. But yeah - I wonder if they are signing any NEW business... aside from military bunker grade stuff (which will…

Google switched to SAP two years or so ago.

switched what?

Re: Due to failure in the IT system, it is not possible to run any trains today

#156
post #49

Earlier quoted context omitted.

My very good guess is that you had a database failure caused by a crypto virus. They will not wish to announce that this was the root cause until A. A plan of action to avoid a future infection can be enumerated. B. They can be certain they will restore the functionality of the trains. The other part of my guess is that they have a SQL db which is stored on /likely/ a windows server instance. I’d even surmise that th…

This is one of my leading theories as well, although I thought they usually hit on Friday night in order to catch admins off-guard and encrypt as much as possible before being stopped? "The IT failure occurred at the end of [Sunday] morning". On Sunday there is also not as much pressure to get things running as there would be on Monday. Or perhaps this is the incentive to pay now and get things fixed on time for the…

Certificates make the most sense to me. The delay can possibly be due to cached certificates, having to find the person to sign the CSR (assuming in-house PKI or even just someone with access to the right email address for external PKI), and/or a CA that isn’t valid on the machines.

Re: Due to failure in the IT system, it is not possible to run any trains today

#157
post #83
post #62

Earlier quoted context omitted.

From the notice: > It affected the system that generates up-to-date schedules for trains and staff. ...boy oh boy did trying to look into what NS uses for crew scheduling ever send me down a rabbit hole. I don't know if the systems have changed but while poking around online I found this[1] doc about the Netherlands' timetable revamp around 2006 and it talks about the complexity of TURNI-- their on-the-fly crew sched…

I have seen “SAP” tossed around in this industry and still have no clue what they do to earn money. Are they the equivalence of “salesforce”?

think Üracle

Re: Due to failure in the IT system, it is not possible to run any trains today

#158
post #62
post #14

My curiosity is killing me as to what exactly went wrong. And as someone living in The Netherlands I'm also kind of mad at the apparent fragility of this huge chunk of our infrastructure. If this had happened on a work day, it would have been a real national emergency, rather than just a huge national inconvenience. I would appreciate one of those post-outage "what happened" reports like with the AWS and Facebook out…

From the notice: > It affected the system that generates up-to-date schedules for trains and staff. ...boy oh boy did trying to look into what NS uses for crew scheduling ever send me down a rabbit hole. I don't know if the systems have changed but while poking around online I found this[1] doc about the Netherlands' timetable revamp around 2006 and it talks about the complexity of TURNI-- their on-the-fly crew sched…

> sidenote: If anyone out there is an SAP specialist ns.nl looks like a pretty great place to work: 36hr week, 5 weeks vacation, pension, and free unlimited 2nd class + low cost 1st class train travel.

And we can assume that a position in the IT department just opened up...

Re: Due to failure in the IT system, it is not possible to run any trains today

#159
post #62

Earlier quoted context omitted.

From the notice: > It affected the system that generates up-to-date schedules for trains and staff. ...boy oh boy did trying to look into what NS uses for crew scheduling ever send me down a rabbit hole. I don't know if the systems have changed but while poking around online I found this[1] doc about the Netherlands' timetable revamp around 2006 and it talks about the complexity of TURNI-- their on-the-fly crew sched…

I love deep diving on public info to determine the internals (even, not only SOPs, policies, but also *governing culture* can be easily gleaned from reading what is placed in public view. For example, The Salvation Army is one of the biggest jokes in all of charitable history. I wont go into details here, but I would NEVER give a dime to the Salvation "army" (of free slave labor under the guise of "salvation" (its a…

Do you have any evidence of these claims? A news article, for example?

I knew someone who worked briefly at the Salvation Army. They said it was shockingly efficient and effective at its charitable mission.

Re: Due to failure in the IT system, it is not possible to run any trains today

#160

Earlier quoted context omitted.

> everything else in their IT land outside this system runs off SAP (likely including the actual distribution of the output of crew scheduling) so if I had to gamble I'd say the failure happened somewhere in the integration between them. I have a reflex repulsion for off-the-shelf "enterprise" software. You pay millions of dollars to subscribe to a suite of (seemingly) bad, bloated software that takes more work to cu…

My previous boss recently tried to pick up an enterprise solution. He runs a non-software company that has a lot of custom internal apps - 90% built/maintained by interns. Of course the intern-built custom apps are super buggy but the bugs get fixed immediately, and the system is tailored to the company's way of doing things. The company spent an obscene amount of money just demoing a full-fledged SAP-type thing to p…

This is one of the reasons I'm bullish on no-code doc-apps like Coda [0]. I recently started consulting with someone who calls himself "The Coda Guy" and pulls together truly wizard-like apps out of Coda [1]. (Coda is effectively a hybrid of Excel, Google Docs, and Notion.)

I think the "Excel+" category should receive a lot more attention than it does now. I can easily see "no-code" tools like Coda taking over Salesforce and effectively filling the niche you describe.

[0]: https://coda.io

[1]: https://coda.io/@simpladocs/cycling-specific-template / https://coda.io/@simpladocs/crm-interaction-tracker

Post reply on HN