Live data from Hacker News

British Airways: All flights cancelled amid IT crash

bbc.com

161–170 of 255 posts

Re: British Airways: All flights cancelled amid IT crash

#161
post #92

Earlier quoted context omitted.

Krakow is a big tech center, is in the EU, and it's not obvious why moving jobs there would have anything to do with a drop in quality.

What makes Krakow inherently better than say, Bangalore? Not snark, just asking.

Work ethic and the ability to say 'No'. Have you ever worked with the Indians, dude ??

Re: British Airways: All flights cancelled amid IT crash

#162

Earlier quoted context omitted.

have you been involved in many IT outsourcing agreements? Cost is always a major factor in procurement, and in IT where there can be a strong market for lemons, it's often the key factor. A company that's more expensive and can't clearly demonstrate in a bid scenario the positive impact of that increase in costs, will lose bids, a lot.

Of course cost is a major factor. I never disputed that. I'm saying that competing on price alone is undesirable for IT outsourcing companies.

But the problem is that factors like security and reliability are often invisible in outsourcing contracts, as it's very hard to specify things like security exactly in a bid contract, and very hard for customers to tell the difference between an organisation with higher security and one with poorer security practices.

Everyone will say they take security seriously, but the cost of actually doing a good job on security is much higher than paying lipservice to it, so it doesn't really make commercial sense to do it well.

In general in fact I'd say that a lot of IT outsourcing contracts tend to lead to a market for lemons. It's very hard for customer to assess the quality of a companies staff for example, so the company with the cheaper staff can afford a cheaper bid, which looks just as good as a company with more expensive staff...

Re: British Airways: All flights cancelled amid IT crash

#163

Earlier quoted context omitted.

have you been involved in many IT outsourcing agreements? Cost is always a major factor in procurement, and in IT where there can be a strong market for lemons, it's often the key factor. A company that's more expensive and can't clearly demonstrate in a bid scenario the positive impact of that increase in costs, will lose bids, a lot.

Of course cost is a major factor. I never disputed that. I'm saying that competing on price alone is undesirable for IT outsourcing companies.

You are right, but they all do it because outsourcing is a signal that corporate management has lost faith in its ability to manage IT and now has but one method of judging value - price.

Re: British Airways: All flights cancelled amid IT crash

#164

In the tech-related (but now fully mainstream, unlike a few years ago) news these days, there are a number of recurring themes. 1. Massive security breaches affecting major corporations, governments, and so on. 2. Massive IT outages, affecting corporations, governments and so forth. It doesn't take a lot of incidents to mark them as 'massive' since things are strongly centralized in this world. Meanwhile, in the last…

Ignoring the offshoring part of this for a moment I think you're on point about the CTOs, it baffled me too at the beginning. When I started doing sales for a startup service and was targeting CTOs I discovered based on my interactions that outside of Silicon Valley companies or obviously tech centered companies, CTOs in other countries and industries are in many cases just the usual political shark type person inter…

> As an example a person in a tech leader role at a major company in the UK who I thought may be interested in hearing about a product was quite rude about me never contacting them again ...

You didn't spam them did you?

Your description of their behaviour sounds a lot like the standard response to spammers. eg FOAD

Re: British Airways: All flights cancelled amid IT crash

#165

Earlier quoted context omitted.

I don't see why an IT outsourcing company would not have the greatest incentive to take security and reliability extremely seriously. Is there anything worse for an IT service provider than being blamed for a massive IT outage at a global corporation? This is headline news. And I don't see any difficult contractual issues at all. On the contrary. A massive outage, by definition, means that the contractual obligation…

Security costs money, reliability costs money. If it's not in your contract, you don't pay for it. if there's any outage that is because the customer didn't ask you do do something that's their fault not yours. For example would you as an IT outsourcer pay for a redundant datacentre if your contract didn't call for it? Would you patch all your systems immediately even if it caused availability issues if it wasn't exp…

>For example would you as an IT outsourcer pay for a redundant datacentre if your contract didn't call for it?

I would assume that the contract calls for particular service levels and that downing the entire fleet of a large carrier for days is in breach of that contract.

If the contract says "provide service X with 99.999% availability" the service provider cannot come back and say, oh but you forgot to specify that we should run a redundant data center to guarantee that availability.

Re: British Airways: All flights cancelled amid IT crash

#166

Earlier quoted context omitted.

Of course cost is a major factor. I never disputed that. I'm saying that competing on price alone is undesirable for IT outsourcing companies.

But the problem is that factors like security and reliability are often invisible in outsourcing contracts, as it's very hard to specify things like security exactly in a bid contract, and very hard for customers to tell the difference between an organisation with higher security and one with poorer security practices. Everyone will say they take security seriously, but the cost of actually doing a good job on securi…

Granted, security is difficult to specify. But availabilty isn't. Not on the scale we're seeing right now with BA.

Re: British Airways: All flights cancelled amid IT crash

#167
I've managed enterprise IT applications shift support to India. I have to say when its done right, it can work well sometimes.

But my experience has taught me this. The vast majority of time its a fragile egg shell waiting to crack. When it fails, it fails miraculously. An IT support team on this scale is one of those things you should keep close to your product or customer.

Occasions like this I guarantee a bunch of execs somewhere in BA will pay ANYTHING to have some of their loyal IT staff back to take control of the situation.

Re: British Airways: All flights cancelled amid IT crash

#168

Earlier quoted context omitted.

Ignoring the offshoring part of this for a moment I think you're on point about the CTOs, it baffled me too at the beginning. When I started doing sales for a startup service and was targeting CTOs I discovered based on my interactions that outside of Silicon Valley companies or obviously tech centered companies, CTOs in other countries and industries are in many cases just the usual political shark type person inter…

> As an example a person in a tech leader role at a major company in the UK who I thought may be interested in hearing about a product was quite rude about me never contacting them again ... You didn't spam them did you? Your description of their behaviour sounds a lot like the standard response to spammers. eg FOAD

No I did not, and that's the issue, a lot of these people are not actually interested in making things any better, they'd rather not be disturbed instead. And then something like what happened today happens. And then people are misdirecting blame to others. The leadership is in most cases to blame.

Re: British Airways: All flights cancelled amid IT crash

#169

Airlines should band together and form working group to redevelop the old system in modern open source tech. Yes it would probably take 5+ years to develop and roll out, but they can't keep maintaining these 50 year old mainframes that cost them tens of millions a year in downtime.

Redeveloping large, complex systems in anything, let alone "modern open source tech", is much more difficult and prone to failure than one may think.

There are many factors that contribute to these difficulties, but tech is not near the top of the list.

There are many cautionary tales, including the $8-billion FAA AAS system rewrite failure [1].

Contributing factors include

- Regulatory processes

- Subcontracting

- Project management

- Politics and turf wars

- The extreme difficulty of reengineering a complex system when few, if any of the original designers and developers are driving it [2].

[1]: http://sebokwiki.org/wiki/FAA_Advanced_Automation_System_(AA...

[2]: https://www.dropbox.com/s/n0nud2xp2a9bxjo/Programming%20as%2...

Re: British Airways: All flights cancelled amid IT crash

#170

Earlier quoted context omitted.

Why just two? The average salary in a western country is many times that in a third world country, and ten times is not that unusual.

Unless you're an idiot and outsourcing critical operations to India or China, it's more like ~4 for 1. Third world countries are developing, you should keep up with that.

>>Unless you're an idiot and outsourcing critical operations to India or China [...]

I've heard rumours that the Chinese will just copy your IP as soon as possible, regardless of what you make them sign.

But what's supposed to be wrong in India compared to other outsourcing sites?

Post reply on HN