Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Toyota blames factory shutdown in Japan on ‘insufficient disk space’

theguardian.com

Post reply on HN
Print view View original

11–20 of 223 posts

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#11

Post by wizerdrobe »

As we move to more abstract systems I wonder how well we (as in companies) are keeping basic systems management capabilities in place at a personnel level.

At $DAY_JOB we recently scuttled most development efforts for a week for our teams. Our nightly backup job that sanitizes PHI ballooned overtime to, say, 20GB+1Byte and ran out of disk space. Because we are running Kubernetes on Fargate we don’t need a full time operations guy, right?

Commence the company (me) scrambling to learn how to use a Peristent Volume and Peristent Volume Claim because a career programmer should be able to perform systems administration takes because DevOps has the word “Dev” in it, right?

So we lost a week of productivity to disk space, but in reality we lost a week to poor personnel and capabilities.

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#13

Post by xeromal »

I was responsible for some dev ops stuff at a state's health department and one of the more infuriating things about working at that place was that it was like pulling teeth getting more storage allocated. Our backups would be running out of disk and they'd allocate me 50 or 100 GB at a time. I'm sure someone Toyototian was yelling that this was going to happen for the past 6 months.

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#14

Post by picadores »

mcny wrote: post #6
jiofj wrote: post #2

Didn't they see the balloon?!? https://3.bp.blogspot.com/-Pv29dGQwIMI/UFcMD6hgcyI/AAAAAAAAF...

To spell it out, I think the joke here is the assertion that they are probably using old operating system and software. The screenshot is for windows XP.

Why is that a joke? Factory equipment is ordered and has a lifetime of 20 years. Of course it has old systems. These are grownup industries. They have no time for development hipster nonsense and extraction games for unwanted features to stave of unemployment in some glass-towers.

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#15

Post by scandox »

picadores wrote: post #14
mcny wrote: post #6

Earlier quoted context omitted.

To spell it out, I think the joke here is the assertion that they are probably using old operating system and software. The screenshot is for windows XP.

Why is that a joke? Factory equipment is ordered and has a lifetime of 20 years. Of course it has old systems. These are grownup industries. They have no time for development hipster nonsense and extraction games for unwanted features to stave of unemployment in some glass-towers.

You're shooting the translator.

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#16

Post by b3lvedere »

zoky wrote: post #3

If 14 geographically distinct factories can be shut down by a single server acting up, you’ve got problems that overnight shipping from Newegg can’t solve…

It was a rainy day so the cloud was not to full capacity :)

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#17

Post by numpad0 »

robertlagrant wrote: post #4

Why is the article tying just-in-time to this issue?

JIT in context of Toyota refers to their philosophical concept of keeping as many parts in transit. I'm not completely sure but I think runtime compilation in software is named after that than the other way around.

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#18

Post by riidom »

junaru wrote: post #8
robertlagrant wrote: post #4

Why is the article tying just-in-time to this issue?

Because they wouldn't need to shut down factories if they had bigger stock of parts on site.

I wonder, wouldn't it be more of a question of how much later to shut down. Or in other words, how big is the time buffer you get for not being "just in time"? The article suggests (the way I read it, at least) that it is some fundamental time span, but I feel like it's more like half a day?

Re: Toyota blames factory shutdown in Japan on ‘insufficient disk space’

#19

Post by archildress »

Just-in-time will cost you far more than it will save you. The problem is that when it fails, you judge those failures as "backwards looking one offs" as opposed to a cost that is part and parcel to being JIT.

Factory downtime is the single biggest cost a manufacturing shop can incur. No amount of working capital savings from carrying fewer screws, widgets, and bolts can offset the costs of taking 14 plants down due to penny wise, pound foolish math.

Post reply on HN