Live data from Hacker News

Excel warriors who save governments and companies from spreadsheet errors

wired.co.uk

31–40 of 193 posts

Re: Excel warriors who save governments and companies from spreadsheet errors

#31
post #19

Excel is a great case study. Turns out, if you give people an accessible and widely available Touring complete environment, they will manage to do pretty much anything with it. On another note, it's interesting to observe that the problems spreadsheets have are the same problems that plague poorly designed software everywhere - lack of documentation, lack of testing, lack of input validation, among others.

This is pretty much the same reason that PHP is much maligned - it certainly has gotchas but they're not so much dangerous than, say, the C++ gotchas... When everyone is able to "have a go" at a tool they'll all abuse it in their special way to get things done and good on them for doing it since if every data problem required an engineering team to solve everyone's business would grind to a halt.

Re: Excel warriors who save governments and companies from spreadsheet errors

#32
post #19

Excel is a great case study. Turns out, if you give people an accessible and widely available Touring complete environment, they will manage to do pretty much anything with it. On another note, it's interesting to observe that the problems spreadsheets have are the same problems that plague poorly designed software everywhere - lack of documentation, lack of testing, lack of input validation, among others.

It’s an extreme end of the spectrum where static, restrictive, but harder to screw up is one end, and weak, dynamic, permissive, but easy to screw up is on the other.

For what it’s good for, it’s great. I love it because you can do many things faster with it than anything else, and the immediate feedback and visual data flow aren’t matched in any language’s IDE I’ve seen. But like all systems, when they grow they need checks. Like the trope about when your code grows to too much complexity, you start needing static types.

Re: Excel warriors who save governments and companies from spreadsheet errors

#33
post #15

I used to professionally audit spreadsheets that were used to back up million dollar decisions. I say “back up” because it was fairly clear the decisions were made independently. But they needed to tick a box saying they’d had it audited so they paid us for a two day audit. In that limited time, which included writing the report, you’ll appreciate we rarely had time to audit anything more than the top-level summary s…

Is your job to help the justify the justification, or to really fix things?

Re: Excel warriors who save governments and companies from spreadsheet errors

#34
> there’s also a Yahoo Groups mailing list, where members offer tips and tricks, share links to resources and pick apart press coverage of the contact tracing debacle.

I do hope the group is aware that Yahoo! is closing down Yahoo Groups and have moved their mailing list

Re: Excel warriors who save governments and companies from spreadsheet errors

#35
post #15

I used to professionally audit spreadsheets that were used to back up million dollar decisions. I say “back up” because it was fairly clear the decisions were made independently. But they needed to tick a box saying they’d had it audited so they paid us for a two day audit. In that limited time, which included writing the report, you’ll appreciate we rarely had time to audit anything more than the top-level summary s…

Is your job to help the justify the justification, or to really fix things?

I assume you fix the math errors and then whatever the result is turns out to be the justification for the decision. The result doesn't matter, so you don't need to aim at a particular one.

Re: Excel warriors who save governments and companies from spreadsheet errors

#36

Excel suffers from being accessible to "everyone", and having a low barrier of entry. While I'm not an auditor, I've been the go-to Excel person at all my internships and in full time roles. I've reviewed, enhanced, and fixed hundreds for tons of different functions (HR, supply chain, manufacturing production reporting). You can build a respectable system in Excel which has built in error flags that make it obvious t…

I am just completely amazed but yet not surprised there is an entire organization dedicated to spreadsheet risks and best practices. What a world we live in. This just goes to show what the killer app is for computers, it seems.

We have these wonderful machines and 80% of people use them for browsing the web/using web apps and producing spreadsheets. Thats the reality I tend to forget sometimes.

Re: Excel warriors who save governments and companies from spreadsheet errors

#37
post #30

Excel suffers from being accessible to "everyone", and having a low barrier of entry. While I'm not an auditor, I've been the go-to Excel person at all my internships and in full time roles. I've reviewed, enhanced, and fixed hundreds for tons of different functions (HR, supply chain, manufacturing production reporting). You can build a respectable system in Excel which has built in error flags that make it obvious t…

>Excel suffers from being accessible to "everyone", and having a low barrier of entry. I call this "baby with a nailgun syndrome". You end up with a bloody mess.

Love it. I'm in Excel ~50+ hours / week and will definitely start using this sentence

Re: Excel warriors who save governments and companies from spreadsheet errors

#38
Obligatory link to excelint/checkcell threads.

https://news.ycombinator.com/item?id=20491091

https://news.ycombinator.com/item?id=22431500

https://arxiv.org/abs/1901.11100

One of the interesting takeaways from Emery Berger's talk, is that he was able to replicate to 2 decimal places a published spreadsheet transcription error rate of 5.26% of cells have errors.

I highly recommend the talk. https://www.youtube.com/watch?v=GyWKxFxyyrQ

Re: Excel warriors who save governments and companies from spreadsheet errors

#40
post #16

I work at a large firm which has shifted itself from using Excel, to significantly promoting data analytics tools such as Alteryx in place of Excel. One of the MAJOR improvements from using Alteryx is that it is easier to audit and review the process. With Excel you can be down the rabbit hole of data manipulation or formula driven outputs and realise you have made a mistake but cannot find where or how. Or cannot fi…

Excel has similar capabilities (since Excel 2010) in the form of PowerQuery[1]. It can pull in 3rd party data sources (including custom HTTP calls if you want to reach out to an API), has data types, can both process and store substantially larger data volumes (data is cached/stored separately from the spreadsheet data in a compressed, columnar format and processed by a separate data processing engine), and every ste…

From the M-code link: “A core capability of Power Query is to filter and combine, that is, to mash-up data from one or more of a rich collection of supported data sources. Any such data mashup is expressed using the Power Query M Formula Language. It's a functional, case sensitive language similar to F#.”

Does M-code serve as a replacement for (the abysmal) VBA? And how similar is it to F#?

Post reply on HN