Live data from Hacker News

Explaining to BBC Newsnight some of the problems with the CRU code

news.bbc.co.uk

11–20 of 32 posts

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#11
post #9
post #7

The unveilings of the CRU materials now also caused Al Gore to cancel his talk at Copenhagen. http://www.examiner.com/x-11224-Baltimore-Weather-Examiner~y...

An inconvenient cancellation.

Responses like this, while quite popular on reddit, hurt the overall quality of HN.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#12
post #4

Earlier quoted context omitted.

No, I'm not shocked either. Mathematicians and scientists have no formal training in programming (at least in the UK). They're expected just to pick it up and get on with it. They don't generally put in the necessary hours like the "self taught programmer" does, because they're generally not interested in programming itself. It's just a calculational annoyance that gets in the way.

> Mathematicians and scientists have no formal training in programming (at least in the UK). They're expected just to pick it up and get on with it. That's an unreasonable generalisation. For one thing, many university courses in science and mathematics do seem to incorporate basic programming training these days, either as part of the course, or via other facilities that the university makes available to those takin…

I'm talking from my experience of attending the most highly regarded mathematics undergraduate programme in the UK. There was basic programming training, but the emphasis was on the "basic". There was absolutely no emphasis placed on writing maintainable code. We (in fact "they": I didn't attend the classes) were simply taught some technical details of C. In fact I think the number of hours of teaching time was single figures.

Now I can't speak for the engineers at the same university. As far as I know they were given excellent training in C++. But simply, the mathematicians did not take programming seriously, so I'm not surprised of the low quality of the implemented models.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#13
post #6
post #2

The only thing they got wrong was where I said I was 'shocked'. I'm not shocked, I'm surprised, and disappointed by the quality of the code.

And this poor code leads to temperature data sets that could be flawed - data sets that form the foundation under the climate models and the conclusions of the IPCC reports. These reports in turn are used by many countries to base policy on. Are governments basing policy on flawed science?

I'd still prefer the (UK) government to be basing policy on flawed science than no science ( http://news.bbc.co.uk/1/hi/8334774.stm ).

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#14
post #9

Earlier quoted context omitted.

An inconvenient cancellation.

Responses like this, while quite popular on reddit, hurt the overall quality of HN.

Indeed, snootiness, as you exhibited in your post, is a far greater asset.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#15
post #8

Having source code reviews via Newsnight is the ultimate confirmation in my mind that all of this should have been open source from the beginning. It would be trivial, and cost CRU nothing, to set up an open source project which would render scandals such as this impossible. A subject like global warming is potentially of such high importance that it shouldn't be left to cowboy programmers to process the data. I coul…

All software used in science should be open source, because if it isn't, the science isn't repeatable.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#16
post #4
post #2

The only thing they got wrong was where I said I was 'shocked'. I'm not shocked, I'm surprised, and disappointed by the quality of the code.

No, I'm not shocked either. Mathematicians and scientists have no formal training in programming (at least in the UK). They're expected just to pick it up and get on with it. They don't generally put in the necessary hours like the "self taught programmer" does, because they're generally not interested in programming itself. It's just a calculational annoyance that gets in the way.

Beyond training in programming, scientists creating production code need training in software engineering. The folks over at Software Carpentry (http://software-carpentry.org/) seem to have the right idea.

Just as important, like other forms of scientific experimentation, work based on computer analysis needs to be independently reproducable. A big part of that is to make the source code and data available to other researchers (ideally, to the public at large) and well-documented.

It seems like the CRU people failed in both areas.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#17
post #8

Having source code reviews via Newsnight is the ultimate confirmation in my mind that all of this should have been open source from the beginning. It would be trivial, and cost CRU nothing, to set up an open source project which would render scandals such as this impossible. A subject like global warming is potentially of such high importance that it shouldn't be left to cowboy programmers to process the data. I coul…

All software used in science should be open source, because if it isn't, the science isn't repeatable.

Not true. For instance, if a report is originally typed in a closed-source, commercial text editor, that has no impact on the repeatability of the science. Similarly, Mathematica is (to my knowledge) a closed-source program, but calculations done by it can still be independently verified (so long as those calculations are made public).

You're on the right track, but need to narrow down the wording some.

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#18
post #12

Earlier quoted context omitted.

> Mathematicians and scientists have no formal training in programming (at least in the UK). They're expected just to pick it up and get on with it. That's an unreasonable generalisation. For one thing, many university courses in science and mathematics do seem to incorporate basic programming training these days, either as part of the course, or via other facilities that the university makes available to those takin…

I'm talking from my experience of attending the most highly regarded mathematics undergraduate programme in the UK. There was basic programming training, but the emphasis was on the "basic". There was absolutely no emphasis placed on writing maintainable code. We (in fact "they": I didn't attend the classes) were simply taught some technical details of C. In fact I think the number of hours of teaching time was singl…

> I'm talking from my experience of attending the most highly regarded mathematics undergraduate programme in the UK.

That's a bold claim. Which undergraduate programme would that be, and by whom is it the most highly regarded in the UK?

Re: Explaining to BBC Newsnight some of the problems with the CRU code

#20
post #7

The unveilings of the CRU materials now also caused Al Gore to cancel his talk at Copenhagen. http://www.examiner.com/x-11224-Baltimore-Weather-Examiner~y...

Al Gore's talk has indeed been cancelled. His spokesperson says the cancellation is because of "all the events going on with the summit", whatever exactly that means. It could be that the real reason is the CRU kerfuffle, but so far as I can tell that's just speculation.

Most of the linked article other than the first two sentences (1) is bullshit and (2) has nothing to do with the cancellation of Gore's slideshow and book signing.

Post reply on HN