Live data from Hacker News

“Joel Test” for Data Science

blog.dominodatalab.com

11–20 of 22 posts

Re: “Joel Test” for Data Science

#11
post #6

meh... for me number 1 should be: do they understand domain knowledge beats fancy analytics hands down most of the times or do they spend their time optimizing things nobody cares about?

I enthusiastically agree with this point, however, I think the test was more about "is the company doing right by data scientists?" than "these are skills competent data scientists should have."

Re: “Joel Test” for Data Science

#12
Ok - "latest tools without IT"; let's imagine that you have valuable or personal data, someone picks up an unchecked tool and heyyyyy presto! You lose all that data (well, you still have it, also other people have and your company is in the newspapers).

Also - the best tools money can buy? Where does money come into data science tools? Tensorflow = free, RStudio = free, Shiny = free (ok you can get commercial versions of the last two, and we have, but they are cheap!) Sparklr = free, Python = free....

Re: “Joel Test” for Data Science

#13
post #9

The original Joel Test was a piece of content marketing by Joel Splosky, the CEO of the company that builds FogBugz among other tools for collaboration among software engineers. This appears to be the same. We should evaluate it its merits: Are these useful questions to ask in pursuit of a more productive and less frustrated data science team?

I don't see the need to make the Joel Test sound so nefarious. The Joel Test was content marketing, yes, but not of the FogBugz tool (while a bug database is item 4 out of 12, he doesn't even plug FogBugz in the item - it was a recruitment piece more than a sales piece). The reason we're still talking about the test is that it really struck a chord - it listed practices that were true and important, but not widely held to be so. Today, it's mostly redundant, because those practices are now totally uncontroversial standard industry practice, but it's worth dwelling on the fact that not too long ago you could "content market" recruiting developers by promising them source control systems and an Excel sheet of bugs.

Re: “Joel Test” for Data Science

#14
post #4

A thinly veiled sales pitch for a "data science collaboration platform" is trotted out as some profound measure of how attractive a given company is to prospective applicants for data science positions. I'm wary of the Joel Test and others like it for one very simple reason: the points are goals to strive towards, not some filter by which prospective employers should be judged. Especially in the case of a fledgeling…

The Joel Test was actually explicitly pitched as a filter to judge employers against (incidentally, Joel's firm scored a perfect 12/12).

Re: “Joel Test” for Data Science

#15
post #9

The original Joel Test was a piece of content marketing by Joel Splosky, the CEO of the company that builds FogBugz among other tools for collaboration among software engineers. This appears to be the same. We should evaluate it its merits: Are these useful questions to ask in pursuit of a more productive and less frustrated data science team?

One of the points in particular seems highly dependant on the product category you are analyzing: ability to put data science models into production. You might be working on some product that can't dynamically respond to stimuli as that seems to imply. My team's work influences product decisions frequently, but it would be contrived to actually deploy our models to the product in many cases.

Another that may not apply is the stuff about reproducing past experiments. Suppose your experment platform is programmatic and interfaces with some codebase. Old feature flags are a form of tech debt that should be removed. So old experiment code is sitting in a repo history somewhere but not necessarily deployable.

Re: “Joel Test” for Data Science

#16
post #12

Ok - "latest tools without IT"; let's imagine that you have valuable or personal data, someone picks up an unchecked tool and heyyyyy presto! You lose all that data (well, you still have it, also other people have and your company is in the newspapers). Also - the best tools money can buy? Where does money come into data science tools? Tensorflow = free, RStudio = free, Shiny = free (ok you can get commercial version…

Well, the best analytics database for your use case may not be cheap. E.g. a column store database.

Even open source options can require expensive eng/ops resources to set up a cluster.

Re: “Joel Test” for Data Science

#17
post #9

The original Joel Test was a piece of content marketing by Joel Splosky, the CEO of the company that builds FogBugz among other tools for collaboration among software engineers. This appears to be the same. We should evaluate it its merits: Are these useful questions to ask in pursuit of a more productive and less frustrated data science team?

I don't see the need to make the Joel Test sound so nefarious. The Joel Test was content marketing, yes, but not of the FogBugz tool (while a bug database is item 4 out of 12, he doesn't even plug FogBugz in the item - it was a recruitment piece more than a sales piece). The reason we're still talking about the test is that it really struck a chord - it listed practices that were true and important, but not widely he…

Don't go too fast. It is widespread in the startup world. In entreprisey world not so much. Here we have no version control, no continuous build and bugs never get solved.

Don't even think about Hall testing. And the people that hired me asked no question about my coding ability nor my Github account. And it is not a small company, nor an isolated thing.

And don't ask about the tooling, i spend my days fighting it... not being able to use package manager due to bad proxy is a PITA.

The Joel Test is still on my list of things to check with every company that want to hire me now. Because i see what happen when it is not respected every day...

Re: “Joel Test” for Data Science

#18
post #9

The original Joel Test was a piece of content marketing by Joel Splosky, the CEO of the company that builds FogBugz among other tools for collaboration among software engineers. This appears to be the same. We should evaluate it its merits: Are these useful questions to ask in pursuit of a more productive and less frustrated data science team?

I don't see the need to make the Joel Test sound so nefarious. The Joel Test was content marketing, yes, but not of the FogBugz tool (while a bug database is item 4 out of 12, he doesn't even plug FogBugz in the item - it was a recruitment piece more than a sales piece). The reason we're still talking about the test is that it really struck a chord - it listed practices that were true and important, but not widely he…

I don't intend to make it sound nefarious. Lots of people were saying that this piece was a sales piece as if it should be dismissed.

I actually love well-written content marketing as it is often highly educational. Other examples include:

- DigitalOcean paying people to write tutorials on server configuration

- MIT paying students to write blog posts on life at MIT

- Ksplice writing a post on the uses of strace.

Re: “Joel Test” for Data Science

#19
post #6

meh... for me number 1 should be: do they understand domain knowledge beats fancy analytics hands down most of the times or do they spend their time optimizing things nobody cares about?

Dear god yes. If everybody on your team just has a generic math/CS background and no one has a deep understanding of the domain you are working in, then you'll end up wasting so much time you might as well give up and go home.

Re: “Joel Test” for Data Science

#20
post #12

Ok - "latest tools without IT"; let's imagine that you have valuable or personal data, someone picks up an unchecked tool and heyyyyy presto! You lose all that data (well, you still have it, also other people have and your company is in the newspapers). Also - the best tools money can buy? Where does money come into data science tools? Tensorflow = free, RStudio = free, Shiny = free (ok you can get commercial version…

Well, the best analytics database for your use case may not be cheap. E.g. a column store database. Even open source options can require expensive eng/ops resources to set up a cluster.

Oracle is probably best in class relational database, but Postgres or MySQL will work fine for most use cases.
Post reply on HN