Live data from Hacker News

a16z Programming Test

hackerrank.com

71–80 of 121 posts

Re: a16z Programming Test

#71
post #3

I seriously hope this doesn't become a norm. I hate timed tests.

As an employer, I would seriously hope this does become the norm. If some employers want to implement recruiting processes that require developers to complete tasks that don't reflect real-world development, it makes it that much easier for other employers to differentiate themselves and attract competent developers who aren't interested or desperate enough to play these games. Frankly, in today's market I feel sorry…

[deleted]

Re: a16z Programming Test

#72
Is anyone in their programming job given several distinct questions and only 3 hours to solve all of them?

A more realistic programming test would be a single, complicated problem with an "end of day" time restraint.

Re: a16z Programming Test

#73
Looks to me like A16Z is blowing it. If Ben Horowitz prides himself on good management of technical work as suggested by his blog posts, then he didn't work very hard on the project of the OP.

Issues:

(1) Engineering School. Uh, guys, here in the US we have universities with schools of engineering -- MIT, Johns Hopkins, CMU, Georgia Tech, etc. Running a good engineering school is a lot of hard work. But this A16Z project has A16Z being their own engineering school, that is, specifying 'course material', testing for it, and deciding on pass/fail. Somehow it seems a bit arrogant for A16Z to believe that they can do the work of an engineering school.

A16Z gets really off the track with their,

> A BS/MS/PhD in Computer Science or the equivalent is nice to have, but the most important requirement is significant independent programming experience as demonstrated by your GitHub account, personal projects, academic publications, or startup success.

Wow! "PhD in Computer Science" ... "is nice to have, but"...! Gee, guys, just shut down MIT, Johns Hopkins, CMU, Georgia Tech, etc. because now A16Z is here with "the right stuff"!

Next, for their "as demonstrated by ... academic publications", sorry, A16Z, "academic publications" are not at all about "programming experience". Instead, the usual criteria are "new, correct, and significant" where "programming" really does not count more than, say, just the word processing for the paper.

(2) Machine Learning. Good grief! That "machine learning" is about "scatterplots & histograms, logistic/linear regression, R/Matlab" fills a "much needed gap in the literature" and "would be illuminating if ignited". Their definition is for a 'statistical data assistant' mostly just for 'descriptive statistics'. Ever hear of J. Tukey? Ah, I'll be nice to you guys; not fun to be too harsh on small children!

Then there is their unforgettable,

> If you also know enough data science/machine learning to design useful metrics for dashboards and workflows, that’s a major plus.

Uh, ever hear of reliability and validity? You have three hours to respond here with a relevant description! You are not permitted to use Google or Wikipedia!

(3) Ego. It appears that the A16Z specification was written by someone who has enough ego to believe that their own 'skill set' is just "the right stuff".

(4) Linux. People programming on Microsoft's platform can have done well but encountered only a small fraction of the topics in the A16Z document. The document is mostly about Linux. Sorry, guys, I'm writing in Visual Basic .NET; no, C# has too much of the deliberately 'idiosyncratic' syntax of C which I find too error prone and hate.

(5) Three Letter Acronyms (TLAs). It appears that A16Z is using obscure TLAs as code word filters. Hmm.

So, they have ORMs. Gee, what the heck is that? So, Google a little and get a Wikipedia entry and discover ORM abbreviates 'object-relational mapping'. Okay. Sure, if write the software with objects and keep the data in a relational database, then need move data between objects and tables. Given the huge variety of objects and tables, tough to believe that there is a significant 'subject' here.

Then there is their ETL. Google again and discover that that TLA abbreviates "extract, transform, and load". So that is essentially 'extracting' data from whatever original sources, 'transforming' the data as needed by the work to be done, and 'loading' the data into a data base. Okay. Sounds entirely routine. I'm surprised they didn't also list (A) LRT, look at a screen, read it, and type in what need, (B) PSS for put on shoes and socks, (C) SDP for start car, drive to the office, and park the car, and especially the crucially important (D) GSL for Google a question, select the promising results, and learn what needed. One more: WTH, waste time on Hacker News!

Okay, A16Z, two can play this game: Think of a large server farm or internet protocol network. Since this 'facility' is subject to errors of wide variety, it is important to monitor the facility for unexpected problems of wide variety, say, from software errors, hardware failures, system administration errors, security breaches, etc. To do this collect some data, say, from Microsoft's instrumentation means, HP's Mercury Interactive, what a relational database management system or Cisco box can report, etc. So, maybe 100 times a second, collect numerical data on each of 25 variables. Now we want a detector of 'anomalies', including for problems never seen before, that is, 'zero-day' problems. Such monitoring is essentially hypothesis testing. So, we want a suitable hypothesis test. Due to the fact that the multi-dimensional probability distribution of that 25 dimensional data is essentially impossible to describe at all accurately, we need an hypothesis test that is 'distribution-free'. Since the data is 25 dimensional, our test must also be 'multi-dimensional'. We want false alarm rate known in advance and adjustable in small steps over a wide range. And we want a good shot at doing nearly as well as the Neyman-Pearson result but with much less data than that result requires. Okay, A16Z, your mission, and I'd like to see you accept it, is to say how to do that. Of course, since you guys are so good and brilliant, you already know my published paper for the answer. But there is a typo in the paper. Where is it? You have three hours to post your response here.

Also needed, find a fast way to do the specified computations. I found a way, but that is not in the paper. You have 24 hours to post the answer to this part! Don't report your answer in some silly way such a running code. Instead, report your answer in clear English with any appropriate mathematics written as high quality mathematical writing, e.g., W. Rudin. Go for it, guys!

Uh, you won't find the answer on Google or GitHub! And asking around Silicon Valley won't help, either. You might want to rush off to the RAD lab project of Patterson and Fox funded by Google, Microsoft, and Sun for when they worked on such problems, but that won't help, either.

My view: Here A16Z showed that their understanding of computing is still down at the level of a junior high self taught programmer.

Re: a16z Programming Test

#74
post #11

Cool, but... Why is A16z building an engineering team?

Probably to build internal tools. A lot of VCs firms are trying to apply more data to their investment decisions and that requires internal tools to handle it all. Also makes sense given the qualifications they are asking for.

A better way: Actually read and understand the submissions from the entrepreneurs!

Re: a16z Programming Test

#75
post #59

Cool, but... Why is A16z building an engineering team?

My guess would be a team to provide a data-centric approach to investment. Crunch a whole lot of numbers to identify industry trends and specific firms that are promising, and see if those can replicate human performance. Or they're simply handling recruitment for a stealth portfolio startup.

> industry trends

Why? The VC firms never invest in an "industry", i.e., there are no such 'index funds'.

Instead, VC firms invest in individual companies, and there what is just crucial is what the company does. If the company looks good, then mostly to heck with the darned industry.

> Or they're simply handling recruitment for a stealth portfolio startup.

In this case, poor startup: A16Z is doing a "piss poor" job 'helping' the startup!

Re: a16z Programming Test

#76
post #67

Random question - how are "scatterplots and histograms" machine learning?

This is a very difficult question and, thus, illustrates the transcendent brilliance and astoundingly "deep domain knowledge" of A16Z. An answer is available only on the bleeding edge of the most brilliant insights of research in machine learning. Ordinary people can't expect to understand such depth! All bow down to the incandescent brilliance of A16Z -- after all, one of their founders used C++ to write a GUI application to read a text markup language and display the formatted results! Maybe this was the first time, I mean after Word, TeX, and some others?

Re: a16z Programming Test

#77
post #3

I seriously hope this doesn't become a norm. I hate timed tests.

As an employer, I would seriously hope this does become the norm. If some employers want to implement recruiting processes that require developers to complete tasks that don't reflect real-world development, it makes it that much easier for other employers to differentiate themselves and attract competent developers who aren't interested or desperate enough to play these games. Frankly, in today's market I feel sorry…

[deleted]

Re: a16z Programming Test

#78
post #65
post #8

I wonder if this could act as a negative filter for good programmers. Who worth their salt is going to invest 3 hours of their time just to submit a resume? Wouldn't you want to talk to the employer first to see if they're a good fit? In a tight labor market, people willing to do this are more desperate than others. So it's going to filter for desperate developers who passed a 3 hour basic skills test. Old fashioned…

one of the best programmers i know refuses to continue with a job application if there is a programming test... its a bit eccentric but valid given that his experience and past achievements say more than a programming test ever could.

Why? I've had that in interviews before when asking people to code. I find it strange (not just because we pre-warn about the agenda) that someone applying to program won't...program? I reasoning I've had has been mainly : "it's too trivial" "I've written gems" "I'm famous"

Re: a16z Programming Test

#79
post #65

Earlier quoted context omitted.

one of the best programmers i know refuses to continue with a job application if there is a programming test... its a bit eccentric but valid given that his experience and past achievements say more than a programming test ever could.

I have come across this opinion as well from some excellent developers, but I can't say that I agree with it. All in all, a well-executed* technical test can be an excellent filter and basis for further interviews. * By well-executed, I mean - relatively language agnostic, lacking in trick questions and meaningless trivia, and being open to multiple good answers. The intention is to not only check basic ability to so…

Agreed re discrepancies: I've had CS Majors / Masters fail, yet my self-taught CEO passes. This amazes me. [edit; the cs majors amaze me]
Post reply on HN