Live data from Hacker News

Artificial-Intelligence Experts Are in High Demand

wsj.com

71–80 of 119 posts

Re: Artificial-Intelligence Experts Are in High Demand

#71
Considering being an employee such as in the OP, I have two reactions:

(1) Take statistics, machine learning, neural nets, artificial intelligence (AI), big data, Python, R, SPSS, SAS, SQL Server, Hadoop, etc., set them aside, and ask the organization looking to hire: "What is the real world problem or collection of problems you want solved or progress on?"

Or, look at the desired ends, not just the means.

(2) Does the hiring organization really know what they want done that is at all doable with current technical tools or only modest extensions of them?

Or, since artificial intelligence is such a broad field, really, so far of mostly unanswered research questions, and the list of topics I mentioned is still more broad, I question if many organizations know in useful terms just what those topics would do for their organization.

So, for anyone with a lot of technical knowledge in, say, the AI, etc., topics, it is important for them to be able to evaluate the career opportunity. I.e., is there a real career opportunity there, say, one good to put on a resume and worth moving across country, buying a house, supporting a family, getting kids through college, meeting unusual expenses, e.g., special schooling for an ADHD child, providing for retirement, making technical and financial progress in the career, etc.?

So, some concerns:

(A) If an organization is to pay the big bucks for very long, e.g., for longer than some fashion fad, then they will likely need some valuable results on their real problems for their real bottom line. So, to evaluate the opportunity, should hear about the real problems and not just a list of technical topics.

(B) For the opportunity for the big bucks to be realistic, really should know where the money is coming from and why. That is, to evaluate the opportunity, need to know more about the money aspects than a $10/hour fast food guy.

(C) As just an employee, can get replaced, laid off, fired, etc. So, to evaluate the opportunity, need to evaluate how stable the job will be, and for that need to know about the real business and not just a list of technical topics.

(D) For success in projects, problem selection and description and tool selection are part of what is crucial. Is the hiring organization really able to do such work for AI, etc. topics?

Or, mostly organizations are still stuck in the model of a factory 100+ years ago where the supervisor knew more and the subordinate was there to add muscle to the work of the supervisor. But in the case of AI, etc., what supervisors really know more or much of anything; what hiring managers know enough to do good problem and tool selection?

Or, if the supervisors don't know much about the technical topics, then usually the subordinate is in a very bad career position. This is an old problem: One of the more effective solutions is some high, well respected professionalism. E.g., generally a working lawyer is supposed to report only to a lawyer, not a generalist manager. Or there might be professional licensing, peer review, legal liability, etc. Or, being just an AI technical expert working for a generalist business manager promises in a year or so to smell like week old dead fish.

(E) If some of the AI, etc., topics do have a lot of business value, then maybe someone with such expertise really should be a founder of a company, harvest most of the value, and not be an employee. So, what are the real problems to be solved. That is, is there a startup opportunity there?

Really, my take is that the OP is, net, talking about a short term fad in some topics long surrounded with a lot of hype. Not good, not a good direction for a career.

AI and hype? Just why might someone see a connection there?

Re: Artificial-Intelligence Experts Are in High Demand

#72
post #2

AI is very interesting but not very accessible because it's so specialized. I have a fairly strong programming background but feel like I'd need to study theory for a significant amount of time to even get my feet wet with AI. If you have (condensed, especially) AI resources that you think would help bridge that gap, please share! Toy-scale project ideas would also be appreciated.

Here are two tutorials I've written on natural language understanding:

https://honnibal.wordpress.com/2013/09/11/a-good-part-of-spe...

https://honnibal.wordpress.com/2013/12/18/a-simple-fast-algo...

Re: Artificial-Intelligence Experts Are in High Demand

#73

Earlier quoted context omitted.

I tend to agree that AI today is a long way from what the founders of the subject imagined – it's become something more like "Applied Computer Science". But what's now called "Artificial General Intelligence" isn't dead, and people are still working on it. Also, it's more tricky than you'd think to narrow down what counts as intelligence. There aren't really any hard lines between an I/O program and an intelligent ag…

Just because you don't see the hard lines doesn't mean they aren't there. We are deluding ourselves by avoiding a hard definition of intelligence so we can keep believing that we are creating AI when its really nothing of the sort.

Just because you can't see unicorns doesn't mean they aren't there, but at some point you have to give up the search. It's fine to talk about how, broadly speaking, rats are more intelligent than ants, plants or microbes (which are basically I/O rules with a body), chimpanzees more so than rats, humans more so than than chimps etc. But in general there's a ton of overlap and the qualities we associate with intelligence – memory, planning, self-awareness, tool use, whatever – are only loosely correlated continua.

There are a few more binary measures in intelligence research, such as the mirror test, but at best they're only a small piece of the puzzle. There's no sudden point where everything clicks into place.

Of course, if you have such a good definition of intelligence, feel free to enlighten me.

Re: Artificial-Intelligence Experts Are in High Demand

#74
post #62

The big thing that prevents me from getting into AI is the lack of practical projects that I can build. It is a very interestimg field, but as a self-taught programmer I'm used to learning by building things, and it's hard for me to come up with some project that would be practically useful and yet doable. Does anyone have any ideas?

I don't know much about AI, though I know a bit about ML, statistics and neural nets. And one good way I've found to learn those subjects has been to find interesting papers and then figure out how to replicate/reimplement them.

This might sound a little uninspiring, but it's a solid start, and often you can make improvements over the authors' original stuff -- especially in areas where you may have more experience, e.g. computational efficiency.

Re: Artificial-Intelligence Experts Are in High Demand

#75
post #49

Earlier quoted context omitted.

I often heard the Big Data guys hype that there's no sampling in Big Data, you have the whole data, so it's not exactly statistics.

from my distant memory if you sample size is the pollution its still statistics

Population I of course meant to say !

Re: Artificial-Intelligence Experts Are in High Demand

#76
post #49

This is suspiciously close "data science" and "machine learning" experts. Can't we just be honest and say that most of these are applied statistics jobs with a specialty in large volumes of data? Or is "statistics" just not fashionable enough nowadays?

I often heard the Big Data guys hype that there's no sampling in Big Data, you have the whole data, so it's not exactly statistics.

Presumably you want to draw an inference of some sort from the data. Otherwise what's the point of even looking at it?

Re: Artificial-Intelligence Experts Are in High Demand

#77

This is suspiciously close "data science" and "machine learning" experts. Can't we just be honest and say that most of these are applied statistics jobs with a specialty in large volumes of data? Or is "statistics" just not fashionable enough nowadays?

Just because you're using statistics it doesn't mean that you are a statistician. For example, most of particle physics is based on statistics, but this is not enough to motivate them to rename the field. Whole fields of engineering use statistics every day, machine learning is just another.

Re: Artificial-Intelligence Experts Are in High Demand

#78
We went through a round of this in the 1980s. The first commercial graphics workstations happened to be LISP machines. So management confused non-numeric code with A.I. There was demand for workstation experts. Not to loang after this UNIX graphics workstations like Sun, Apollo and MicroVAX came out and the market switch to UNIX/Linux.

Second was the expert systems boom in the mid-1980s. This was fanned by Stanford professor Fegeinbaum who wrote the infamous book The 5th Generation about expert system computers being the future and Japan was building the best ones. These would either be LISP machines or an interesting French niche language called prologic. Prologic basically traversed a databse "if-then" rules (modus pons). These machines went nowhere and Japan economy tanked in the early 90s. Lot of Silicon Valley VCs lost big on this.

Prof Feigenbaum may still be correct, but 40 years early. However the new A.I. is driven by massive database matching possible in modern peta-level computers and not so much logical computing.

Re: Artificial-Intelligence Experts Are in High Demand

#79

Earlier quoted context omitted.

Just because you don't see the hard lines doesn't mean they aren't there. We are deluding ourselves by avoiding a hard definition of intelligence so we can keep believing that we are creating AI when its really nothing of the sort.

Just because you can't see unicorns doesn't mean they aren't there, but at some point you have to give up the search. It's fine to talk about how, broadly speaking, rats are more intelligent than ants, plants or microbes (which are basically I/O rules with a body), chimpanzees more so than rats, humans more so than than chimps etc. But in general there's a ton of overlap and the qualities we associate with intelligen…

You are repeating the same mistake as before. The difference is significant between admitting we don't know what those lines are and claiming that they don't exist.

Re: Artificial-Intelligence Experts Are in High Demand

#80

This is suspiciously close "data science" and "machine learning" experts. Can't we just be honest and say that most of these are applied statistics jobs with a specialty in large volumes of data? Or is "statistics" just not fashionable enough nowadays?

Your comment might mistake "data science" as being more than a neologism for describing something that hasn't yet taken enough concrete shapes to be clearly defined.

I think many would agree that "machine learning" and/or "deep learning" are at least cornerstones for "artificial intelligence". After all, nobody singularly defines intelligence.

Post reply on HN