Ask HN: So what's new in the world of A.I.?
11–20 of 51 posts
Re: Ask HN: So what's new in the world of A.I.?
#12Whenever there is a 'breakthrough' in AI two years onwards we call it by some different name and AI gets pushed just a little bit further in to the future again. Plenty of stuff that is 'normal' in machine learning today would have been advanced AI twenty years ago. I don't expect this to change much, until the time that we reach the stage where you can click together a functional agent from a bunch of pre-made units…
In this sense AI can be seen to be similar to philosophy.
Re: Ask HN: So what's new in the world of A.I.?
#13> AI research and related topics and startups rarely make news. Research of any sort rarely makes news. The exceptions involve universities with very zealous, hard-working P.R. people (who pretty much always overstate the importance and impact of the work they cover). As for startups, they, and other businesses, are there to make money. And there just isn't much money to be made in A.I. (yet?). The only commercially…
> The only commercially viable idea to come out of A.I., that I know of, is the expert system. And that turned out to be a pretty small market. Oh come on, you're baiting AI people (like me) here. :P * Spam Filters (Bayesian networks) * Video Game AI (game trees, fuzzy logic, etc) * Natural Language Processing (Markov networks) * Computational Finance (pattern recognition) The list goes on, but the thing about AI is…
An algorithm to predict which humans are trustworthy enough to keep their promises to their creditors, which murders the performance of human beings, enabling billions of dollars of commerce which was previously economically unfeasible? AI. FICO? Oh, that is just some number crunching on a big source of data. Big deal. Come back when you get a chatbot working.
Re: Ask HN: So what's new in the world of A.I.?
#14From my brief exposure, here are some big algorithms and some applications in roughly chronological order. Definitely not exhaustive. Those in the know...feel free to correct me:
- Least squares regression (prediction- used everywhere)
- Fishers Discriminant (classification tasks)
- Perceptron networks (classification tasks)
- Markov Models/Hidden Markov Models (Speech/Handwriting recognition)
* Machine Learning community develops out from AI *
- Support Vector Machines (Image recognition/ classification)
- Expectation Maximization (prediction)
- Relevance vector machines (classification / prediction)
- Gaussian processes
- Predictive sampling
My prediction (heh pun intended) is that you see enormous changes in the field when processing by GPU's becomes much more available. There are some algorithms that are simply difficult to research because labs don't have access to fast enough machines. Also, there is beginning to be some effort to port these algorithms to a Map/Reduce framework so they can be run at scale (check out Apache Mahout). Lastly, I'm slightly biased towards machine learning as that's where I chose to do my grad research. I'm not sure what problem domains are under AI or ML or Statistics...I tend to clump them all together.
Re: Ask HN: So what's new in the world of A.I.?
#15Earlier quoted context omitted.
> The only commercially viable idea to come out of A.I., that I know of, is the expert system. And that turned out to be a pretty small market. Oh come on, you're baiting AI people (like me) here. :P * Spam Filters (Bayesian networks) * Video Game AI (game trees, fuzzy logic, etc) * Natural Language Processing (Markov networks) * Computational Finance (pattern recognition) The list goes on, but the thing about AI is…
Amen. Stuff that doesn't work is "AI". Stuff that does work is "math". An algorithm to predict which humans are trustworthy enough to keep their promises to their creditors, which murders the performance of human beings, enabling billions of dollars of commerce which was previously economically unfeasible? AI. FICO? Oh, that is just some number crunching on a big source of data. Big deal. Come back when you get a cha…
Once a deterministic route to a decision is shown it does now feel like math and a lot less like the grand ideas they had in their minds.
Re: Ask HN: So what's new in the world of A.I.?
#16Re: Ask HN: So what's new in the world of A.I.?
#17So some of the major AI fields are now known as:
* machine learning - learning from data, aka applied statistics, aka how to "learn"
* computer/machine vision - how to "see"
* natural language processing - how to "read" and "write" and "translate"
* speech recognition - how to "hear"
* robotics - how to "do"
* affective computing - how to "feel" and "act"
There are others as well, but as you can see from this simplistic breakdown, the specialities loosely mirror those in biology/medicine/neuroscience, and indeed there are also researchers who straddle the boundaries between the natural side and the computation side of things.As a vision researcher, I can tell you that there's a huge amount of work being done, and progress being made, in our field -- both in academia and in industry. While it often doesn't make the news, we consider this a feature, not a bug.
For following progress in these fields, I have two comments:
1. There's no good resource I know of to follow all the subfields of AI. Instead, there are different sources for each field.
2. While others have recommended journals and conferences, I think it can be tough to read them if you're not already immersed in the field. So instead, I'd recommend starting with the wikipedia pages for each field, seeing the general list of topics, and then finding the appropriate papers if you're really interested. A good way to find important papers is by looking on google scholar for papers with lots of citations (insert usual disclaimers here about citations != quality of work, etc.)
I can get you started in computer vision with two very influential papers in the last decade that have also had a huge impact on industry:
P. Viola and M. Jones - Robust Real-time Object Detection http://research.microsoft.com/en-us/um/people/viola/Pubs/Det...
This paper revolutionized face detection, and is the basis for automatic face detection in most consumer cameras.
D. Lowe. Distinctive image features from scale-invariant keypoints http://www.cs.ubc.ca/~lowe/papers/ijcv04.pdf
This paper was the culmination of many years of work on detecting repeatable features in images and representing them in a consistently-findable way and is the basis for numerous object recognition algorithms, as well as those for stitching multiple photos together into panoramas and Microsoft's "PhotoSynth".
Re: Ask HN: So what's new in the world of A.I.?
#18To add to the many good responses here so far: AI is such an overloaded term with many negative connotations that it's no longer used. It's also now specialized into separate components, as researchers realize that it's not "cheating" to study e.g. vision separately from natural language processing. Even humans cheat, by having separate portions of the brain specialize in different parts of "AI". So some of the major…
Despite being mostly known as an ML researcher, Leslie Pack Kaelbling's AAAI-10 keynote slides make something of an argument for why AI is important as well: http://people.csail.mit.edu/lpk/AAAI10LPK.pdf
Re: Ask HN: So what's new in the world of A.I.?
#19But in all seriousness, the links to journals are your best resource for specific topic areas. I've spent a lot of time in data modeling, computer vision, etc. It is a lot about providing specific models (with some minor adaptation / dynamism in the algorithm) to provide for "learning" / "adjustment".
So start with areas that are directly related to your interests and try and iterate/generalize from there.