Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask YC: Real World Applications of Machine Learning?

news.ycombinator.com

Post reply on HN
Print view View original

1–10 of 16 posts

Ask YC: Real World Applications of Machine Learning?

#1

Post by kurtosis »

I've been in grad school in physics for 4 years. Ever since I read MacKay's book on ML I've been obsessed with the field. I have a strong desire to do something with ML technology that real customers would pay for, but I'm a bit clueless about where to look. Questions:

(1) What are some specific commercial applications of ML technology (other than banking/finance which I'm not interested in for personal reasons) I've been looking at medical devices / biometrics, but any other suggestions would be helpful.

(2) Would someone with a physics background be taken seriously? I have a decent amount of experience doing numerical work and data analysis with python / c++, but I suspect that these types of jobs are hyper-competitive even for people with hard-core CS backgrounds.

Re: Ask YC: Real World Applications of Machine Learning?

#2

Post by csmajorfive »

(1) All sorts of information and collaborative filtering. Examples: Netflix, Amazon, Pandora, etc. Lots on ML in defense these days too -- i.e. here's everyone's call data, who's the terrorist?

(2) If you just want to implement or tweak existing algorithms, it doesn't really matter what your background is -- the qualifications are the same as any software engineering job (so CS degree helps a lot but not mandatory). If you want to be in a research type position, you'll need a PhD in CS with a dissertation on ML.

Re: Ask YC: Real World Applications of Machine Learning?

#3

Post by kansando »

On 2, we are a company founded by a combination of CS/Physics people. We have found that pairing a physics person with a CS person leads to the best outcomes.

I think you should emphasize the things you are good at (probably modeling and data analysis) and not worry too much about the CS gaps There are a ton of opportunities out there for your skill-set.

Re: Ask YC: Real World Applications of Machine Learning?

#4

Post by rtf »

An out-of-left-field option, if your goal is only to make some money working with ML: go into independent game design and create a game around a ML system.

It's not something mainstream gaming would be interested in using because the goals are different - there the development process is enslaved to some well-defined intellectual property, and (with rare exceptions) does not roam freely enough to allow more than a "good-enough AI opponent" - but if you developed a concept and brought it to market yourself, making sure that the result is fun to play and easy to learn, as well as a good use of tech, you have a shot at a decent revenue stream. Probably not enough to live on, but the beauty of independent gaming is that you can keep revising and expanding on an innovative concept, gradually growing your own market over a period of many years.

Re: Ask YC: Real World Applications of Machine Learning?

#5

Post by yummyfajitas »

Basically any topic where you know what hypothesis look like, and there is lots of data floating around.

Medical diagnosis is an area where ML should be used, but isn't. It's been discovered that a decision tree beats a cardiologist for heart attack triage, but no one will touch it (1). In research, it is often used to discover genetic regulatory networks, and other such things. Basically, ML is replacing what would be a boring job for a grad student.

Also look at marketing. Thanks to their ML systems, Walmart knows that people buy poptarts to prepare for a hurricane.

(1) If a cardiologist kills 10/1000 people due to human error (whoops, forgot the aspirin), it happens. If a computer program kills 5/1000 people due to classification error it's 5 lawsuits waiting to happen, provided you can find a cardiologist to say "In hindsight, I would have gotten that right."

Re: Ask YC: Real World Applications of Machine Learning?

#6

Post by rms »

yummyfajitas wrote: post #5

Basically any topic where you know what hypothesis look like, and there is lots of data floating around. Medical diagnosis is an area where ML should be used, but isn't. It's been discovered that a decision tree beats a cardiologist for heart attack triage, but no one will touch it (1). In research, it is often used to discover genetic regulatory networks, and other such things. Basically, ML is replacing what would…

I met a guy at a university commercialization seminar that was trying to make ML/decision tree stuff for medical diagnoses and such. I don't think he was thinking of triage but much more basic decisions. I hope he got some funding, but this was also in Pittsburgh.

Re: Ask YC: Real World Applications of Machine Learning?

#7

Post by kurtosis »

yummyfajitas wrote: post #5

Basically any topic where you know what hypothesis look like, and there is lots of data floating around. Medical diagnosis is an area where ML should be used, but isn't. It's been discovered that a decision tree beats a cardiologist for heart attack triage, but no one will touch it (1). In research, it is often used to discover genetic regulatory networks, and other such things. Basically, ML is replacing what would…

many thanks, these are good ideas and your examples are awesome

Re: Ask YC: Real World Applications of Machine Learning?

#8

Post by kurtosis »

rtf wrote: post #4

An out-of-left-field option, if your goal is only to make some money working with ML: go into independent game design and create a game around a ML system. It's not something mainstream gaming would be interested in using because the goals are different - there the development process is enslaved to some well-defined intellectual property, and (with rare exceptions) does not roam freely enough to allow more than a "g…

how about an online "hot-or-not" type of game for docs where you are given the same diagnostic information that would be given to a cardiologist and you can see if you can beat the decision tree?

I think someone made something like this not too long ago for stock prices vs. random walks..

Re: Ask YC: Real World Applications of Machine Learning?

#9

Post by apathy »

csmajorfive wrote: post #2

(1) All sorts of information and collaborative filtering. Examples: Netflix, Amazon, Pandora, etc. Lots on ML in defense these days too -- i.e. here's everyone's call data, who's the terrorist? (2) If you just want to implement or tweak existing algorithms, it doesn't really matter what your background is -- the qualifications are the same as any software engineering job (so CS degree helps a lot but not mandatory).…

> If you want to be in a research type position, you'll need a PhD in CS with a dissertation on ML.

Comp Bio works fine too. Same difference.

Re: Ask YC: Real World Applications of Machine Learning?

#10

Post by albertcardona »

Sebastian Seung's research group at MIT is using machine learning to automatically segment the profiles of sectioned axons and dendrites in electron microscopical images of 60 nm serial sections. A very hard problem, and currently in high demand among neuroscience labs.

The purpose: to reconstruct all neuronal connections of a piece of brain tissue.

http://hebb.mit.edu/

Post reply on HN