Live data from Hacker News

Andrew Ng is raising a $150M AI Fund

techcrunch.com

111–120 of 155 posts

Re: Andrew Ng is raising a $150M AI Fund

#111
post #88
post #6

Earlier quoted context omitted.

Looks like Data sets are going to be the moat of AI companies.

I've been involved in this a couple of times and want to share a thought. If you are just aggregating data, that's not a moat. A lot of folks are buying data from a bunch of sources to give complete coverage - e.g. a dataset of all plane ticket prices, where before you could only get separate datasets from each of amadeus and rivals. Someone, usually someone big, just goes round you to build their own infrastructure…

What kind of useful curated datasets do you imagine could be created by a game? Like driving data from a GTA-like game?

Re: Andrew Ng is raising a $150M AI Fund

#112

Earlier quoted context omitted.

Have you ever seen a child learn how to speak? He also needs loads of "labelled" data to initially learn about concepts.

I would disagree on this point, humans unlike current AI systems can learn from one or two data points, especially at easier tasks like identifying cats. Current AI algorithms need huge labeled data sets for solving narrow problems so one needs to build more generalization ability to our current AI systems.

That's because we are already VERY pretrained on very similar tasks. You should look into transfer learning and one shot learning for examples of techniques that in practice do something very similar.

Re: Andrew Ng is raising a $150M AI Fund

#113
post #5

I look at announcements like this, and past ones about Ng, and I always marvel at how things have gone since I took and completed his 2011 ML Class... That was one helluva course, challenging and interesting, and fun all at the same time (and so much "concretely" - lol). From what I understand, that course is still available thru Coursera (which Ng booted up after the ML Class experiment; Udacity was Thrun's contribu…

It's far from challenging. The Stanford one (CS229) is though.

Maybe not if you are someone lucky enough to have gone to Stanford, and are a CS major.

When I took the ML Class (I also took the AI Class at the same time, but had to drop out due to personal reasons - but I stayed in on the ML Class and finished it), I hadn't really touched linear algebra since high school.

I graduated high school in 1991; Ng's course was 20 years later.

I also didn't have any stats or probability experience under my belt. Nor anything about derivatives or integrals.

I basically had to pick all of this up on-the-fly (fortunately there are internet resources), and even to this day, I barely understand them (I understand matrix operations mostly, but I struggle with probabilities, and I have little-to-no idea on derivatives or integrals).

After high school I went on to get a 1 year, virtually worthless today associates degree from a now-defunct voc-tech school here in Phoenix. Since then, I've been steadily employed as a software engineer here in the valley, and well compensated (I believe) for it. I own my own house, and I have zero debt except for a mortgage.

Given all of that, one should be able to see how such a course would be a challenge. There were a ton of people who signed up, but from what I understand, the majority dropped out after the first couple of weeks. This actually seems "par for the course" though for MOOCs.

I know it was a simplified intro to ML, but for me, it and what I took of the AI Class taught me more than what I ever was able to figure out on my own, especially on neural networks. The light really clicked on for me there. But I was really disappointed to have to drop out of the AI Class.

Later, in the Spring 2012, after Udacity had been established, they weren't able to offer the AI Class as one of their courses. So Thrun came up with another course, which was originally titled "CS373 - How to Build Your Own Self-Driving Vehicle" - and I jumped on that one, and completed it as well. I found it fairly challenging too (but not as challenging as the AI Class was). This course has since been renamed to "AI for Robotics" - which is more apt, I think.

It took a while - but eventually the AI Class was made into a course (I think there was some kind of licensing issue, but I don't know for sure, that was preventing it from being part of Udacity's offerings). I have yet to retake it, but it is on my list (plus a ton of others).

Today, I'm in the home stretch of the 3rd term of Udacity's Self-Driving Car Engineer nanodegree. I'm struggling mightily to get my path planner project to work properly, but I almost have it done (it can make it around the track, but for some reason my behavior planner isn't costing things properly). Got an elective, and the integration project to do, all by mid-October or so.

I don't know if any of this will lead anywhere for me career-wise. I'm happy with my current employer, so I expect to stick around here for a while. I have hopes, dreams, ambitions to perhaps get a degree of some sort in CompSci. I want to really learn more mathematics. I've always been a lifelong learner, but this kind of stuff is really fascinating to me, even if it is (what seems to me at least) complex and not always intuitive. But if it were easy, it probably wouldn't be as fun (but I will say Keras and Tensorflow really make things much easier than when we had to implement a neural net in Octave and Python).

Re: Andrew Ng is raising a $150M AI Fund

#115
post #35

"Many of these funds are putting time and resources into securing data sets" - this is key.

Whenever I see announcements like this, it's very unclear to me what is meant by "AI." Are they talking about basically getting the most out of the current ML/deep learning type systems? If so then I guess building data sets makes sense but it seems more like an uninteresting business strategy than what I think of as pushing AI forward. If, on the other hand, they are talking about making progress on the more traditi…

Don't have anything relevant to say except to make a fun note that we can change your second sentence, keeping it correct, while increasing its ambiguity. If we restate it as:

Are they talking about basically getting the most out of the current ML type systems?

Since Deep learning is a subset of machine learning, the sentence retains correctness but there are now two equally valid interpretations.

Okay, I do have something relevant to say. I don't see what advantage there is in raw sensory data streams, models can be trained off-line to operate on sensor streams just fine. What we actually want are systems that learn adaptively and on-line. To do that well, they'd need to also be data efficient.

Re: Andrew Ng is raising a $150M AI Fund

#116

Earlier quoted context omitted.

It's still available. I've been taking it for the past month or so. After learning more about him, he's probably the only person in the world that I envy. I resonate with his ideas a lot, but I'm like 1% of what he is. It makes me a bit sad. I'll be taking his new course as well and hopefully one day I will be able to work in the same field as him.

You should focus on what you can do to make yourself a better person. Anyone on earth can compare themselves to another person and get the sense they feel inferior . Wherever You Go, There You Are.

Yep, it helps to remember that only 0.000000014% of the population is the literal best at anything.

Re: Andrew Ng is raising a $150M AI Fund

#117
post #88

Earlier quoted context omitted.

I've been involved in this a couple of times and want to share a thought. If you are just aggregating data, that's not a moat. A lot of folks are buying data from a bunch of sources to give complete coverage - e.g. a dataset of all plane ticket prices, where before you could only get separate datasets from each of amadeus and rivals. Someone, usually someone big, just goes round you to build their own infrastructure…

What kind of useful curated datasets do you imagine could be created by a game? Like driving data from a GTA-like game?

Some of the more interesting AI research is being done in the area of developing very accurate models of the real world. This way the many varied iterations needed to develop the AI model can be done without the same physical limitations of aggregating human data. Games are definitely in this same realm, although it's not always practical to make a human playable simulation-game and an AI playable simulation game given development constraints.

What I find fascinating is what AR might do for training AI models. To execute on AR we'll need to digitize a model of our physical surroundings so the software can interact. At that point we'll have a compelling pipeline of actionable data in regards to machine learning - especially for robotics.

Re: Andrew Ng is raising a $150M AI Fund

#118
post #19

Earlier quoted context omitted.

Privacy activists have long ignored any benefits of data collection and as we continue to extract more and more value from data this should become more evident and we will be forced to start discussing concrete harms rather than people's general discomfort.

Aside from running large scale analyses over large health data sets, what are some examples where the value derived from large aggregations of personal data is dispersed widely through a society rather than being captured mostly by a single corporation or organization?

Building large data sets doesn't necessarily mean from personal data. Look at open-data initiatives such as http://open.canada.ca/en/open-data . Lots of potential for useful tools to be created if the data is there, which won't happen if even benign data like that are kept under wraps/not collected.

Re: Andrew Ng is raising a $150M AI Fund

#119
post #5

I look at announcements like this, and past ones about Ng, and I always marvel at how things have gone since I took and completed his 2011 ML Class... That was one helluva course, challenging and interesting, and fun all at the same time (and so much "concretely" - lol). From what I understand, that course is still available thru Coursera (which Ng booted up after the ML Class experiment; Udacity was Thrun's contribu…

It's still available. I've been taking it for the past month or so. After learning more about him, he's probably the only person in the world that I envy. I resonate with his ideas a lot, but I'm like 1% of what he is. It makes me a bit sad. I'll be taking his new course as well and hopefully one day I will be able to work in the same field as him.

I watched several of the course videos and was struck by how long it's been since college and I did anything with matrices. I kept pausing to go look up what things meant and meanwhile some of his students were catching errors in real time in class

Re: Andrew Ng is raising a $150M AI Fund

#120

Earlier quoted context omitted.

People say that but I don't see many ML companies being acquired or funded because of their data sets.

Big companies have valuable datasets, small companies have talent. It makes sense for big companies to acquire talent, not datasets.

plus acquiring data is trivial compared to devising a good model
Post reply on HN