Earlier quoted context omitted.
Looks like Data sets are going to be the moat of AI companies.
I've been involved in this a couple of times and want to share a thought. If you are just aggregating data, that's not a moat. A lot of folks are buying data from a bunch of sources to give complete coverage - e.g. a dataset of all plane ticket prices, where before you could only get separate datasets from each of amadeus and rivals. Someone, usually someone big, just goes round you to build their own infrastructure…
Andrew Ng is raising a $150M AI Fund
111–120 of 155 posts
Re: Andrew Ng is raising a $150M AI Fund
#112Earlier quoted context omitted.
Have you ever seen a child learn how to speak? He also needs loads of "labelled" data to initially learn about concepts.
I would disagree on this point, humans unlike current AI systems can learn from one or two data points, especially at easier tasks like identifying cats. Current AI algorithms need huge labeled data sets for solving narrow problems so one needs to build more generalization ability to our current AI systems.
Re: Andrew Ng is raising a $150M AI Fund
#113I look at announcements like this, and past ones about Ng, and I always marvel at how things have gone since I took and completed his 2011 ML Class... That was one helluva course, challenging and interesting, and fun all at the same time (and so much "concretely" - lol). From what I understand, that course is still available thru Coursera (which Ng booted up after the ML Class experiment; Udacity was Thrun's contribu…
It's far from challenging. The Stanford one (CS229) is though.
When I took the ML Class (I also took the AI Class at the same time, but had to drop out due to personal reasons - but I stayed in on the ML Class and finished it), I hadn't really touched linear algebra since high school.
I graduated high school in 1991; Ng's course was 20 years later.
I also didn't have any stats or probability experience under my belt. Nor anything about derivatives or integrals.
I basically had to pick all of this up on-the-fly (fortunately there are internet resources), and even to this day, I barely understand them (I understand matrix operations mostly, but I struggle with probabilities, and I have little-to-no idea on derivatives or integrals).
After high school I went on to get a 1 year, virtually worthless today associates degree from a now-defunct voc-tech school here in Phoenix. Since then, I've been steadily employed as a software engineer here in the valley, and well compensated (I believe) for it. I own my own house, and I have zero debt except for a mortgage.
Given all of that, one should be able to see how such a course would be a challenge. There were a ton of people who signed up, but from what I understand, the majority dropped out after the first couple of weeks. This actually seems "par for the course" though for MOOCs.
I know it was a simplified intro to ML, but for me, it and what I took of the AI Class taught me more than what I ever was able to figure out on my own, especially on neural networks. The light really clicked on for me there. But I was really disappointed to have to drop out of the AI Class.
Later, in the Spring 2012, after Udacity had been established, they weren't able to offer the AI Class as one of their courses. So Thrun came up with another course, which was originally titled "CS373 - How to Build Your Own Self-Driving Vehicle" - and I jumped on that one, and completed it as well. I found it fairly challenging too (but not as challenging as the AI Class was). This course has since been renamed to "AI for Robotics" - which is more apt, I think.
It took a while - but eventually the AI Class was made into a course (I think there was some kind of licensing issue, but I don't know for sure, that was preventing it from being part of Udacity's offerings). I have yet to retake it, but it is on my list (plus a ton of others).
Today, I'm in the home stretch of the 3rd term of Udacity's Self-Driving Car Engineer nanodegree. I'm struggling mightily to get my path planner project to work properly, but I almost have it done (it can make it around the track, but for some reason my behavior planner isn't costing things properly). Got an elective, and the integration project to do, all by mid-October or so.
I don't know if any of this will lead anywhere for me career-wise. I'm happy with my current employer, so I expect to stick around here for a while. I have hopes, dreams, ambitions to perhaps get a degree of some sort in CompSci. I want to really learn more mathematics. I've always been a lifelong learner, but this kind of stuff is really fascinating to me, even if it is (what seems to me at least) complex and not always intuitive. But if it were easy, it probably wouldn't be as fun (but I will say Keras and Tensorflow really make things much easier than when we had to implement a neural net in Octave and Python).
Re: Andrew Ng is raising a $150M AI Fund
#114So is this Elon Musk's arch-nemesis?
Re: Andrew Ng is raising a $150M AI Fund
#115"Many of these funds are putting time and resources into securing data sets" - this is key.
Whenever I see announcements like this, it's very unclear to me what is meant by "AI." Are they talking about basically getting the most out of the current ML/deep learning type systems? If so then I guess building data sets makes sense but it seems more like an uninteresting business strategy than what I think of as pushing AI forward. If, on the other hand, they are talking about making progress on the more traditi…
Are they talking about basically getting the most out of the current ML type systems?
Since Deep learning is a subset of machine learning, the sentence retains correctness but there are now two equally valid interpretations.
Okay, I do have something relevant to say. I don't see what advantage there is in raw sensory data streams, models can be trained off-line to operate on sensor streams just fine. What we actually want are systems that learn adaptively and on-line. To do that well, they'd need to also be data efficient.
Re: Andrew Ng is raising a $150M AI Fund
#116Earlier quoted context omitted.
It's still available. I've been taking it for the past month or so. After learning more about him, he's probably the only person in the world that I envy. I resonate with his ideas a lot, but I'm like 1% of what he is. It makes me a bit sad. I'll be taking his new course as well and hopefully one day I will be able to work in the same field as him.
You should focus on what you can do to make yourself a better person. Anyone on earth can compare themselves to another person and get the sense they feel inferior . Wherever You Go, There You Are.
Re: Andrew Ng is raising a $150M AI Fund
#117Earlier quoted context omitted.
I've been involved in this a couple of times and want to share a thought. If you are just aggregating data, that's not a moat. A lot of folks are buying data from a bunch of sources to give complete coverage - e.g. a dataset of all plane ticket prices, where before you could only get separate datasets from each of amadeus and rivals. Someone, usually someone big, just goes round you to build their own infrastructure…
What kind of useful curated datasets do you imagine could be created by a game? Like driving data from a GTA-like game?
What I find fascinating is what AR might do for training AI models. To execute on AR we'll need to digitize a model of our physical surroundings so the software can interact. At that point we'll have a compelling pipeline of actionable data in regards to machine learning - especially for robotics.
Re: Andrew Ng is raising a $150M AI Fund
#118Earlier quoted context omitted.
Privacy activists have long ignored any benefits of data collection and as we continue to extract more and more value from data this should become more evident and we will be forced to start discussing concrete harms rather than people's general discomfort.
Aside from running large scale analyses over large health data sets, what are some examples where the value derived from large aggregations of personal data is dispersed widely through a society rather than being captured mostly by a single corporation or organization?
Re: Andrew Ng is raising a $150M AI Fund
#119I look at announcements like this, and past ones about Ng, and I always marvel at how things have gone since I took and completed his 2011 ML Class... That was one helluva course, challenging and interesting, and fun all at the same time (and so much "concretely" - lol). From what I understand, that course is still available thru Coursera (which Ng booted up after the ML Class experiment; Udacity was Thrun's contribu…
It's still available. I've been taking it for the past month or so. After learning more about him, he's probably the only person in the world that I envy. I resonate with his ideas a lot, but I'm like 1% of what he is. It makes me a bit sad. I'll be taking his new course as well and hopefully one day I will be able to work in the same field as him.
Re: Andrew Ng is raising a $150M AI Fund
#120Earlier quoted context omitted.
People say that but I don't see many ML companies being acquired or funded because of their data sets.
Big companies have valuable datasets, small companies have talent. It makes sense for big companies to acquire talent, not datasets.