Live data from Hacker News

Andrew Ng is raising a $150M AI Fund

techcrunch.com

51–60 of 155 posts

Re: Andrew Ng is raising a $150M AI Fund

#51

Earlier quoted context omitted.

there is usually a minimum investment amount. for a fund of this size, im guessing it would be around $5m

I find this really frustrating about tech investing. Much of the early investment opportunities are only available to the richest. It's an insider's game.

I don't think it is not unique to tech investing, but it is true for all small companies.

Re: Andrew Ng is raising a $150M AI Fund

#52
post #35

"Many of these funds are putting time and resources into securing data sets" - this is key.

Whenever I see announcements like this, it's very unclear to me what is meant by "AI." Are they talking about basically getting the most out of the current ML/deep learning type systems? If so then I guess building data sets makes sense but it seems more like an uninteresting business strategy than what I think of as pushing AI forward. If, on the other hand, they are talking about making progress on the more traditi…

The building blocks of AI products are not stable enough for the industry to be respected outside of specialized cases. Too many crap models, not enough simple tools ensuring that models are not crap. I'm guessing these funds would go toward producing those tools. Data quality is a huge issue, so curated data sets are vital, at least until the standard toolchain is strong enough to reliably work on noisy information.

Re: Andrew Ng is raising a $150M AI Fund

#53
post #35

Earlier quoted context omitted.

Whenever I see announcements like this, it's very unclear to me what is meant by "AI." Are they talking about basically getting the most out of the current ML/deep learning type systems? If so then I guess building data sets makes sense but it seems more like an uninteresting business strategy than what I think of as pushing AI forward. If, on the other hand, they are talking about making progress on the more traditi…

I don't think you're up to speed with the latest in ML approaches. You have to be narrow before you can be broad, drawing cross correlations between great narrow inference towards more generalized problem sets.

I would be grateful if you could point me toward some relevant resources.

Re: Andrew Ng is raising a $150M AI Fund

#54

Earlier quoted context omitted.

What is the difference between a data set and a raw sensory data stream? More specifically, isn't a raw sensory data stream just a data set? I think you are getting hung up on semantics. Or is it just the time correlation that interests you? Because some of these data sets are very likely to indeed be time correlated. Like a video/audio data set for example.

I'm personally most interested in approaches to AI not based as heavily on dataset-collecting. There's a now almost standard method of: 1) first curate a nice, large dataset (often explicitly labeled by humans), then 2) carefully engineer a model architecture that has good performance on the problem represented by that dataset. Example: dataset is ImageNet, problem is tagging images. Obviously there's a lot of practi…

this all seems quite naive of the literature in the field. what other "kind of inference" do you wish he would pursue?

Re: Andrew Ng is raising a $150M AI Fund

#55
post #9

I'm curious to the opinions of people here on companies collecting data to build data sets vs. privacy.

Regardless of our individual opinions, probably far more than enough of the general public does not care about or know about securing their online privacy than is needed for an invasive AI startup to get what they need to make a valuable product.

Do you, or anyone else, have any thoughts as to why Americans have, at least stereotypically, a more laissez faire attitude to personal privacy compared to those in Europe? Just the somewhat recent history of secret police in Europe? The American founders were very pro-privacy weren't they?

Re: Andrew Ng is raising a $150M AI Fund

#56

Earlier quoted context omitted.

Big companies have valuable datasets, small companies have talent. It makes sense for big companies to acquire talent, not datasets.

Increasingly, small companies have really novel and valuable data sets.

like?

Re: Andrew Ng is raising a $150M AI Fund

#57
post #19
post #9

I'm curious to the opinions of people here on companies collecting data to build data sets vs. privacy.

Privacy activists have long ignored any benefits of data collection and as we continue to extract more and more value from data this should become more evident and we will be forced to start discussing concrete harms rather than people's general discomfort.

Aside from running large scale analyses over large health data sets, what are some examples where the value derived from large aggregations of personal data is dispersed widely through a society rather than being captured mostly by a single corporation or organization?

Re: Andrew Ng is raising a $150M AI Fund

#58
post #6

"Many of these funds are putting time and resources into securing data sets" - this is key.

Looks like Data sets are going to be the moat of AI companies.

Licensing quality, trusted data is very expensive right now, but as IoT, device tracking, and other data-producing technologies come online there will be a race to the bottom in cost of quality. A lot of older data providers who haven't kept up with the times will be put out of business. I doubt it will take that long; I've had a few ideas in the space and they're not all that complicated...

Re: Andrew Ng is raising a $150M AI Fund

#59
post #54

Earlier quoted context omitted.

I'm personally most interested in approaches to AI not based as heavily on dataset-collecting. There's a now almost standard method of: 1) first curate a nice, large dataset (often explicitly labeled by humans), then 2) carefully engineer a model architecture that has good performance on the problem represented by that dataset. Example: dataset is ImageNet, problem is tagging images. Obviously there's a lot of practi…

this all seems quite naive of the literature in the field. what other "kind of inference" do you wish he would pursue?

Quite possible. I do have a recent PhD in AI, but it's a big field and I can't claim to know more than a small percentage of it.

The problem with the dataset-first approach is that humans are still providing a lage part of the intelligence: defining the domain, defining what good performance on it looks like, carefully designing model architectures, collecting and labeling large datasets, etc. This is fine for narrow task-specific problems, but is not really the end-all of AI, and does not even seem to work well on all well-defined tasks. As an example of another kind of inference, how about mathematical reasoning? I purposely pick one here that is seemingly very formal; should be possible for a computer to do it. Mathematicians are somehow able to invent conjectures and prove theorems without first being exposed to terabytes of labeled mathematical facts. The scientific method is kind of an even messier version of this. Or to take something laypeople do, people can usually learn games to at least a passable level from just a handful of playthroughs, not AlphaGo-style millions of plays (imagine if you had to play even 1,000 games of MT:G before you got the basic hang of it...).

All this kind of stuff is quite well-represented in the literature though, if you mean the scientific literature. Pop-press AI writing tends to cover a pretty specific subset of what's going on at AI conferences.

Re: Andrew Ng is raising a $150M AI Fund

#60

Earlier quoted context omitted.

I find this really frustrating about tech investing. Much of the early investment opportunities are only available to the richest. It's an insider's game.

I don't think it is not unique to tech investing, but it is true for all small companies.

Or big companies. If you wanted a chance to profit from Snap, Square, Twitter or (coming soon) Pinterest, you had to be a high level investor.

I believe most regulations that block this kind of investment are done in the name of protecting the little guy.

Post reply on HN