Live data from Hacker News

This AI Boom Will Also Bust

overcomingbias.com

311–320 of 320 posts

Re: This AI Boom Will Also Bust

#311
post #186

Earlier quoted context omitted.

A lot of revolutionary technologies begin as toys. In the 9th century two brothers created a machine called, "the instrument which plays by itself." It uses a rotating cylinder with "teeth" that triggers keys which were encoded to play music. One can say it's a programmable music machine. Fast forward to the 1700s and artisan engineers in France were creating similar devices that automatically played music. Toys for…

I think your story does more to reinforce the parent post's point. The chain of events you outline spans an entire millennium. Over that time, yes, a lot of technology developed, and eventually we got to computers, and there was even the movement that gives us the term Luddite. But it was still one long chain of gradual, evolutionary developments over the course of a very long expanse of time. At no point was there a…

If the world evolved in linear terms, you would be right. However, the rate of scientific advancement has multiplied exponentially over the history of mankind: our scientific understanding has advanced more in the last 100 years than it has in the previous 10000 combined (nuclear physics, quantum physics, molecular biology, information technology, astronomy/cosmology - you name it.)

Remember, 10 years ago smartphones were in the realm of science fiction. Now, everyone has one in their pockets.

Today we can train a computer for a week to generate a cute little christmas jingle. How many years do we need to train a human child to do the same? AGI won't happen overnight, sure, but its effects of that research will be felt continuously along the way.

Re: This AI Boom Will Also Bust

#312
post #77
post #56

Earlier quoted context omitted.

What about nature based apps, for coming after work, and just relaxing a bit in nature ? do they give a similar feeling of going into a beach, etc ?

I love that idea but I think we should be more social in person than electronically. I would better go out with someone on a run or a walk than this but again I would love that for sometime

I think almost everyone would prefer to walk with someone in person in nature. However sometimes the more realistic (or perhaps perceived) alternatives might be stay in, or go on a virtual tour with someone online. This makes it relatively attractive.

Re: This AI Boom Will Also Bust

#313
post #123

[Disclosure: I work for a deep-learning company.] Robin's post reveals a couple fundamental misunderstandings. While he may be correct that, for now, many small firms should apply linear regression rather than deep learning to their limited datasets, he is wrong in his prediction of an AI bust. If it happens, it will not be for the reasons he cites. He is skeptical that deep learning and other forms of advanced AI 1)…

>> One-shot learning, or learning from a few examples, is a field where we're making rapid progress, which means that in the near future, we'll obtain much higher accuracy on smaller datasets. I'm really not convinced by one-shot learning, or rather I really don't see how it is possible to show that any technique used generalises well to unseen data, when you're supposed to have access to only very little data during…

It all depends on the specific problem. Are the patterns simple and strong or complicated and subtle?

Re: This AI Boom Will Also Bust

#314
post #300

Earlier quoted context omitted.

> Open the first edition of Artificial Intelligence: A Modern Approach and there's a fair bit of effort to apply linear regression selectively in order to be computationally feasible. Does the book mention linear regression at all? The term doesn't appear in the index.

Third addition has it [0]. The second does as well, but the first doesn't have an online index. [0] http://aima.cs.berkeley.edu/aima-index.html

Thanks. The section "Regression and Classification with Linear Models" from the third edition and the chapter "Statistical Learning Methods" from the second edition do not appear in the first edition.

Re: This AI Boom Will Also Bust

#315
post #208

Earlier quoted context omitted.

Brain emulation? I didn't realize people seriously thought that could be good for anything other than research and investigation. If we can successfully emulate the brain, it seems we would have necessarily acquired the knowledge needed to build models that are very powerful without having to exactly mimic the brain.

See Hanson's http://ageofem.com/

I keep hearing great things about that book. Thanks for the link, maybe it is time to pick up a copy.

Re: This AI Boom Will Also Bust

#316

Earlier quoted context omitted.

The combination of the methods was certainly novel as far as I am aware. Also, it was not clear ahead of time that it would actually succeed in defeating the best humans. Demonstrating that it could be done is a grear achievement. There is also the symbolic value. It was a "coming of age" event to a certain degree. I believe go was the last classic board game that researchers had been longing to conquer. I haven't lo…

By that token, IBM's wins at chess and Jeopardy also deserve to be seen as "coming of age" events. And while the wins certainly showcased IBM's engineering prowess, I'm unconvinced Deep Blue or Watson moved the AI needle in a meaningful way. If they had, others would have followed in their technical footsteps. But AFAIK, no one has. I believe this lack of high tech repercussion will be true of AlphaGo too. Novel AI f…

You don't think Deep Blue was inspirational to folks who were perhaps deciding if they wanted to pursue AI research?

The same holds for AlphaGo and Watson. Also, my understanding is that they are more technically interesting than Deep Blue. Given how recent these projects are, their legacy is only beginning to unfold.

I agree with you that applying this tech to domains other than games is no easy challenge. But I would be very surprised, in the long run, if events like this are not documented as key steps along the way at some point in the future.

Re: This AI Boom Will Also Bust

#317

I think this field is suffering from some confusion of terminology. In my mind there are three subfields that are crystallizing that each have different goals and thus different methods. The first one is Data Science. More and more businesses store their data electronically. Data Scientists aim to analyze this data to derive insights from it. Machine Learning is one of the tools in their tool belt, however often they…

Articles like this show because people are given the title Engineers.

Re: This AI Boom Will Also Bust

#318
post #300

Most firms that think they want advanced AI/ML really just need linear regression That's how AI always looks in the rearview mirror. Like a trivial part of today's furniture. Pointing a phone at a random person on the street and getting their identity is already in the realm of "just machine learning" and my phone recognizing faces is simply "that's how phones work, duh" ordinary. When I first started reading Hacker…

> Open the first edition of Artificial Intelligence: A Modern Approach and there's a fair bit of effort to apply linear regression selectively in order to be computationally feasible. Does the book mention linear regression at all? The term doesn't appear in the index.

It may (or may not) have been a bit of stretch on my part for which the only excuse I have is that I was going on memory and the phrase triggered my memory.

The first edition discusses Least Mean Squares LMS which is in a way [that way being my way maybe] the 'evil twin' of Least Squares. It fits the data points (in this case the values produced by the agent) to a known curve rather than the curve to the data points. In the first edition, 'long running' examples are on the order of a few hundred to a thousand epochs and fitting a curve via linear regression is similar computationally.

Anyway, I'll claim poetic license if I must. And I must if my hand waving doesn't work.

Re: This AI Boom Will Also Bust

#319

Earlier quoted context omitted.

I read your consciousness post and will reply here because that thread is already locked. I think the problem of consciousness comes from its definition. The word consciousness is too large, encloses too many aspects of cognition, religion and philosophy to be useful. It's a suitcase word, reifying various meanings into one name. What we need instead of "consciousness" is a set of concepts: - "perception" - means rep…

>Consciousness is a balancing system for the colony of cells that just want to pass their genes into the next generation. is there anything in that which requires that it be a physical biological substrate rather than a model? Can't computer models follow the same behavior as long as that's how their environment / system is set up? (More specifically, can't they also have brains made up of cells connected to each oth…

I think there is absolutely no need for the system to be biological. A computer model can work just as well. As long as it solves the same behavior problem, there is no difference between brain reinforcement learning and artificial reinforcement learning.

Re: This AI Boom Will Also Bust

#320

Earlier quoted context omitted.

My hype is different, because in my estimation we already have the hardware. You write: >As an IT guy with a basic but solid neuroscience education -- could you go ahead and take a few minutes (maybe will take you 5-10) to read through my above-referenced links referencing my previous discussion and tell me whether I'm correct in your estimation on the bottom-up aspect - i.e. the amount of computation that human neur…

> i.e. the amount of computation that human neural nets can likely be doing We don't know nearly enough what they are really doing! We only know a few selected bits and pieces! You are basing your assumptions on nothing, so according to logic any conclusion is possible from a faulty premise. On which you promptly deliver spectacularly. Also, the "computation" a brain does at one moment leaves out the time aspect: Lot…

Thank you so much for those insightful links!
Post reply on HN