Very wishful thinking on my part, but I think we're far closer to a general intelligence than most expect.
Out of curiosity: how far away do you think we are?
Neurogenesis Deep Learning
11–20 of 105 posts
Re: Neurogenesis Deep Learning
#12Very wishful thinking on my part, but I think we're far closer to a general intelligence than most expect.
Re: Neurogenesis Deep Learning
#13Earlier quoted context omitted.
Out of curiosity: how far away do you think we are?
I'll say... 5 - 7 years. This is all based on pure speculation, and being a little more than a ML hobbiest. One thing is for sure though - when we do reach that point, everything changes forever.
Re: Neurogenesis Deep Learning
#14It never ceases to amaze me that the best steps towards achieving AI is to look at how we perceive that a Neuron works and simulate it. And the thing is, we aren't exactly sure why exactly that is.. it's amazing. Sometimes the best thing we can do is imitate nature
Spiking Neural Networks [0] attempt to be more accurate representations of human neurons, but haven't really caught on because they aren't really much better than our perceptron model of neurons, at least for the things we are trying to do with them.
Re: Neurogenesis Deep Learning
#15Earlier quoted context omitted.
I'll say... 5 - 7 years. This is all based on pure speculation, and being a little more than a ML hobbiest. One thing is for sure though - when we do reach that point, everything changes forever.
I would have said 30 years, and I thought I was the optimist :) Anyway I hope you're right and I'm wrong!
Re: Neurogenesis Deep Learning
#16It never ceases to amaze me that the best steps towards achieving AI is to look at how we perceive that a Neuron works and simulate it. And the thing is, we aren't exactly sure why exactly that is.. it's amazing. Sometimes the best thing we can do is imitate nature
Why attribute the idea of introducing new nodes to a graph to biological concepts? It seems like a simple step in exploration, similar to how one might think to vary the weights of the nodes randomly over some range.. unless there is some technique biology uses to pre-configure the nodes upon introduction to the network, that might be rather interesting.
Re: Neurogenesis Deep Learning
#17Slightly off topic, but I hate how publications are written. It seems like authors are purposely using big words and sentences that are often 5-6 lines long in order to make it seem more clever. I find myself often having to reread a sentence in order to understand it. These algorithms are often very simple and can be easily explained. Don't over complicate them.
Re: Neurogenesis Deep Learning
#18Earlier quoted context omitted.
I'll say... 5 - 7 years. This is all based on pure speculation, and being a little more than a ML hobbiest. One thing is for sure though - when we do reach that point, everything changes forever.
I would have said 30 years, and I thought I was the optimist :) Anyway I hope you're right and I'm wrong!
Re: Neurogenesis Deep Learning
#19Very wishful thinking on my part, but I think we're far closer to a general intelligence than most expect.
Re: Neurogenesis Deep Learning
#20Neurogensis? How about neural death as a way to prune large neural networks into more compact ones--now that is a research idea!
This idea is at least partially in use with regularisation and dropout. The difference at least with dropout is that the "killed" neurons are then massaged back into the network in order become useful again.