So what exactly are these guys building? For a product that’s supposedly 1.0 it sure lacks even the most basic of examples. I also think the title should reflect the product name because it’s clickbait as it is right now.
Building AI without a neural network
11–20 of 50 posts
Re: Building AI without a neural network
#12> But that leaves large and important areas that GPTs are entirely unfit for: Real-time problem solving in dynamic environments, understanding and reacting to current events or spatial reasoning and coordination in the physical world.
It is important to recognize the limitations of these deep neural networks and especially GPTs which both have been hyped to the point where most see it as the solution to everything; since many deep-learning supporters continue to compare it to the human brain, despite the severely limited explainability in these models to the point where not even researchers know what it is doing.
It's one of the reasons why there's very low trust in deep neural networks in general. Humans can be held to account for their actions but with almost all these neural network systems cannot be held to account when something goes wrong and accept the output as the answer whilst 'it is thinking' or 'reasoning'.
> The mechanism behind real world complex systems requires both simple rulesets and a communicative fabric that allows for real time feedback loops. For flocks of starlings this can be as easy as keeping eye contact with the next bird. For Termites, it is pheromone trails. For societies, it is language, reputation and status. For capital markets, it is money. And for the internet, its the physical wiring and network architecture that makes it all possible.
As long as this solution provides transparency and explainable results rather than giving an answer from a black box system then I'm looking forward to this approach.
Re: Building AI without a neural network
#13It's interesting how when discussing neural networks "inspired by the human brain" always comes up when the brain, as far as we know, is emergent behavior from many little things coordinating, not architected. "Top down" never really works for complex systems, the economy being an obvious example. But we tend to ignore that when thinking about neural networks.
Bear in mind that for most (all?) advanced economies the state runs about 40-50%, so top down is working fine for about half of the economy.
Re: Building AI without a neural network
#14[dead]
Re: Building AI without a neural network
#15> But that leaves large and important areas that GPTs are entirely unfit for: Real-time problem solving in dynamic environments, understanding and reacting to current events or spatial reasoning and coordination in the physical world. It is important to recognize the limitations of these deep neural networks and especially GPTs which both have been hyped to the point where most see it as the solution to everything; s…
Human explainability/interpretability is terrible -- it takes years to understand a person well enough to model their actions well in novel situations, and there's tons of literature that backs up that people consistently invent bullshit explanations when asked why they did things. Humans can only be held to account by telling them to change, which we can do with neural networks too.
Re: Building AI without a neural network
#16It's interesting how when discussing neural networks "inspired by the human brain" always comes up when the brain, as far as we know, is emergent behavior from many little things coordinating, not architected. "Top down" never really works for complex systems, the economy being an obvious example. But we tend to ignore that when thinking about neural networks.
ANNs aren't top down either though. The architecture isn't as important as people think.
https://nonint.com/2023/06/10/the-it-in-ai-models-is-the-dat...
Even then, the architectures we use are essentially stumbled on. This is alchemy, not modern chemistry.
Re: Building AI without a neural network
#17It's interesting how when discussing neural networks "inspired by the human brain" always comes up when the brain, as far as we know, is emergent behavior from many little things coordinating, not architected. "Top down" never really works for complex systems, the economy being an obvious example. But we tend to ignore that when thinking about neural networks.
If you look at the actual process for building these deep neural networks, it's actually far more emergent and bottom-up than you might think just reading the news.
I took a deep learning class before things really took off [0], and what we were taught was that a lot of deep learning research was just trying different structures to see what worked. Even the people who were good at it didn't base their architectures on strong theories for how and why things would work, they just had developed an intuition through lots of trial and error.
All the explanations for what the various structures in a deep learning model are doing are post hoc—they're observations made of the behavior of the systems after we build them.
[0] Edit: Not just a random deep learning class either. The TA for that class created AI Dungeon that semester. The professor came in one day with a story of how they accidentally racked up tens of thousands of dollars in Google Cloud bills in 24 hours when that went viral.
Re: Building AI without a neural network
#18It's interesting how when discussing neural networks "inspired by the human brain" always comes up when the brain, as far as we know, is emergent behavior from many little things coordinating, not architected. "Top down" never really works for complex systems, the economy being an obvious example. But we tend to ignore that when thinking about neural networks.
Bear in mind that for most (all?) advanced economies the state runs about 40-50%, so top down is working fine for about half of the economy.
Going on a tangent sorry, you started it!
So... in a private company the employees are very often a lot more beholden to the managers/owners, so top-down command and control can be applied a lot more than in an administration where job security is often much higher. For better or for worse, this can result in a lot more bottom-up decision-making...
In view of general wastefulness, lack of longer term (environmental) planning, I would challenge the "working fine" a bit.
Re: Building AI without a neural network
#19[deleted]
Re: Building AI without a neural network
#20This is an ad for hivekit.io and contains almost no substance.