41–50 of 345 posts
This seems huge, am I overestimating the significance?
This sounds exciting, but the example outputs look quite bad. E.g. from the interactive conversation sample: > What is the capital of France? > Marseille And many of the generated image captions are inaccurate.
The language models that produced very impressive results have >>50B parameters, e.g. GPT-3 with 175B, Aleph Alpha Luminous (200B), Google PaLM (540B). GPT-3 can understand and answer basic trivia questions, and impressively mimic various writing styles, but it fails at basic arithmetic. PaLM can do basic arithmetic much better and explain Jokes. Dall-E 2 (specialized on image generation) has 3.5B parameters for the image generation alone and it uses a 15B language model to read in text (a version of GPT-3).
given that the same model can both: 1. tell me about a cat (given a prompt such as "describe a cat to me") 2. recognize a cat in a photo, and describe the cat in the photo does the model understand that a cat that it sees in an image is related to a cat that it can describe in natural language? As in, are these two tasks (captioning an image and replying to a natural language prompt) so distinct that a "cat" in an im…
Similar to the so-called "Jennifer Aniston neurons" in humans that activate whenever we see, hear, or read a particular concept: https://en.wikipedia.org/wiki/Grandmother_cell
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
Certainly we can say our ML models are becoming more general in the sense of being able to cross-correlate between multiple domains. This is quite a different story than "becoming a general intelligence." Intelligence is a property of a being with will. These models, and machines in general, do not posses will. It is we who define their form, their dataset, their loss function, etc. There is no self-generation that m…
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
> a world where AI is indistinguishable, or far superior, to human intelligence I think the part about being "indistinguishable from human intelligence" is potentially a intellectual trap. We might get to it being far superior while still underperforming at some tasks or behaving in ways that don't make sense to a human mind. An AI mind will highly likely work completely differently from humans and communicating with…
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
The other day I prompted a language model with "The S-300 missile system is" and got something that was grammatical but mostly wrong: the S-300 missile system was not only capable of shooting down aircraft and missiles (which it is), but it was also good for shooting at other anti-aircraft missile systems, naval ships, tanks, etc.
All the time Google and Bing try to answer my questions directly but frequently the "lights are on and nobody is home" and the answers just don't make sense.
I see the problem is that people look at the output of these things that are (say) 70% correct and in their mind they fill in the other 30%.
Slowly but surely we're moving towards general AI. There is a marked split across general society and even ML/AI specialists between those who think that we can achieve AGI using current methods and those who dismiss the possibility. This has always been the case, but what is remarkable about today's environment is that researchers keep making progress contrary to the doubter's predictions. Each time this happens, th…
These billion parameter boxes are outside the reach of your everyday developers. In terms of cost of propping up the infrastructure makes them tenable only for megacorps.
Most of us aren't moving goal posts, but are very much skeptic at the things we are being oversold on.
I personally think we are still far away from AGI, and neural networks of any variety are converging on a local optima in the AI design space. I would enjoy "talking" with an AI that doesn't have the contextual memory of a proverbial gold fish.
The real scary thing is that these objectively unprovable systems are plopped into existing systems and more and more in charge of automatic decision making. A corporation's wet dream, if they can absolve themselves of any responsibility "the algorithm can't lie!"