Generative AI is overrated, long live old-school AI
1–10 of 192 posts
Re: Generative AI is overrated, long live old-school AI
#2[dead]
Re: Generative AI is overrated, long live old-school AI
#3When the generative model is autoregressive (autocomplete), it can easily be used as a predictor. All of the state of the art language models are tested against multiple choice exams and other types of prediction tasks. In fact, it's how they are trained...masking - https://www.microsoft.com/en-us/research/blog/mpnet-combines...
For example: "Multiple-choice questions in 57 subjects (professional & academic)" - https://openai.com/research/gpt-4
Re: Generative AI is overrated, long live old-school AI
#4From TFA:
TLDR; Don't be dazzled by generative AI's creative charm! Predictive AI, though less flashy, remains crucial for solving real-world challenges and unleashing AI's true potential. By merging the powers of both AI types and closing the prototype-to-production gap, we'll accelerate the AI revolution and transform our world. Keep an eye on both these AI stars to witness the future unfold.Re: Generative AI is overrated, long live old-school AI
#5[flagged]
Re: Generative AI is overrated, long live old-school AI
#6We are all struck with the novelty of generative AI, it needs time to settle. People will throw the universe at the wall and see what really sticks.
To my mind generative AI is great at finding needles in the haystack of stuff we already know. Of course it just as often gives you a fake needle right now, just to see if you notice.
On the other hand "traditional"/predictive AI is often better at the things we don't already know or understand.
Re: Generative AI is overrated, long live old-school AI
#7Seems like the person who wrote the blog works in "classical" deep learning. So do I, so here's the fairest take I can come up with: "AI" has for recent memory been a marketing term anyway. Deep learning and variations have had a good run at being what people mean when they refer to AI, probably overweighting towards big convolution based computer vision models.
Now, "AI" in people's minds means generative models.
That's it, it doesn't mean generative models are replacing CNNs, just like CNNs don't replace SVMs or regression or whatever. It's just that pop culture has fallen in love with something else.
Re: Generative AI is overrated, long live old-school AI
#8[flagged]
There's about ~10% point improvement left (i.e, from 80% to 90%) before it starts to stagnate. We've seen the same with predictive models benchmarked on ImageNet et. al.
Re: Generative AI is overrated, long live old-school AI
#9Re: Generative AI is overrated, long live old-school AI
#10I’m not sure I understand a definition of AI that doesn’t include the ability to generate things.