ChatGPT turned generative AI into an “anything tool”
arstechnica.com
ChatGPT turned generative AI into an “anything tool”
1–10 of 245 posts
Re: ChatGPT turned generative AI into an “anything tool”
#2Although let's see if it is sustainable.
I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive.
This might sound a bit conspiratorial so apologies for that but back when the competition for Google Assistant/Siri/Cortana/Alexa was super hot, the responses to the various voice assistance was almost eerie in that it could infer what you wanted/needed. Then as things cooled off, they got gradually dumber/worse every year since then. They're legitimately bad today (Siri in particular, but even Google Assistant is much worse than itself from back then). I suspect it is because hardware costs were too high so they found cheaper models that could run on a potato/locally.
From what I've read to get ChatGPT responses in the times it currently takes, they may need to be running something like two 3080 GPUs, 64 GB of RAM, and a high end CPU, with the power draw associated. So to make the economics work (even with ad revenue for example), either a technological breakthrough has to occur to make running today's models much cheaper OR they will cut back making the responses objectively worse (they arguably already did this once with a 3.5 model change).
Re: ChatGPT turned generative AI into an “anything tool”
#3This is what we used to call an "AGI" back in 2013-2014. Generalized artificial intelligence. An AI which is general enough to be used for diverse tasks in multiple fields, unlike specialized AIs of that time (e.g. for image recognition or self-driving cars). Nothing more than that.
Now the goalposts are moved way forward, and now "AGI" is something that have conscious, with superhuman intelligence, and probably evil intent. But back in a day, AGI was just what we have today -- an universal chat bot.
We live in the magic land.
Re: ChatGPT turned generative AI into an “anything tool”
#4I've been building a daily news digest with intent of learning something new and creating something cool.
Although AI is the heart of the product, I have noticed that I have been using it as an "anything tool". Though the articles talks about more broad use cases like hardware and robotics, I've found its an anything tool for most of the boring use cases.
Using python for the first time in a while, ask GPT. Need a tweak on the app store copy, ask GPT. What are the top news sources, ask GPT. Data formatting & manipulation, save 5 minutes ask GPT.
https://apps.apple.com/us/app/quill-news-digest/id1669557131
Re: ChatGPT turned generative AI into an “anything tool”
#5This is what we used to call an "AGI" back in 2013-2014. Generalized artificial intelligence. An AI which is general enough to be used for diverse tasks in multiple fields, unlike specialized AIs of that time (e.g. for image recognition or self-driving cars). Nothing more than that. Now the goalposts are moved way forward, and now "AGI" is something that have conscious, with superhuman intelligence, and probably evil…
This doesn't match what I've seen of usage of the term AGI since ~2010. I think we've "solved" chatbots more than was imagined at the time, and that involves being able to produce readable and arguably useful answers about a range of topics, but we haven't got game playing sorted yet, we don't have proactive models, and there's nothing in these models for movement or robotics (which until recently has been considered an important necessary step).
We have taken a noticeable step forwards towards AGI in the last few years, but AGI is still a long way off.
Re: ChatGPT turned generative AI into an “anything tool”
#6Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
[deleted]
Re: ChatGPT turned generative AI into an “anything tool”
#7Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
So far OpenAI's modus operandi was "does it get better if we make it bigger". But now we've reached "good enough" (arguably already with GPT3.5, as evidenced by free ChatGPT running on GPT3.5-turbo).
There has been promising work about making models smaller without losing performance (e.g. by training them longer), or quantizing the weights (llama.cpp etc) to make the model cheaper to run. I believe we will see a lot more focus on this over the next couple years, and given how there's been comparatively little work done in this direction I wouldn't be surprised by 10x or 100x efficiency gains.
Re: ChatGPT turned generative AI into an “anything tool”
#8Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs.
I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we run something far better than Siri, entirely at home, hooked up to our home APIs in a functional spoken interface seems in reach and awesome (to me hah).
I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me.
If it's cheap it'll be slow, but imo that's okay. For home use i think these systems can be the glue that tie our DBs/Ingestions/etc together, rather than the big-brain that knows everything.
Re: ChatGPT turned generative AI into an “anything tool”
#9This is what we used to call an "AGI" back in 2013-2014. Generalized artificial intelligence. An AI which is general enough to be used for diverse tasks in multiple fields, unlike specialized AIs of that time (e.g. for image recognition or self-driving cars). Nothing more than that. Now the goalposts are moved way forward, and now "AGI" is something that have conscious, with superhuman intelligence, and probably evil…
This doesn't match what I've seen of usage of the term AGI since ~2010. I think we've "solved" chatbots more than was imagined at the time, and that involves being able to produce readable and arguably useful answers about a range of topics, but we haven't got game playing sorted yet, we don't have proactive models, and there's nothing in these models for movement or robotics (which until recently has been considered…
It's not just about language.
https://general-pattern-machines.github.io/
>but we haven't got game playing sorted yet
4 can play chess, Minecraft fine. So I imagine a lot of games fall down to data.
>and there's nothing in these models for movement or robotics
The point is that there doesn't need to be.
There are many projects using LLMs to pilot robots off text prediction ability.
https://tidybot.cs.princeton.edu/ https://innermonologue.github.io/ https://www.deepmind.com/blog/rt-2-new-model-translates-visi...
I think most from the 2000s would be calling what we have today AGI.
Re: ChatGPT turned generative AI into an “anything tool”
#10Large Language Models learn to complete arbitrary token sequences, not just about language.