When you have a hammer…
ChatGPT turned generative AI into an “anything tool”
11–20 of 245 posts
Re: ChatGPT turned generative AI into an “anything tool”
#12This is what we used to call an "AGI" back in 2013-2014. Generalized artificial intelligence. An AI which is general enough to be used for diverse tasks in multiple fields, unlike specialized AIs of that time (e.g. for image recognition or self-driving cars). Nothing more than that. Now the goalposts are moved way forward, and now "AGI" is something that have conscious, with superhuman intelligence, and probably evil…
This doesn't match what I've seen of usage of the term AGI since ~2010. I think we've "solved" chatbots more than was imagined at the time, and that involves being able to produce readable and arguably useful answers about a range of topics, but we haven't got game playing sorted yet, we don't have proactive models, and there's nothing in these models for movement or robotics (which until recently has been considered…
Games are solved since AlphaZero. Just set up an adversarial model, and voila. Any game, any conditions.
Proactive models are simple — just generate the “internal monologue” periodically from the system prompt, mix it with the compressed state, then feed it to another model (the outputs are used as state updates). I think this is how human agency works as well.
Movement is a different story (LLMs do not work here, except as planners), but it pretty much solved too. Robot hardware is too expensive, though, and it is not clear how to power it autonomously.
Re: ChatGPT turned generative AI into an “anything tool”
#13Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
So far OpenAI's modus operandi was "does it get better if we make it bigger". But now we've reached "good enough" (arguably already with GPT3.5, as evidenced by free ChatGPT running on GPT3.5-turbo). There has been promising work about making models smaller without losing performance (e.g. by training them longer), or quantizing the weights (llama.cpp etc) to make the model cheaper to run. I believe we will see a lot…
let's not forget about good old fashion moore's law. which I believe in GPUs is even faster. and I'm not sure if some of these exotics Hardware architectures will pane out or not either.
Re: ChatGPT turned generative AI into an “anything tool”
#14Tried using Bing ChatGTP to create a logo for me because I saw a cool demo on Instagram. It couldn't write text correctly and I tried numerous times. Not only that, the logos were terrible and didn't "mimic" the image I uploaded as a guide (which was in the demo) Today I needed to transcribe an MP3. Nope, can't do that either.
However on Monday I had it write some PHP and that was neat!
50/50 for me.
Re: ChatGPT turned generative AI into an “anything tool”
#15Tried using Bing ChatGTP to create a logo for me because I saw a cool demo on Instagram. It couldn't write text correctly and I tried numerous times. Not only that, the logos were terrible and didn't "mimic" the image I uploaded as a guide (which was in the demo) Today I needed to transcribe an MP3. Nope, can't do that either. However on Monday I had it write some PHP and that was neat! 50/50 for me.
Transcribing an MP3 is a solved problem, in some contexts. What were you doing to make this a fail?
Re: ChatGPT turned generative AI into an “anything tool”
#16Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs. I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we…
"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me."
Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...
Re: ChatGPT turned generative AI into an “anything tool”
#17Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…
isn't ChatGPT just an investor demo anyway?
I doubt they run out of cash at least until they fund building GPT 5. If it flops then who knows.
Re: ChatGPT turned generative AI into an “anything tool”
#18Tried using Bing ChatGTP to create a logo for me because I saw a cool demo on Instagram. It couldn't write text correctly and I tried numerous times. Not only that, the logos were terrible and didn't "mimic" the image I uploaded as a guide (which was in the demo) Today I needed to transcribe an MP3. Nope, can't do that either. However on Monday I had it write some PHP and that was neat! 50/50 for me.
Transcribing an MP3 is a solved problem, in some contexts. What were you doing to make this a fail?
Gave Bing Chat an MP3 URL and it just refused. I know I can do this with software on my PC, or maybe there's an online service where I can upload but I was hoping this would be something Bing Chat/ChatGTP would excel at. I tried first giving it the URL of the article where the MP3 was embedded, and then tried a direct link.
Re: ChatGPT turned generative AI into an “anything tool”
#19Tried using Bing ChatGTP to create a logo for me because I saw a cool demo on Instagram. It couldn't write text correctly and I tried numerous times. Not only that, the logos were terrible and didn't "mimic" the image I uploaded as a guide (which was in the demo) Today I needed to transcribe an MP3. Nope, can't do that either. However on Monday I had it write some PHP and that was neat! 50/50 for me.
For logos you'd be better off with DALL-E 2, no? How do you even get a useful graphical logo out of a text-based language model?
Re: ChatGPT turned generative AI into an “anything tool”
#20Earlier quoted context omitted.
This doesn't match what I've seen of usage of the term AGI since ~2010. I think we've "solved" chatbots more than was imagined at the time, and that involves being able to produce readable and arguably useful answers about a range of topics, but we haven't got game playing sorted yet, we don't have proactive models, and there's nothing in these models for movement or robotics (which until recently has been considered…
It's not just about language. https://general-pattern-machines.github.io/ >but we haven't got game playing sorted yet 4 can play chess, Minecraft fine. So I imagine a lot of games fall down to data. >and there's nothing in these models for movement or robotics The point is that there doesn't need to be. There are many projects using LLMs to pilot robots off text prediction ability. https://tidybot.cs.princeton.edu/ h…
[dead]