Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT turned generative AI into an “anything tool”

arstechnica.com

Post reply on HN
Print view View original

21–30 of 245 posts

Re: ChatGPT turned generative AI into an “anything tool”

#21

Post by SubiculumCode »

wongarsu wrote: post #7
Someone1234 wrote: post #2

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

So far OpenAI's modus operandi was "does it get better if we make it bigger". But now we've reached "good enough" (arguably already with GPT3.5, as evidenced by free ChatGPT running on GPT3.5-turbo). There has been promising work about making models smaller without losing performance (e.g. by training them longer), or quantizing the weights (llama.cpp etc) to make the model cheaper to run. I believe we will see a lot…

efficiency efficiency efficiency will be the call. How do we reduce model size without losing ability. Can hardware be designed to run a particular set of weights efficiently?

Re: ChatGPT turned generative AI into an “anything tool”

#22

Post by NBJack »

unshavedyak wrote: post #8
Someone1234 wrote: post #2

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs. I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we…

Except for the part Llama 2 weights are still being gated by Meta. There are certainly ways around this, but officially this hasn't even changed, even for Llama 1. I'm not certain Meta has any real incentive to do so. This arguably puts a bit of a damper on home solutions.

Falcon looks very promising, but we seem to be at the early stages of its release, and I haven't seen much validating the claims made about it.

I'd love to host an in-home alternative to Alexa, but I don't think I have the time to train a replacement on my own. Here's hoping this changes

Re: ChatGPT turned generative AI into an “anything tool”

#23

Post by Sohcahtoa82 »

atemerev wrote: post #3

This is what we used to call an "AGI" back in 2013-2014. Generalized artificial intelligence. An AI which is general enough to be used for diverse tasks in multiple fields, unlike specialized AIs of that time (e.g. for image recognition or self-driving cars). Nothing more than that. Now the goalposts are moved way forward, and now "AGI" is something that have conscious, with superhuman intelligence, and probably evil…

> But back in a day, AGI was just what we have today -- an universal chat bot.

I don't know anybody that used AGI to mean that. I've always thought of AGI as an AI that can learn how to perform tasks with very simple instructions, rather than spending weeks training a neural network on a data center full of GPGPUs.

Basically, my idea of AGI has always been what you're calling the "new" definition of AGI.

Re: ChatGPT turned generative AI into an “anything tool”

#24

Post by renewiltord »

JimtheCoder wrote: post #16
unshavedyak wrote: post #8

Earlier quoted context omitted.

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs. I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we…

"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me." Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...

Of course it does. That's the structure of all sci-fi horror https://dresdencodak.com/2009/09/22/caveman-science-fiction/

Re: ChatGPT turned generative AI into an “anything tool”

#25

Post by jstarfish »

JimtheCoder wrote: post #16
unshavedyak wrote: post #8

Earlier quoted context omitted.

On the plus side i think at-home LLMs will continue to get a lot better. ChatGPT 3.5/4 both seem in reach for Llama2 and seeing all the amazing fine tunings that were available for Llama1, i suspect we have a very functional future of at home LLMs. I say functional because i don't think we've seen the larger reasoning skills scale well for smaller deployments, so that may be out of reach. But i think a future were we…

"I look forward to hooking all my at-home cameras up to a voice recognition, image recognition, and LLM detection suite and just speak aloud and have the AI-suite "do stuff". It sounds really, really fun to me." Alternatively, this sounds like the starting plot to a crossover sci-fi/horror movie...

They never read Demon Seed.

Re: ChatGPT turned generative AI into an “anything tool”

#26

Post by danpalmer »

atemerev wrote: post #12
danpalmer wrote: post #5

Earlier quoted context omitted.

This doesn't match what I've seen of usage of the term AGI since ~2010. I think we've "solved" chatbots more than was imagined at the time, and that involves being able to produce readable and arguably useful answers about a range of topics, but we haven't got game playing sorted yet, we don't have proactive models, and there's nothing in these models for movement or robotics (which until recently has been considered…

Games are solved since AlphaZero. Just set up an adversarial model, and voila. Any game, any conditions. Proactive models are simple — just generate the “internal monologue” periodically from the system prompt, mix it with the compressed state, then feed it to another model (the outputs are used as state updates). I think this is how human agency works as well. Movement is a different story (LLMs do not work here, ex…

AlphaZero is amazing, but it only plays 2D games with well defined win conditions.

Re: ChatGPT turned generative AI into an “anything tool”

#27

Post by malwrar »

Someone1234 wrote: post #2

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

The only moat openai has is their financial resources to pay for training and their vast troves of data scraped before reddit/twitter/etc started trying to lock things down. I think at this point there are enough people knowledgeable and interested in open LM technology that, if openai begins to degrade in quality, we won’t lose this technology forever.

I’ve personally been obsessively reading papers about new models and transformer modifications, and having succeeded in implementing some I think the experience has taught me that this tech is probably where web was in the 90s: easy in concept, expensive and hard to scale due to a few missing easy pieces thatll come later.

Re: ChatGPT turned generative AI into an “anything tool”

#28

Post by spott »

Someone1234 wrote: post #2

Although let's see if it is sustainable. I pay for ChatGPT Plus but most people aren't, and from what I've read they're losing money like crazy. We may wind up seeing this as the technical high point before the various competitors cut back on expensive hardware/energy usage for the free tier, and the quality of the responses takes a dive. This might sound a bit conspiratorial so apologies for that but back when the c…

If it was just computer that caused the various assistants to get bad, then why haven’t they gotten good again?

Google assistant came out in 2016! That is 7 years ago! Since then, GPU compute in flops has 5xed… for single precision. If you include half-floats (not a thing back then), it is 75x the single precision flops.

I think the reason that assistants have “gotten bad” is a combination of edge case controls (avoiding politically problematic results), increased capabilities mean more opportunities for failures, and their failures are amplified, and their successes ignored (in other words they aren’t necessarily worse, we just expect more out of them).

Re: ChatGPT turned generative AI into an “anything tool”

#30

Post by party_zebra »

I bet we're going through the cycle netflix went through.

Cable was fractured and expensive, then netflix made it cheap and monolithic, then everyone realized there was money to be made in this new paradigm, then there was a legal fight over usage rights, then it got split up and partitioned into a bunch of different services, the combined cost of which is pretty expensive and individually each service kind of sucks.

So I'm betting we're a few years away from stackoverflow, wikipedia, imdb, goodreads?, etc all having their own ai interfaces.

Fine by me. chatgpt is a way better user experience than stackoverflow, and I'd probably use the wikipedia one, don't really care about anything else. It being an "anything tool" is kind of a novelty, I liked that I could make it "write an advertisement for a housecat in the style of a ford truck commercial, and use plenty of made up trademarks and patents for normal cat behaviors/features", but then lost interest when it refused to do the same thing for boobs.

Post reply on HN