Live data from Hacker News

HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

arxiv.org

261–270 of 280 posts

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#261
post #36

Earlier quoted context omitted.

There will be no AGI during our lifetime. It seems weird to me that people that should understand how ML works (e.g. sama) instead of educating laypeople about about how this actually works and the huge limits the technology has, start talking nonsense about AGIs like some random scifi fan at a convention. Depressing.

How can you speak with such confidence, when Hinton and Ilya Sutskever can not? Hinton even said it is possible in next 5-10 years. While, you can believe whatever you believe, please don't bash people as laypeople or something as nonsense.

Because nobody even understands what AGI is. Or more charitably, has their own version of what AGI means in their head and nobody realizes it that they are talking about different things.

Will we get very good software in the form of personal assistants that could answer questions in depth about a large number of topics? Most likely. Chat GPT is very good at a lot of things, and its only going to get better. Compute amount is going to be an issue though.

Will we get something that resembles a human sitting behind a keyboard, except an expert in every single subject on the internet with some markov chain process that determines objective subfunctions to minimize? Could be. Thing is though, there still has to be an overarching code to run that markov chain, which is not AGI. Definitely dangerous in the wrong hands, but not dangerous by itself - CTRL C could stop its execution at any time.

Will we get a AGI that is smart enough to circumvent that ctrl c signal, break containment, take over the world, and kill all humans, all in the spirit of turning the earth into a super computer? Nah. To even start to code that AGI, you need to get around the whole principle of computational irreducability which means first proving that P=NP. An AGI will essentially have to run simulations on the world internally to figure out how things could play out, at an information amount threshold that is less than the information in the world its trying to simulate, which (unless P=NP) is impossible.

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#262

Earlier quoted context omitted.

Can chatgtp ride a bicycle? Can you ride a bicycle? If you ‘d never rode on a bicycle before - do you think if you read enough books on bicycle riding, the physics of bicycle riding, the physics of the universe - you would have anywhere near as complete a model of bicycle riding as someone who’d actually rode on a bicycle before. Sure you’d be able to talk a great game about riding bicycles - but when it comes to the…

Could Stephen Hawking ride a bicycle?

Yes, his mnd was diagnosed around the age of 21? And he didn’t learn to ride bicycles from reading books.

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#263
post #192
post #176

Earlier quoted context omitted.

> An actual intelligence would have a mental model of the world deeper than the connection between one token and the next Why are you so confident in this? We don't really know how human "intelligence" works. Whose to say it's not doing something similar? It's a bit like saying an audio file doesn't contain "music" because it's just a binary representation of the original work.

If I ask a human what their favorite flavor of ice cream is, they will answer based on their actual preference for different kinds of ice cream. If I ask a chat LLM what its favorite flavor of ice cream is, it will select a statistically likely answer to the question. That's the difference. For reference: my favorite ice cream flavor is cake batter, but only if it's the one at Cold Stone. If it's from somewhere else,…

Someone's actual preference is stored in their memory. If you give the LLM access to a database that includes "preferences", I'm sure it will be able to retrieve that.

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#264

Earlier quoted context omitted.

I am getting super tired of these responses. Yes, I have tried it. Please converse in good faith. GPT-4 has never, not once, in dozens of hours of use, asked me a clarifying question. It cannot understand things.

Friend, kindly be assured that I am indeed conversing with you in good faith. :-) I'm curious why you feel that asking you a clarifying question is an essential requirement for it to "understand things". I have not gotten it to issue a question mark '?'. But it did suggest to me an option: If you would like to define M(7) as equal to M(6), you can do so. What I'm picking up is that it "understands" some things explic…

> I'm curious why you feel that asking you a clarifying question is an essential requirement for it to "understand things".

It isn't a requirement, it's an example I used. You can come up with others, I'm sure! Like ask it to replace a word with another word. It kind of works! But also does random other things. Why? Because that's how these models function! But I asked GPT why these models often don't ask clarifying questions (try it yourself, new prompt! GPT-4!):

> I have found often that GPT models will just reply with answers, rather than ask clarifying questions about the text we're giving them. Why do these models do this?

The reason why GPT models may not ask clarifying questions about the text given to them is that they are trained to generate text based on the patterns and relationships they observe in large amounts of data. This means that they do not have a deep understanding of the content they are processing and are unable to determine whether or not they need additional information to better understand a particular text.

Additionally, GPT models are trained to optimize for the likelihood of generating coherent and grammatically correct text. In most cases, generating a response that directly answers the question or prompt given to them is a more effective way to achieve this goal than asking clarifying questions that may require additional context or information.

However, there are some techniques that can be used to encourage GPT models to ask clarifying questions. One approach is to include explicit cues or markers in the input text that signal to the model that additional information is needed. Another approach is to use training data that includes examples of the model asking clarifying questions, which can help the model learn to do so more consistently.

---

It's very convenient for all of us to think that GPT is like a human, but somehow not like a human enough to cause any moral issues!

It's like winning, but you don't even have to play!

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#265
post #213

Earlier quoted context omitted.

First, these are trivial examples. I would not classify "give me the values to this math formula" as clarifying questions. Second, in response to "I'm not sure why you think that?" ask GPT why it often does not ask clarifying questions. It will explain to you why! Third, I just asked GPT the most vague question on the planet: "I am trying to create a function that takes a value, and gives me a result using that value…

I appreciate your willingness to engage with real examples on this so we’re not just talking past each other. I on purpose chose the most simple concise examples that demonstrate the classes of thought capabilities you were saying it was missing, it can also do more challenging versions of these type of problems. I think your criticism is essentially that it does not think and act like a human, and acts in ways you d…

I am super confused by these responses. Stop assuming what I'm thinking! What is with this? I haven't seen this type of conversation on HN except for crypto and GPT models. Seems like a lot of emotional responses!

Stop saying I am doing XYZ. That's rude! Ask me what I think.

My criticism is not any of those things. I'm not even criticizing the model! I'm criticizing people who are making overly-broad claims about the model!

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#266

Earlier quoted context omitted.

First, these are trivial examples. I would not classify "give me the values to this math formula" as clarifying questions. Second, in response to "I'm not sure why you think that?" ask GPT why it often does not ask clarifying questions. It will explain to you why! Third, I just asked GPT the most vague question on the planet: "I am trying to create a function that takes a value, and gives me a result using that value…

It gave you exactly what you asked for. Be like complaining that someone used “foo” as a function name instead of looking up the exact function call you wanted. Ask a vague question get a vague answer, seems reasonable.

Can we stop with these responses, please? They are very much in bad faith.

I never claimed that the answer was wrong. I even said in my post it was a sensible answer!

My claim is that this thing isn't grokking the stuff you send it. If you sent that type of question to something that was a general problem-solver, it would reply with "wtf" or help you, you know, solve the problem you're trying to solve.

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#267

Earlier quoted context omitted.

Bro, GPT-4 can absolutely not understand new information. Try to teach it a grammar. It can't learn a grammar. Anyone can learn a new grammar. Not GPT-4. GPT-4 does not ask clarifying questions. It does not understand things.

Here's a conversation where Claude, an AI on poe.com asks clarifying questions: === From now on in this conversation, please ask at least one clarifying question for anything I ask to help provide more efficient and relevant answers. Additionally, if it appears that my question doesn't address my underlying goal or if there's a more effective approach, please offer alternative suggestions that better align with what…

> From now on in this conversation, please ask at least one clarifying question for anything I ask to help provide more efficient and relevant answers.

This is certainly cheating, and not really what I claimed.

It would be like me saying "the model can't complete this formula!" and you replying with a prompt that says "when you are prompted to complete this formula, respond with this answer"

That isn't teaching it anything! It doesn't mean it understands anything! You're telling it what to do!

And it isn't my criticism of the model, either. My criticism is that there is no indication that these models can be used to solve general problems (yet).

People are claiming there are obvious indications they can! With no proof! Then when I say "there's no proof of that!" people are responding with prompts like yours, that mean nothing!

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#268

Earlier quoted context omitted.

Except, whatever model is doing the orchestration will still not "understand" the problem (be able to learn from new information provided).

True, but as the orchestrator of my hands and limbs, I could not even begin tell you the implementation details of what they are doing to accomplish my high level intentions

I never said that the model needs to understand how it works! I only said that these models haven't indicated that they can understand what you're saying to them.

Re: HuggingGPT: Solving AI tasks with ChatGPT and its friends in HuggingFace

#270
post #192

Earlier quoted context omitted.

If I ask a human what their favorite flavor of ice cream is, they will answer based on their actual preference for different kinds of ice cream. If I ask a chat LLM what its favorite flavor of ice cream is, it will select a statistically likely answer to the question. That's the difference. For reference: my favorite ice cream flavor is cake batter, but only if it's the one at Cold Stone. If it's from somewhere else,…

Someone's actual preference is stored in their memory. If you give the LLM access to a database that includes "preferences", I'm sure it will be able to retrieve that.

If it's preference is a variable that exists because a human thinks it would make sense to another human it has no connection with reality.
Post reply on HN