Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI, Google and Anthropic are struggling to build more advanced AI

bloomberg.com

Post reply on HN
Print view View original

51–60 of 622 posts

Re: OpenAI, Google and Anthropic are struggling to build more advanced AI

#51

Post by Der_Einzige »

atomsatomsatoms wrote: post #11

At least they can generate haikus now

In general, no they can't:

https://gwern.net/gpt-3#bpes

https://paperswithcode.com/paper/most-language-models-can-be...

The appearance of improvements in that capability are due to the vocabulary of modern LLMs increasing. Still only putting lipstick on a pig.

Re: OpenAI, Google and Anthropic are struggling to build more advanced AI

#56

Post by ryanackley »

nshkrdotcom wrote: post #26
irrational wrote: post #13

> The AGI bubble is bursting a little bit I'm surprised that any of these companies consider what they are working on to be Artificial General Intelligences. I'm probably wrong, but my impression was AGI meant the AI is self aware like a human. An LLM hardly seems like something that will lead to self-awareness.

An embodied robot can have a model of self vs. the immediate environment in which it's interacting. Such a robot is arguably sentient. The "hard problem", to which you may be alluding, may never matter. It's already feasible for an 'AI/AGI with LLM component' to be "self-aware".

An internal model of self does not extrapolate to sentience. By your definition, a windows desktop computer is self-aware because it has a device manager. This is literally an internal model of its "self".

We use the term self-awareness as an all encompassing reference of our cognizant nature. It's much more than just having an internal model of self.

Re: OpenAI, Google and Anthropic are struggling to build more advanced AI

#58

Post by danjl »

Where will the training data for coding come from now that Stack Overflow has effectively been replaced? Will the LLMs share fixes for future problems? As the world moves forward, and the amount of non-LLM generated data decreases, will LLMs actually revert their advancements and become effectively like addled brains, longing for the "good old times"?

Re: OpenAI, Google and Anthropic are struggling to build more advanced AI

#59

Post by esafak »

leosanchez wrote: post #21
thousand_nights wrote: post #15

not long ago these people would have you believe that a next word predictor trained on reddit posts would somehow lead to artificial general superintelligence

If you look around, People still believe that a next word predictor trained on reddit posts would somehow lead to artificial general superintelligence

Because the most powerful solution to that is to have intelligence; a model that can reason. People should not get hung up on the task; it's the model(s) that generates the prediction that matters.

Re: OpenAI, Google and Anthropic are struggling to build more advanced AI

#60

Post by throwawayk7h »

irrational wrote: post #13

> The AGI bubble is bursting a little bit I'm surprised that any of these companies consider what they are working on to be Artificial General Intelligences. I'm probably wrong, but my impression was AGI meant the AI is self aware like a human. An LLM hardly seems like something that will lead to self-awareness.

I have not heard your definition of AGI before. However, I suspect AIs are already self-aware: if I asked an LLM on my machine to look at the output of `top` it could probably pick out which process was itself.

Or did you mean consciousness? How would one demonstrate that an AGI is conscious? Why would we even want to build one?

My understanding is an AGI is at least as smart as a typical human in every category. That is what would be useful in any case.

Post reply on HN