Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5 is behind schedule

wsj.com

Post reply on HN
Print view View original

981–990 of 1001 posts

Re: GPT-5 is behind schedule

#981

Post by singpolyma3 »

Workaccount2 wrote: post #779
singpolyma3 wrote: post #405

Earlier quoted context omitted.

I don't think providing accurate answers to context free questions is even something anyone is seriously working on making them do. Using them that way is just a wrong use case.

People are working -very- seriously on trying to kill hallucinations. I'm not sure how you surmised the use case here, as nothing was given other than an example of a hallucination.

There's a difference between trying to get it to accurately answer based on the input you provide (useful) and trying to get it to accurately answer based on whatever may have been in the training data (not so useful)

Re: GPT-5 is behind schedule

#982

Post by antifa »

myroon5 wrote: post #927
bwhiting2356 wrote: post #120

I want AI to help me in the physical world: folding my laundry, cooking and farming healthy food, cleaning toilets. Training data is not lying around on the internet for free, but it's also not impossible. How much data do you need? A dozen warehouses full of robots folding and unfolding laundry 24/7 for a few months?

https://en.wikipedia.org/wiki/XY_problem ? Many non-AI products already reduce chore time: * Washer-Dryer Combos * Soylent/Huel bars * Self-cleaning toilets / automatic toilet bowl cleaners * Robotic vacuums / mowers / pool/litter cleaners * Pet/plant feeders

> robotic litter boxes

Has successfully guilotined several cats.

Re: GPT-5 is behind schedule

#983

Post by swyx »

foolfoolz wrote: post #294
missedthecue wrote: post #271

Earlier quoted context omitted.

Do we know LLMs are the path to AGI? If they're not, we'll just end up with some neat but eye wateringly expensive LLMs.

AGI will arrive like self driving cars. it’s not that you will wake up one day and we have it. cars gained auto-braking, parallel parking, cruise control assist. and over a long time you get to something like waymo, which still is location dependent. i think AGI will take decades but sooner will be some special cases that are effectively the same

waymos are locaiton dependent mostly because of regulations not tech right

Re: GPT-5 is behind schedule

#984

Post by ByteAndBattle »

SamPatt wrote: post #415

I'm sure the debate over the definition of AGI is important and will continue for a while, but... I can't care about it anymore. Between Perplexity searching and summarizing, Claude explaining, and qwen (and other tools) coding, I'm already as happy as can be with whatever you want to call this level of intelligence. Just today I used a completely local AI research tool, based on Ollama. It worked great. Maybe it won…

Local search with Ollama? Please share!

Re: GPT-5 is behind schedule

#985

Post by [deleted] »

gizmo wrote: post #686
netdevphoenix wrote: post #640

Earlier quoted context omitted.

> The ability to “talk to an expert” about any topic I’m curious about and ask very specific questions has been invaluable to me. It is dangerous to assume that LLMs are experts on any topic. With or without quotes. You are getting a super fast journalist intern with a huge memory but inability to reason critically, lacking understanding about anything and huge unreliability when it comes to answering questions (you…

People who are experts (PhD and 20 years of experience) often have very dumb opinions in their field of expertise. Experts make amateur mistakes too. Look at the books written by expert economists, expert psychologists, expert historians, expert philosophers, expert software engineers. Most books are not worth the paper they're written on, despite the authors being experts with decades of experience in their respecti…

[deleted]

Re: GPT-5 is behind schedule

#986

Post by DirkH »

willmadden wrote: post #759
solardev wrote: post #732

Earlier quoted context omitted.

> a revolution in knowledge-worker productivity. That's a nice euphemism for "imminent mass layoffs and a race to the bottom"...

No, the job market will adapt, just like it did during the industrial and information revolutions, and life will be better.

"The job market will adapt and horses will simply find employment elsewhere now that we have cars"

The industrial revolution is not an apt analogy. Humans were still too essential to getting factories to actually work. Horses becoming useless - by no fault of their own - is an apt analogy. We are rushing to a world where humans can be fully replaced.

This "humans will always be in the loop no matter what" is just Cope. We simply don't know what will happen or the what the upper bound of AI capabilities will be. But 100% automation and humans as knowledge workers being as useless vs AI as horses vs cars is no longer sci-fi. We don't know if it will, but this is a future that actually could happen within our lifetimes.

Re: GPT-5 is behind schedule

#987

Post by madethisnow »

missedthecue wrote: post #271
dkobia wrote: post #232

Earlier quoted context omitted.

AGI is the Sisyphean task of our age. We’ll push this boulder up the mountain because we have to, even if it kills us.

Do we know LLMs are the path to AGI? If they're not, we'll just end up with some neat but eye wateringly expensive LLMs.

AGI is nebulous and gets more nebulous as time goes on. When we can answer for ourselves as humans what being conscious IS, then maybe we can prescribe it to another entity

Re: GPT-5 is behind schedule

#988

Post by madethisnow »

ynniv wrote: post #177
exhaze wrote: post #160

Earlier quoted context omitted.

I think the wildest thing is actually Meta’s latest paper where they show a method for LLMs reasoning not in English, but in latent space https://arxiv.org/pdf/2412.06769 I’ve done research myself adjacent to this (mapping parts of a latent space onto a manifold), but this is a bit eerie, even to me.

Is it "eerie"? LeCun has been talking about it for some time, and may also be OpenAI's rumored q-star, mentioned shortly after Noam Brown (diplomacybot) joining OpenAI. You can't hill climb tokens, but you can climb manifolds.

Interesting paper on this. "Automated Search for Artificial Life" https://sakana.ai/asal/

Re: GPT-5 is behind schedule

#989

Post by madethisnow »

ttul wrote: post #874
danielmarkbruce wrote: post #216

Earlier quoted context omitted.

It's just concept space. The entire LLM works in this space once the embedding layer is done. It's not really that novel at all.

This was my thought. Literally everything inside a neural network is a “latent space”. Straight from the embeddings that you use to map categorical features in the first layer. Latent space is where the magic literally happens.

Completely agree. Have you see this?

https://sakana.ai/asal/

Re: GPT-5 is behind schedule

#990

Post by netdevphoenix »

codingdave wrote: post #862
netdevphoenix wrote: post #817

Earlier quoted context omitted.

You forget that it makes stuff up and you won't know it until you google it. When googling, fake stuff stands out because truth is consistent. Querying multiple llms at the same time and being able to compare results is a much better comparison to googling but no one does this. As I said, you are talking to a super confident journalist intern who can give you answers but you won't know if it is true or partially true…

LLMs train from online info. Online info is full of misinformation. So I would not trust an answer to be true just because it is given by multiple LLMs. That is actually a really good way to fall into the misinformation trap.

My point was that googling gets you a variety of results from independent sources. So I said that querying multiple LLMs is as close as you can get for a similar experience.
Post reply on HN