Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-5 is behind schedule

wsj.com

Post reply on HN
Print view View original

781–790 of 1001 posts

Re: GPT-5 is behind schedule

#781

Post by Workaccount2 »

jaybna wrote: post #772
Workaccount2 wrote: post #765

Earlier quoted context omitted.

Doing basic copyright analyses on model outputs is all that is needed. Check if the output contains copyright, block it if it does. Transformers aren't zettabyte sized archives with a smart searching algo, running around the web stuffing everything they can into their datacenter sized storage. They are typically a few dozen GB in size, if that. They don't copy data, they move vectors in a high dimensional space based…

So then copyrighted content scraped is not needed for training? Guess I missed AGI suddenly appearing that reasoned things out all by itself.

Nothing builds a better strawman than a foundation started with "So".

Re: GPT-5 is behind schedule

#782

Post by tim333 »

solardev wrote: post #732
LASR wrote: post #610

So the team I lead does a lot of research around all the “plumbing” around LLMs. Both technical and from a product-market perspectives. What I’ve learned is that for the most part that AI revolution is not going to be because of PHD-level LLMs. It will be because people are better equipped to use the high-schooler level LLMs to do their work more efficiently. We have some knowledge graph experiments where LLMs contin…

> a revolution in knowledge-worker productivity. That's a nice euphemism for "imminent mass layoffs and a race to the bottom"...

In my lifetime there have seldom been much layoffs due to improved technologies. The companies tend to invest to keep up with the rival companies. The layoffs come more when the companies become loss making for whatever reason eg. the UK coal industry going, or Detroit being undercut by lower cost car makers.

Re: GPT-5 is behind schedule

#783

Post by LightBug1 »

I just want to say something random. ChatGPT cited and English newspaper called 'The Sun' in the answer to a query I made this moring.

I found that amusing and figured then that we might already be beyond peak AI!

If AI is trained on sources that include The Sun, it's going to end up being garbage and/or constantly needing to be fact checked.

Re: GPT-5 is behind schedule

#784

Post by tim333 »

anon373839 wrote: post #583
ciconia wrote: post #551

Earlier quoted context omitted.

When you think about it it's astounding how much energy this technology consumes versus a human brain which runs at ~20W [1]. [1] https://hypertextbook.com/facts/2001/JacquelineLing.shtml

It’s almost as if human intelligence doesn’t involve performing repeated matrix multiplications over a mathematically transformed copy of the internet. ;-)

It makes you think there must be more efficient algorithms out there.

Re: GPT-5 is behind schedule

#785

Post by HyprMusic »

ramesh31 wrote: post #522
ferminaut wrote: post #440

Earlier quoted context omitted.

the context limits on google are nuts! Being able to pump 2 million tokens in and having it cost $0 is pretty crazy rn. Cline makes it seamless to switch between APIs and isnt trying to shoehorn their SAAS AI into a custom vscode (looking at you cursor)

>the context limits on google are nuts! Being able to pump 2 million tokens in and having it cost $0 is pretty crazy rn. What's the catch though? I was looking at Gemini recently and it seemed too good to be true.

Your code becomes training data[0]:

> When you use Unpaid Services, including, for example, Google AI Studio and the unpaid quota on Gemini API, Google uses the content you submit to the Services and any generated responses to provide, improve, and develop Google products and services and machine learning technologies, including Google's enterprise features, products, and services, consistent with our Privacy Policy.

[0] https://ai.google.dev/gemini-api/terms

Re: GPT-5 is behind schedule

#786

Post by weatherlite »

aprilthird2021 wrote: post #750
weatherlite wrote: post #613

Earlier quoted context omitted.

Not worth 1B ? Come on man. I see them improving the tool enough for most people willing to pay 50$ a month for a subscription. And for most companies to be willing to pay 300$ per employee. It's perhaps not there yet but I'm sure they'll reach this amount of value for their offering. It remains to be seen what competition will do to the prices though.

The market of people willing to pay $50 a month for OAI vs $0/month for one of the open source LLAMA variants is not large enough to justify their current valuation, imo

I'm not that familiar with the open source ones - how good are they in comparison?

Re: GPT-5 is behind schedule

#787

Post by mrits »

solardev wrote: post #732
LASR wrote: post #610

So the team I lead does a lot of research around all the “plumbing” around LLMs. Both technical and from a product-market perspectives. What I’ve learned is that for the most part that AI revolution is not going to be because of PHD-level LLMs. It will be because people are better equipped to use the high-schooler level LLMs to do their work more efficiently. We have some knowledge graph experiments where LLMs contin…

> a revolution in knowledge-worker productivity. That's a nice euphemism for "imminent mass layoffs and a race to the bottom"...

The idea that someone should be paid by a corporation when they don't provide value is very strange to me. Doing so seems like the real race to the bottom

Re: GPT-5 is behind schedule

#790

Post by vidarh »

jaybna wrote: post #741

25% of the top 1000 websites are blocking OpenAI from crawling: https://originality.ai/ai-bot-blocking I am betting hundreds of thousands, rising to millions more little sites, will start blocking/gating this year. AI companies might license from big sources (you can see the blocking percentage went down), but they will be missing the long tail, where a lot of great novel training data lives. And then the big sites w…

All the big players are pouring a fortune into manually curated and created training data.

As it stands, OpenAI has a market cap large enough to buy a major international media conglomerate or two. They'll get data no matter how blocked they get.

Post reply on HN