Live data from Hacker News

GPU World

gpuworld.org

131–140 of 303 posts

Re: GPU World

#131

Earlier quoted context omitted.

agent's failures on long horizon tasks We've moved from LLMs being able to work on a task for about 2 minutes to about 2 hours in the last 18 months, and that's mostly limited by the context window size filling up. In 14 years time I don't really see a reason why that wouldn't have extended a time frame that's effectively continuous forever, or at least a ceiling that's indistinguishable from that. The question reall…

2 hours... of agent work, usually for the same output the average worker has to use much more time

Throw understanding images in there and it becomes less true in my experience. Sure they shit out code and search text well, but one infographic and they circle trying to rasterize it.

Re: GPU World

#132

Earlier quoted context omitted.

fertility is NOT a measure of happiness

Name one species that is happy whilst rapidly going extinct.

A species isn't a thing that can be happy or not.

Also the idea of a replacement rate of 1 equals rapidly going extinct is mathematically illiterate. Exponentials work both ways - in growth and decay - ie let's say the population halves every generation ~ 25 years - it would take nearly 1000 years to reach near zero - as half of half is a smaller absolute reduction each time.

Re: GPU World

#133
post #109

Earlier quoted context omitted.

This take is unfathomable to me. How are LLMs not massively revolutionary, despite them not being infallible? This comment reminds me of there being competitions for finding useful purposes for electricity when it was first discovered. Imagine talking about the usefulness of LLMs while thinking that LLMs in 2026 just compress a few TB of data into a set of weights and that's all they work with lol.

Whichever side of the divide you're on, I think it's really weird that on a site like HN (where people have at least a passing familiarity with technology) there are such polarised takes on whether it's the next industrial revolution, or a technological parlour trick. I'm giving away which side I'm on now, but most of the TAM have experienced the product at this point, and trillions of dollars have been invested. I w…

The TAM of electricity is 99.999% of humanity, yet there was 82 years between Alessandro Volta's Voltaic Pile experiments and the first electrical grid in the world, Pearl Street Station, New York City.

A farmer may have seen an LLM answering their questions about how to make a less dry chicken sandwich, but he hasn't seen a specifically designed and tested harness that autonomously manages a crop harvester. There is not a lot of work in this space right now, because programming and math are infinitely more verifiable, and the capabilities of never models would probably invalidate any usecases, but if the model progress slows down, all attention will go towards making them work for any aspect of production.

Re: GPU World

#134

Earlier quoted context omitted.

The fertility rate in China is 1. The fertility rate where I live is 1.21. 1 in 5 adult women where I live are on prescription anti-depressant medication. For comparison - the fertility rate under Stalin - the uber evil bad guy as we all know was between 3 and 4.5.

fertility is NOT a measure of happiness

Well, population explosions tend to happen in hellholes and sensible declines happen in civilized society. The term happiness of course isn't something you can measure that easily, though.

Re: GPU World

#135

> Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like? If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build u…

Absolutely untrue. LLM will be the automation force of everything. It will connect and orchestrate our entire society. It will be a much bigger impact that any other revolution in the past. Our lives will be unrecognizable in 10 years from now.

Re: GPU World

#136

Earlier quoted context omitted.

fertility is NOT a measure of happiness

Name one species that is happy whilst rapidly going extinct.

Do you think average human cares about "our species is going extinct" stuff? If not, why couldn't they be happy at the same time?

You seem to equate birth rate with happiness, but ignore efficacy and availability of modern contraception.

Re: GPU World

#137
post #94

Earlier quoted context omitted.

I disagree with this take. While LLMs themselves are currently unreliable, the work done in the math community on hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed. For now, that still requires experts to set up and monitor, but I do believe that in a couple of decades we’ll make progress on how to do more mundane tasks in a rel…

> I disagree with this take. While LLMs themselves are currently unreliable, the work done in the math community on hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed. For now, that still requires experts to set up and monitor, but I do believe that in a couple of decades we’ll make progress on how to do more mundane tasks in a r…

I generally side with your skepticism, but there are verifiable domains with economic value such as drug discovery.

Re: GPU World

#138

Earlier quoted context omitted.

Whichever side of the divide you're on, I think it's really weird that on a site like HN (where people have at least a passing familiarity with technology) there are such polarised takes on whether it's the next industrial revolution, or a technological parlour trick. I'm giving away which side I'm on now, but most of the TAM have experienced the product at this point, and trillions of dollars have been invested. I w…

Did you experience the popularization of the WWW? There were massive disagreements even among smart tech-savvy people. We even had a stock market boom and just cycle associated with it. Funnily, none of that mattered. What mattered is that enough ordinary people on the street found it useful, both for personal and business reasons. Ask yourself: are regular people using this tech, either as producers or consumers? An…

> Funnily, none of that mattered. What mattered is that enough ordinary people on the street found it useful, both for personal and business reasons.

Broad economic impact due to Internet boom in the the US came from 2 main categories: 1) New huge internet enabled tech companies appeared(Amazon, Google, Meta etc.), all created their own products, all were build on reliable foundational technology. LLMs is not a reliable foundational technology. 2) Existing legacy companies could utilize internet to connect their teams/departments/offices though a bunch of new software which were build on reliable foundational technology. LLMs is not a reliable foundational technology.

> And remember that this is the least powerful that it will ever be.

This mantra is being repeated but "serious LLMs's issues" I described are still there and will be there because they are part of how LLMs are built and work. Without addressing those you can't build products but LLMs's capability as a personal productivity tool will keep rising, yes.

The "best" possible outcome of LLMs to a broader economy might be that a smaller group of experts will be able to do the job in companies due to boost of their personal productivity and a bunch of people will be freed up(laid off) and they will have to go and work on something else and thus a boost of productivity in the economy. But it seems it won't be any low hanging fruits(problems to solve) this time as it was during the internet era. It is not like we out of problems: new cancer treatments, self driving cars, nuclear fusion, modular nuclear reactors etc. There is a huge value to capture there, here is the thing though, those are hard problems, it is not a new TikTok, gmail, netflix etc. Yes, people will have LLMs now but can we actually start solving hard problems with them? Because it might be the case that a gravy train of the last few decades for Silicon Valley is over, no more useless internet enabled services, no more billion dollar companies built on just applying internet to yet another thing and producing another digital product. People's free time is limited, its redistribution across digital services will not grow the economy, global internet penetration is already pretty high and won't grow that much, so there might not be much value to capture there.

Re: GPU World

#139
post #133

Earlier quoted context omitted.

Whichever side of the divide you're on, I think it's really weird that on a site like HN (where people have at least a passing familiarity with technology) there are such polarised takes on whether it's the next industrial revolution, or a technological parlour trick. I'm giving away which side I'm on now, but most of the TAM have experienced the product at this point, and trillions of dollars have been invested. I w…

The TAM of electricity is 99.999% of humanity, yet there was 82 years between Alessandro Volta's Voltaic Pile experiments and the first electrical grid in the world, Pearl Street Station, New York City. A farmer may have seen an LLM answering their questions about how to make a less dry chicken sandwich, but he hasn't seen a specifically designed and tested harness that autonomously manages a crop harvester. There is…

Fair points (and I appreciate very much that they read like a human wrote them). As a counter point - and I know it's a weak one - a few years ago people were telling me that crypto was going to replace currency, and soon every person on the planet would be using it for every transaction. Many people believe that will still happen, but I don't think many serious people do.

I want to believe there is big bucks in this technology - my employer is tied up in it and so is my compensation. I just find it personally very unremarkable in a way that I never did with phones or the internet. When I got my first phone, or first started using Dogpile for research - I saw immediate value, and would have paid big bucks to keep it in my life. AI has had a few years and a huge amount of investment (time and money) and if it disappeared overnight I wouldn't pay $10 to get it back. I keep trying it, there's just something missing in my brain where it should be clicking for me :(

Re: GPU World

#140

Earlier quoted context omitted.

Whichever side of the divide you're on, I think it's really weird that on a site like HN (where people have at least a passing familiarity with technology) there are such polarised takes on whether it's the next industrial revolution, or a technological parlour trick. I'm giving away which side I'm on now, but most of the TAM have experienced the product at this point, and trillions of dollars have been invested. I w…

Did you experience the popularization of the WWW? There were massive disagreements even among smart tech-savvy people. We even had a stock market boom and just cycle associated with it. Funnily, none of that mattered. What mattered is that enough ordinary people on the street found it useful, both for personal and business reasons. Ask yourself: are regular people using this tech, either as producers or consumers? An…

It's very hard to disagree with the point that it will get more powerful, perhaps in uenxpected ways.

I don't know that the average regular person is using this tech as a producer, and while it's hard not to consume it - I don't know if anybody consuming it really wants to. I'm in a bubble of people where we give it a lot more mindshare, but e.g my electrician is aware of the tech, knows what it does, and doesn't really care. I think you're right that if it could manage his books, help him rewire a switchboard, order inventory for him etc that would be very different.

Post reply on HN