Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPU World

gpuworld.org

Post reply on HN
Print view View original

191–200 of 303 posts

Re: GPU World

#191

Post by setopt »

flerovium114 wrote: post #150
xerlait wrote: post #137

Earlier quoted context omitted.

I generally side with your skepticism, but there are verifiable domains with economic value such as drug discovery.

Are LLMs doing drug discovery? To my knowledge, that’s all classic “machine learning”

Not yet, as far as I know, but perhaps someone will find a way to do that in the future. We're talking about the next two decades here, a lot can happen in that time.

DNA itself can be thought of as a language which describes proteins, and I personally don't know enough about the limits of LLMs as a technology to claim that it can never be adapted to, say, do reverse translation from desired protein shapes into DNA sequences.

Re: GPU World

#192

Post by RajT88 »

jstummbillig wrote: post #96
maxnevermind wrote: post #77

> Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like? If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build u…

The thing that would change it a lot is that people would start trading away their GPUs, because some people would get vastly more economic use out of them.

This. Look at what happened when the government gave out free ATSC tuners for people with old TV's. eBay filled up with ATSC tuners. lol

Re: GPU World

#193

Post by FuriouslyAdrift »

algoth1 wrote: post #166
chrismorgan wrote: post #149

This website has the distinction of being the first basically-just-content website I have ever encountered to break when web fonts are blocked (or otherwise fail to load). Other than the weird 5×5 colourful tile image thing near the top, all the content is in the document , but they go out of their way to break it in various baffling ways: ① if JS is disabled, it hides all the content behind a “Please enable JavaScri…

Probably lots of tracking behind the scenes requiring all the js

Privacy Badger didn't show any trackers.

Re: GPU World

#194

Post by Gareth321 »

roel_v wrote: post #109
maxnevermind wrote: post #77

> Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like? If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build u…

This take is unfathomable to me. How are LLMs not massively revolutionary, despite them not being infallible? This comment reminds me of there being competitions for finding useful purposes for electricity when it was first discovered. Imagine talking about the usefulness of LLMs while thinking that LLMs in 2026 just compress a few TB of data into a set of weights and that's all they work with lol.

I strongly agree. I cannot understand how anyone could seriously use this technology and come away thinking it's mostly useless. I suspect there is a LOT of bias baked into their opinion.

Re: GPU World

#195

Post by Gareth321 »

onion2k wrote: post #110
maxnevermind wrote: post #77

> Someday, such as in 2040, there may be available, for every human being, the performance equivalent of 'a B300 GPU for contemporary LLMs'. What would this world be like? If we talk about just LLMs, given how things have been going since ChatGPT, my bet it would not change that much. LLMs are not foundational technology such as Internet or Steam engine or Rail roads were. There are very few products that can build u…

agent's failures on long horizon tasks We've moved from LLMs being able to work on a task for about 2 minutes to about 2 hours in the last 18 months, and that's mostly limited by the context window size filling up. In 14 years time I don't really see a reason why that wouldn't have extended a time frame that's effectively continuous forever, or at least a ceiling that's indistinguishable from that. The question reall…

My codex tasks regularly cross 8 hours, and I'm only using Sol High. It's not unusual for tasks to span much longer. It just requires instructions to continue working until the spec is complete.

Anthropic and OpenAI are currently obsessed with getting humans out of the training and improvement loops. It's going to happen very soon and when it does I think we see staggering improvements in a very short space of time. Basically, the Singularity.

Re: GPU World

#196

Post by 2ajshg17 »

gwern wrote: post #5
tucnak wrote: post #2

Neal Stephenson is one of the judges. 40k seems like generous enough first prize. I wonder if they will accept a play.

> I wonder if they will accept a play. We will accept any words you think have a chance of being the best thing we will read about the premise of 'GPU World'. Because the premise is so specific, we wanted to leave participants a lot of freedom in how they used it. (Also a little bemused at the discussion of the grand prize amount here. $40k is a very generous prize for a short piece of writing. For perspective, the C…

Of course. Ex Sequoia members and crypto bros are generous.

How are you going to evaluate 10^6 submissions? Let me guess: You'll preselect with AI for the expedient narrative:

"AI will be democratized and a small model will run on any GPU and there will be no oligarchies and China will pay for all of it!"

Re: GPU World

#197

Post by lnrd »

ezoe wrote: post #126

Not all humans have equally capable literacy and industrial background. To use current Top AI SaaS models for coding, the users have to write text prompts. There is clear difference of result by programmer and non-programmer. Image and music generation have exactly same skill gap. So most human don't directly use AI even if it's available to all 8 billion population. But I really doubt we will have such all humans us…

It's "what if" thought exercise, doesn't need to be an accurate (or realistic) prediction.

Re: GPU World

#198

Post by debo_ »

chrismorgan wrote: post #149

This website has the distinction of being the first basically-just-content website I have ever encountered to break when web fonts are blocked (or otherwise fail to load). Other than the weird 5×5 colourful tile image thing near the top, all the content is in the document , but they go out of their way to break it in various baffling ways: ① if JS is disabled, it hides all the content behind a “Please enable JavaScri…

This is what happens when the world has a gpu per person

Re: GPU World

#199

Post by voncheese »

_superposition_ wrote: post #173
setopt wrote: post #94

Earlier quoted context omitted.

I disagree with this take. While LLMs themselves are currently unreliable, the work done in the math community on hooking up creative LLMs to reliable verifiers like Lean show that it’s possible to construct systems where the unreliability is suppressed. For now, that still requires experts to set up and monitor, but I do believe that in a couple of decades we’ll make progress on how to do more mundane tasks in a rel…

Most notably Paul Krugman Nobel winning economist in 98: "By 2005 or so, it will become clear that the Internet’s impact on the economy has been no greater than the fax machine’s." Predicting the future is hard.

Hadn't seen this quote before, amazing.

Also goes to show how hard it is to predict anything that is a massive change - these levels of changes are so infrequent that we can't rely on priors to predict the future.

Re: GPU World

#200

Post by ipsod »

HarlequinHair wrote: post #188
ipsod wrote: post #177

Earlier quoted context omitted.

> I don't know if anybody consuming it really wants to. You don't know of people who ask LLMs questions? Or just chat with it for fun and to learn? Maybe your electrician isn't interested. A pharmacist and a nurse I talk to are. Virtually everybody I've talked to uses it to some degree or another. I think it'll soon replace Alexa/Siri for most people, as well as google search. That's pretty far from nobody.

I think the first parent post all this conversation originated from, pointed that LLMs are not groundbreaking inventions. If people use it to replace voice assistants or search engines, you can see how this new invention is not really adding anything you already hadn't. AIs in general are very useful, but apart from the campaign they did to change everything's name into AI (also well known algorithms and "old" machin…

> If a technology is convenient for people, you shouldn't need to insist to make people use it.

This is like the railroads, and the tracks have been laid. Because of the enormous cost, it can't be left to "hope they'll find it useful," and has to be pushed like crazy, or we're going to be left with a train system with no goods or passengers, and no path into the future.

Personally, having AI as an intelligence I can call like it's a library from apps I build... and to help build those apps... I feel that the future is as bright as the sun. I've always believed in software, but I feel like a chef that's just discovered salt and butter.

I don't know what it means for the world stage, but I believe that software is the highest art, and it's just had an incalculably massive buff. As an artist, I am stoked. The possibilities for creation of good things are limitless, and if you can't see that, I can't help you.

However, I wouldn't necessarily invest in AI companies. I don't know how this all fits into the rest of the world, except that I believe in my own ability to make products, same as I ever did, but now with AI.

Post reply on HN