Live data from Hacker News

After the AI boom: what might we be left with?

blog.robbowley.net

211–220 of 489 posts

Re: After the AI boom: what might we be left with?

#211

Earlier quoted context omitted.

You have to verify everything from human developers too. They hallucinate APIs when they try to write code from memory. So we have: - documentation - design reviews - type systems - code review - unit tests - continuous integration - integration testing - Q&A process - etc. It turns out when include all these processes, teams of error-prone human developers can produce complex working software. Mostly -- sometimes th…

Taking the example of egyptian archeology, if you're reading the work of someone who is well regarded as an expert in the field, you can trust their word a lot more than you can trust the word of an AI, even if the AI is provided the text you're reading. This is a pretty massive difference between the two, and your narrative is part of why AI is proving to be so harmful for education in general. Delusional dreamers a…

The vast majority of people trying to do any given thing simply don’t have access to experts in the field, though.

I’ll take a potential solution I can validate over no idea whatsoever of my own any day.

Re: After the AI boom: what might we be left with?

#212

Earlier quoted context omitted.

Your assertions are at odds with modern computers - including Nvidia datacenter GPUs - still working fine after many, many years. If not for 1. improved power efficiency on new models and 2. Nvidia'a warranty coverage expiring, datacenters could continue running those GPUs for a long time.

Which GPUs have been running for decades that you're referring to? The A100s that are 4 years old? MTBFs for GPUs are about 5-10 years, and that's not about fans. AWS and the other clouds have a 5-8 year depreciation calendar for computers. That is not "decades." You can keep a server running for 10-15 years, but usually you do that only when the server is in a good environment and has had a light load.

> Which GPUs have been running for decades that you're referring to? The A100s that are 4 years old? MTBFs for GPUs are about 5-10 years, and that's not about fans.

I said solid state components last decades. 10nm transistors have a thing for over 10 years now and other than manufacturer defect don't show any signs of wearing out from age.

> MTBFs for GPUs are about 5-10 years, and that's not about fans.

That sounds about the right time for a repaste.

> AWS and the other clouds have a 5-8 year depreciation calendar for computers.

Because the manufacturer warranties run out after that + it becomes cost efficient to upgrade to lower power technology. Not because the chips are physically broken.

Re: After the AI boom: what might we be left with?

#213

Earlier quoted context omitted.

The whole point of the article is that the dotcom era produced long term assets that stayed valuable for decades after the bubble burst, and argues that the AI era is producing short term assets that won’t be of much use if the bubble bursts.

But the chips of the dotcom era were not long-term assets. The author appears to claim that.

Where? I scanned the article again. I can’t seem to find that.

Re: After the AI boom: what might we be left with?

#214

Earlier quoted context omitted.

> we are on the cusp of intelligent machines That's an extremely speculative view that has been fashionable at several points in the last 50 years.

How often in the last 50 years have those machines done what these machines do?

Define "do" in this context. If you mean hardware-accelerated matmul, then machines have been doing that for half a century.

Re: After the AI boom: what might we be left with?

#215

Earlier quoted context omitted.

"AI" has been doing that since the 1950s though. The problem is that each time we define something and say "only an intelligent machine can X" we find out that X is woefully inadequate as an example of real intelligence. Like hilariously so. e.g. "play chess" - seemed perfectly reasonable at the time, but clearly 1980s budget chess computers are not "intelligent" in any very useful way regardless of how Sci Fi they w…

yeah im in agreement, ai will eventually do everything a human being can

Perhaps, but why are you so convinced we're so close when we weren't all the other times?

Re: After the AI boom: what might we be left with?

#216

> GPUs that have a 1-3 year lifespan In 10 years GPUs will have a lifespan for 5-7 years. The rate of improvement on this front has been slowing down faster then CPU.

There's some telephone game being played here. The three year number was a surprisingly low figure sourced to some anonymous Google engineer. Most people were assuming at least 5 years and maybe more. BUT, Google then went on record to deny that the three year figure was accurate. They could have just ignored it, so it seems likely that three years is too low. Now I read 1-3 years? Where did one year come from? GPU l…

> Where did one year come from?

Perhaps the author confused "new GPU comes out" with "old GPU is obsolete and needs replacement"

Re: After the AI boom: what might we be left with?

#217
post #96
post #38

Earlier quoted context omitted.

Speech to text and vice versa exists for over a decade. Where's the life altering application from that?

> Speech to text and vice versa exists for over a decade. Indeed. I was using speech to text three decades ago. Dragon Naturally Speaking was released in the 90s.

Then you hopefully remember how “natural” it actually was.

Re: After the AI boom: what might we be left with?

#218

Earlier quoted context omitted.

> we are on the cusp of intelligent machines That's an extremely speculative view that has been fashionable at several points in the last 50 years.

How often in the last 50 years have those machines done what these machines do?

On every occasion you could have made exactly the same point.

Re: After the AI boom: what might we be left with?

#219
post #146
post #108

Local/open-weight models are already incredibly competent. Right now a Mac Studio with 256GB can be found for less than $5000, and an equivalent workstation will likely be 50% cheaper in a year. If anything that price is higher because of the boom, rather than subsidized by a potential bubble. It can run a 8bit quant of GPT-OSS 120B, or 4bit quant of GLM-4.6 using only an extra 100-200W. That energy use comes out to…

I have an M4 MBP and I also think Apple is set up quite nicely to take real advantage of local models. They already work on the most expensive Apple hardware. I expect that price to come down in the next few years. It’s really just the UX that’s bad but that’s solvable. Apple isn’t having to pay for each users power and use either. They sell hardware once and folks pay with their own electricity to run it.

Your comment made me realize that there's also the benefit of not having to handle the hardware depreciation, it's pushed to the customer. And now Apple has renewed arguments to sell better machines more often ("you had ChatGPT 3-like performance locally last year, now you can get ChatGPT 4-like performance if you buy the new model").

I know folks who still use some old Apple laptops, maybe 5+ years old, since they don't see the point in changing (and indeed if you don't work in IT and don't play video games or other power-demanding jobs, I'm not sure it's worth it). Having new models with some performant local LLM built-in might change this for the average user.

Re: After the AI boom: what might we be left with?

#220

Earlier quoted context omitted.

who cares about a bubble? we are on the cusp of intelligent machines. The implications will last for hundreds of years, maybe impact the trajectory of humanity

> we are on the cusp of intelligent machines That's an extremely speculative view that has been fashionable at several points in the last 50 years.

Things like getting gold in the math olympiad and 120 on iq tests are kinda cuspy and not been there in 49 of the last 50 years.
Post reply on HN