Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

IBM CEO says there is 'no way' spending on AI data centers will pay off

businessinsider.com

Post reply on HN
Print view View original

731–740 of 985 posts

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#731

Post by staticassertion »

gloosx wrote: post #638
bloppe wrote: post #590

Earlier quoted context omitted.

Would you mind sharing some of these projects? I've found Claude's usefulness is highly variable, though somewhat predictable. It can write `jq` filters flawlessly every time, whereas I would normally spend 30 minutes scanning docs because nobody memorizes `jq` syntax. And it can comb through server logs in every pod of my k8s clusters extremely fast. But it often struggles making quality code changes in a large code…

It is always "I'm producing 300 projects in a nanosecond" but it's almost never about sharing or actually deploying these ;)

There's a massive incentive not to share them. If I wrote a project using AI I'd be reluctant to publish it at all because of the backlash I've seen people get for it.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#732

Post by greenie_beans »

arisAlexis wrote: post #519
brokenmachine wrote: post #454

Earlier quoted context omitted.

We have 8.3 billion examples of general intelligence alive on the planet right now. Surely an artificial one in a data center, costing trillions and beholden to shareholders, will solve all society's issues!

I suggest you read Amodei post called "machines of loving grace". It will change your worldview (probably).

as a counterpoint, you should read this essay with the same title: https://www.clunyjournal.com/p/machines-of-loving-grace

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#733

Post by tikotus »

blablabla123 wrote: post #533

Despite the flashy title that's the first "sober" analysis from a CEO I read about the technology. While not even really news, it's also worth mentioning that the energy requirements are impossible to fulfill Also now using ChatGPT intensely since months for all kinds of tasks and having tried Claude etc. None of this is on par with a human. The code snippets are straight out of Stackoverflow...

I'd rather phrase it as "code is straight out of GitHub, but tailored to match your data structures"

That's at least how I use it. If I know there's a library that can solve the issue, I know an LLM can implement the same thing for me. Often much faster than integrating the library. And hey, now it's my code. Ethical? Probably not. Useful? Sometimes.

If I know there isn't a library available, and I'm not doing the most trivial UI or data processing, well, then it can be very tough to get anything usable out of an LLM.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#734

Post by gessha »

geerlingguy wrote: post #483
vesrah wrote: post #435

Earlier quoted context omitted.

The GPUs going into data centers aren't the kind that can just be reused by putting them into a consumer PC and playing some video games, most don't even have video output ports and put out FPS similar to cheap integrated GPUs.

And the big ones don't even have typical PCIe sockets, they are useless outside of behemoth rackmount servers requiring massive power and cooling capacity that even well-equipped homelabs would have trouble providing!

Don’t underestimate a homelaber’s intention to cosplay as a sysadmin or ability to set their house on fire ;)

I wonder if people will come up with ways to repurpose those data center cards.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#735

Post by forty »

properbrew wrote: post #676
bloppe wrote: post #590

Earlier quoted context omitted.

Would you mind sharing some of these projects? I've found Claude's usefulness is highly variable, though somewhat predictable. It can write `jq` filters flawlessly every time, whereas I would normally spend 30 minutes scanning docs because nobody memorizes `jq` syntax. And it can comb through server logs in every pod of my k8s clusters extremely fast. But it often struggles making quality code changes in a large code…

Not the OP you're replying to, but I've put together quite a few projects using only LLMs, no hand crafted code anywhere (I couldn't do it!) https://dnbfamily.com https://eventme.app https://blazingbanana.com https://play.google.com/store/apps/details?id=com.blazingban... https://play.google.com/store/apps/details?id=com.blazingban... https://play.google.com/store/apps/details?id=com.blazingban... Are they perfect? N…

Maybe the most depressing part of all this is if people start thinking they would not have been able to do things without the LLM. Of course they would have, it's not like LLMs can do anything that you cannot. Maybe it would have taken more time at least the first time and you would have learned a few things in the process.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#736

Post by gessha »

mike_hearn wrote: post #612
chii wrote: post #453

Earlier quoted context omitted.

i dont mean consumer market for video cards - i mean a consumer buying ai chips to run themselves so they can have it locally. If i can buy a $10k ai card for less than $5000 dollars, i probably would, if i can use it to run an open model myself.

Why would you do that when you can pay someone else to run the model for you on newer more efficient and more profitable hardware? What makes it profitable for you and not for them?

Control and privacy?

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#737

Post by __MatrixMan__ »

gloosx wrote: post #638
bloppe wrote: post #590

Earlier quoted context omitted.

Would you mind sharing some of these projects? I've found Claude's usefulness is highly variable, though somewhat predictable. It can write `jq` filters flawlessly every time, whereas I would normally spend 30 minutes scanning docs because nobody memorizes `jq` syntax. And it can comb through server logs in every pod of my k8s clusters extremely fast. But it often struggles making quality code changes in a large code…

It is always "I'm producing 300 projects in a nanosecond" but it's almost never about sharing or actually deploying these ;)

If you haunt the pull requests of projects you use I bet you'll find there's a new species of PR:

> I'm not an expert in this language or this project but I used AI to add a feature and I think its pretty good. Do you want to use it?

I find myself writing these and bumping into others doing the same thing. It's exciting, projects that were stagnant are getting new attention.

I understand that a maintainer may not want to take responsibility for new features of this sort, but its easier than ever to fork the project and merge them yourself.

I noticed this most recently in https://github.com/andyk/ht/pulls which has two open (one draft) PRs of that sort, plus several closed ones.

Issues that have been stale for years are getting traction, and if you look at the commit messages, it's AI tooling doing the work.

People feel more capable to attempt contributions which they'd otherwise have to wait for a specialist for. We do need to be careful not to overwhelm the specialists with such things, as some of them are of low quality, but on the whole it's a really good thing.

If you're not noticing it, I suggests hanging out in places where people actually share code, rather than here where we often instead brag about unshared code.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#738

Post by pezgrande »

3form wrote: post #615
b112 wrote: post #585

Earlier quoted context omitted.

The used market is going to be absolutely flooded with millions of old cards. I imagine shipping being the most expensive cost for them. The supply side will be insane. Think 100 cards but only 1 buyer as a ratio. Profit for ebay sellers will be on "handling", or inflated shipping costs. eg shipping and handling.

I assume NVIDIA and co. already protects themselves in some way, either by the fact of these cards not being very useful after resale, or requiring them to go to the grinder after they expire.

Dont they own socket for enterprise cards? I can't see consumers buying these card unless they are PCIE at the very least.

Re: IBM CEO says there is 'no way' spending on AI data centers will pay off

#740

Post by cpursley »

DoctorOW wrote: post #661
gloosx wrote: post #638

Earlier quoted context omitted.

It is always "I'm producing 300 projects in a nanosecond" but it's almost never about sharing or actually deploying these ;)

The problem I had that the larger your project gets, the more mistakes Claude makes. I (not a parent commenter) started with a basic CRUD web app and was blown away by how detailed it was, new CSS, good error handling, good selection and use of libraries, it could even write the terminal commands for package management and building. As the project grew to something larger Claude started forgetting that some code alre…

So, just like a human on a growing codebase?
Post reply on HN