Live data from Hacker News

AI sticker shock hits corporate America

axios.com

91–100 of 154 posts

Re: AI sticker shock hits corporate America

#91

We use GH Copilot at work and this week sat for a presentation by GH about optimizing token usage and maximizing ROI on tokens used. Anyone else get this presentation? They didn’t have time for questions because they had to run and give it to the next big enterprise on their list… They basically said that everything is too expensive, you have to watch it like a hawk. It was as if they poured a bucket of cold water on…

Just hire people and pay then a fair wage and let everyone get richer together ffs When did American capitalism become such a zero sum game

If you're in a market where a competitor can cut their costs to produce the same quality product, end customers don't know (and if they knew, 95+% of them don't give a crap) how rich you've helped your employees get.

If someone else can make it more efficiently, there's a powerful force for you to also have to improve to match that efficiency.

"Why is the airline experience so much worse than 50 years ago?" "It's massively cheaper per seat-mile, and consumers in aggregate reveal that they prefer the cheapest price that online travel searches, so airlines deliver to that preference."

Re: AI sticker shock hits corporate America

#92
post #81

Earlier quoted context omitted.

We are since at least the 2000s when the world wide web revolution finally made it possible for Google, Apple, Amazon etc... to become the behemoths they are. And maybe even before that. And the answer is no, because when chief officers succeed it's because of their genius and forward thinking posture, but when they fail it's none of their fault, so they are shielded in an echo chamber that produces such delusions an…

Way before that, as usual we can attribute quite a lot of stupidity in corporate governance to Jack Welch. Execs really bought into Welch's schtick wholly, they went to MBA schools praising Welch's management style, read his books, or at least got taught by people who had bought wholly into it. So much time has passed that I believe truly the current crop of execs don't know any better, they think this status quo is…

Agreed. For a long time Jack Welch was lauded as "The Greatest CEO in History" for burning GE to the ground in a way that made a lot of money (while destroying a company that took 100 years to build and employed 400,000 people).

By the time he died (pretty recently actually, 2020!), it was pretty obvious what kind of legacy he was leaving behind. Which is probably why his family was very careful to keep his burial location secret, presumably to keep people from peeing on his grave.

Re: AI sticker shock hits corporate America

#94
> "Most people default to automating tasks they dislike rather than tasks most valuable to the company," Sophia Velastegui, CEO of Velastegui Ventures and former chief AI officer at Microsoft, told Axios. Instead, they should focus on using AI to drive revenue.

That's right! Work, slave, pain away every day! How dare you make your life a bit less miserable?!

Re: AI sticker shock hits corporate America

#95
post #33

Earlier quoted context omitted.

Ah, that's not how it works : CEOs are rich so they are successful. They are successful so they are rich. Q.E.D.

Maybe in your fantasy world. In reality people are rarely rich based on merit alone. EDIT: Sorry it was a really clever joke.

>>>EDIT: Sorry it was a really clever joke.

I sincerely hope that was your attempt at sarcasm.

Re: AI sticker shock hits corporate America

#96

Earlier quoted context omitted.

Yeah, everything is fine until you don’t want to use AI for something because it sucks at that task and then you end up on a PiP because your token burn is low. Why the f*ck are AI Token Use Leaderboards even a thing. Features that used to take months are now expected in days. Oh you didn’t merge 40 pull requests and deploy to prod 15 times today? Aren’t you using Opus the greatest thing since the invention of the wh…

> on a PiP because your token burn is low Does this happen? I’ve never been at a company that measures employee performance by token burn targets. I suspect most companies don’t do that, but I could be wrong obviously.

I doubt it, but I've seen dumber stuff like laying off people because they think AI will replace them

Re: AI sticker shock hits corporate America

#97
> Corporate leaders are starting to question whether soaring AI spending is delivering meaningful returns.

This is act one the AI bear market. Yes I know everyone screams “bubble”. Let me explain the scenario I have in mind.

1. AI booms because the technology seems to actually have promise of revolutionizing how work gets done. It can do your taxes! It can drive Excel! It can act as a CEO! It can code up full apps and SaaS products! It can replace this vendor or that! You know the drill.

2. Every company must in corporate AI or be seen as obsolete. Having a bad quarter? Announce that you are “seeking to explore opportunities to develop an AI integration plan framework” for your plumbing business. Massive AI compute buying happens. While two of the three major AI houses are not publicly traded proxies like Nvidia and RAM manufacturers are so the market rips higher and higher. Nvidia trades as if it is already 10+ years from now, every company out there has adopted AI perfectly, and it is delivering huge profits to them.

3. Reality checks start pouring in. Turns out that not only is AI expensive (a problem that presumably will be taken care of with time and development), but that the technology itself just isn’t suitable for everything. (IMHO it’s great at augmenting a power user but it is terrible at interacting directly with customers). We start seeing individual companies change tone on investment. They can’t stop it due to momentum but they are starting to shift the narrative to warn of what comes next. This is where we are.

4. Numbers come in. Earnings show what the actual ROI is. Some companies do benefit, but crucially we see examples of where investing in AI destroys value. I think this happens when replace crucial parts of their workforce with agents and find that they lost in-house expertise, when customers left due to worse products, or simply when AI was roughly as expensive as human labor without being significantly more productive.

5. The market stumbles. What do you mean AI won’t take over every corporate America?! Surely that can’t be right! Nvidia and other proxies flag.

6. In a late to the game rush Anthropic and OpenAI IPO fearing that the market has noticed that the emperor has no clothes. Their internal numbers turn out to be scary: very high revenue but no path to insane profitability. They quickly get included in QQQ and maybe even S&P500 but as their IPO price is the highest they trade they drag the broad market indexes down. This is leveraged by the Nvidia proxy status.

7. Infrastructure course correction. Hyperscalers who started huge datacenter buildouts cannot justify it. They pay contract penalties and get out of some of the projects, writing down losses. The market fully melts.

—-

I think there is a competing market downturn fueled by the affordability squeeze. Basically while AI spend is corporate driven, the biggest investors are consumer companies. Of the hyperscalers you can maybe argue that Microsoft is not a B2C fully but it is close. If consumers don’t have money to spend, hyperscalers take a hit, investment slows from there, and AI is hit directly by it.

I think either scenario is likely, it’s just which happens first. But right now the market is sprinting down a tight rope and trading like that tight rope has no end and that the sprinter never makes a mistake regardless of wind changes. Everything has to go right for a very long time to justify valuations. One stumble can stop it all.

Re: AI sticker shock hits corporate America

#98

We use GH Copilot at work and this week sat for a presentation by GH about optimizing token usage and maximizing ROI on tokens used. Anyone else get this presentation? They didn’t have time for questions because they had to run and give it to the next big enterprise on their list… They basically said that everything is too expensive, you have to watch it like a hawk. It was as if they poured a bucket of cold water on…

Did you have any good tips for optimizing usage? The ones I’ve stumbled upon seem to be: switch models based on task complexity, use tooling like ASTs and compression, disable unused MCPs, compact often, be verbose with input to give clear guidance…

I don't think compacting often is good for saving money. It generates more output tokens and then the input is no longer from cache, which is priced differently...typically very differently.

Re: AI sticker shock hits corporate America

#99

>Corporate leaders are starting to question whether soaring AI spending is delivering meaningful returns. This isn't surprising. Ive recently run into quite a few rabbit holes where AI is bad enough that its much more efficient to do it myself. I wanted to refactor some code, gave it a design pattern to go towards, some specific classes and methods, etc. making it a well described problem. AI just couldn't do it sati…

[dead]
Post reply on HN