Funny, now it's the management saying "Go be a bohemian, experiment, spend freely." and the employee saying, "Hold on, where's my ROI?"
Tokenmaxxing is dead, long live tokenmaxxing
61–70 of 315 posts
Re: Tokenmaxxing is dead, long live tokenmaxxing
#62Tokenmaxxing was just a way to force employees to start leveraging AI in a meaningful way. For companies that have measured performance based on token spend, they can now dial it back. Employees have learned to leverage AI for things they wouldn’t have prior. Now they know what’s possible and what’s not. No one is stupid enough to always measure performance based on token spend and have unlimited budget. It was alway…
The smart move would have been to get lower level managers to assign specific employees to experiment with applying LLMs to their processes and report back. Then incorpoate the findings into their processes.
Instead there was FOMO mass hysteria. Now there is a backlash. And a lot of time and money wasted.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#63The implication that tokenmaxxing was an intentional and thoughtfully considered approach rather than blind hype-following by an overpaid manager class who are too far removed from value to understand the downsides of LLMs is hysterical beyond belief.
Worse, tokenmaxxing has been pushed by the labs hoping to charge those tokens by the pound on their API prices eventually, even if temporarily hiding such costs behind "highly subsidized plans" or frequent bug-induced "reset buttons"
I would wager most if not all of the tokenmaxxing was done on enterprise API priced plans, not subscription plans. You can't actually token"max" if you are limited in the amount of tokens you can use per 5 hours.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#64Tokenmaxxing was just a way to force employees to start leveraging AI in a meaningful way. For companies that have measured performance based on token spend, they can now dial it back. Employees have learned to leverage AI for things they wouldn’t have prior. Now they know what’s possible and what’s not. No one is stupid enough to always measure performance based on token spend and have unlimited budget. It was alway…
The smart move would have been to get lower level managers to assign specific employees to experiment with applying LLMs to their processes and report back. Then incorpoate the findings into their processes. Instead there was FOMO mass hysteria. Now there is a backlash. And a lot of time and money wasted.
Letting everybody freely experiment for a while is much more effective than appointing somebody to do just that.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#65This seems to happen with most big tech adoption in the first few years. The big data boom in the early 2010's had execs just buying up spark clusters and data lakes before they even had a clear analytical use case or governance.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#66Tokenmaxxing was just a way to force employees to start leveraging AI in a meaningful way. For companies that have measured performance based on token spend, they can now dial it back. Employees have learned to leverage AI for things they wouldn’t have prior. Now they know what’s possible and what’s not. No one is stupid enough to always measure performance based on token spend and have unlimited budget. It was alway…
Its not _just_ that. Orgs aren't remotely sensible at measuring anything that isn't counted in dollars.
employees who are on the ai bandwagon are there for the free management attention.
Management is cooked because the damn market is hard, money is tight and they can't afford to fight the top down love and $$$ thrown at AI.
If you zoom out, all the real money spent on energy to keep AI alive isn't going to be held in nvidia stock for too long. it will burst, but its stupid to time it.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#67At least it's being used. There are many examples of tech over-adoption, like building out capacity for 1M concurrent users, only to see 50.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#68Tokenmaxxing was just a way to force employees to start leveraging AI in a meaningful way. For companies that have measured performance based on token spend, they can now dial it back. Employees have learned to leverage AI for things they wouldn’t have prior. Now they know what’s possible and what’s not. No one is stupid enough to always measure performance based on token spend and have unlimited budget. It was alway…
No one is stupid enough to always measure performance based on token spend and have unlimited budget.
Accenture was.
Re: Tokenmaxxing is dead, long live tokenmaxxing
#69Tokenmaxxing was just a way to force employees to start leveraging AI in a meaningful way. For companies that have measured performance based on token spend, they can now dial it back. Employees have learned to leverage AI for things they wouldn’t have prior. Now they know what’s possible and what’s not. No one is stupid enough to always measure performance based on token spend and have unlimited budget. It was alway…
Thanks for posting the tweet, it was a very interesting read. A bit amusing knowing what's up with MS and Azure these days, but that's not the point!
Re: Tokenmaxxing is dead, long live tokenmaxxing
#70Earlier quoted context omitted.
I really don't understand this take. If you're a carpentry shop that just bought power tools for the first time and you're worried that your employees are sticking with hand tools because that's what they know, then you look for sawdust. The goal isn't to have people work at converting wood into sawdust, the point is that if you wanna see if the tools are working you wanna see proof they're actually being used. I'm s…
Why would a carpentry shop buy hundreds of thousands of dollars of power tools without consulting with their employees to see what they actually need to get their job done more effectively? The logic of buying the tools then forcing the employees to use them "or else" is completely backwards in any sane world. (Of course, we've all had bosses that went to some marketing seminar and come back having been tricked^Wsold…
Because those power tools had just been invented and no one had experience with them.
Though in theory power tools are faster than hand tools.