The title seems misleading, and reading the article explains the reason more clearly. There's nonsense OKR's and objectives at these companies to burn as many tokens as possible. It turns out that when you make a metric out of token usage, it unsurprisingly ends up becoming extremely expensive. Inference is affordable, and you don't need a SOTA proprietary model to get a lot of use out of this technology. While you l…
Microsoft reports AI is more expensive than paying human employees
11–20 of 74 posts
Re: Microsoft reports AI is more expensive than paying human employees
#12It's the same reason Teams got so much attention during lockdown.
Re: Microsoft reports AI is more expensive than paying human employees
#13Re: Microsoft reports AI is more expensive than paying human employees
#14Re: Microsoft reports AI is more expensive than paying human employees
#15They've made a hardware LLM that reaches over 14k TPS on Llama 3.1 8B, and you can try it here: https://chatjimmy.ai/
So clearly hardware LLMs are the future, and the cost will be drastically reduced. But I know that all the AI labs want to create a perception of high prices forever.
Re: Microsoft reports AI is more expensive than paying human employees
#16Re: Microsoft reports AI is more expensive than paying human employees
#17With discipline, it’s an aggregator.
Re: Microsoft reports AI is more expensive than paying human employees
#18Re: Microsoft reports AI is more expensive than paying human employees
#19Re: Microsoft reports AI is more expensive than paying human employees
#20The title seems misleading, and reading the article explains the reason more clearly. There's nonsense OKR's and objectives at these companies to burn as many tokens as possible. It turns out that when you make a metric out of token usage, it unsurprisingly ends up becoming extremely expensive. Inference is affordable, and you don't need a SOTA proprietary model to get a lot of use out of this technology. While you l…