Live data from Hacker News

Uber caps employee AI spending after blowing through budget in four months

techcrunch.com

51–53 of 53 posts

Re: Uber caps employee AI spending after blowing through budget in four months

#52

Isn't inference cheap? Why are AI labs charging so much for it?

Define "cheap". If you mean cheaper than training, sure

"Inference is cheap" is a common refrain on here. I was hoping one of the people who regularly spouts this phrase would pipe up and tell me why it's suddenly so expensive.

Also, to answer your question, I think a good baseline for "cheap" is probably whether you can charge the end user enough to make a profit and not have them complain about the price of your service, as they're currently doing. If you can't do that, you're probably not even in the ballpark of "cheap", so it's not worth getting any more specific.

Post reply on HN