ChatGPT could cost over $700k per day to operate
businessinsider.com
ChatGPT could cost over $700k per day to operate
1–10 of 223 posts
Re: ChatGPT could cost over $700k per day to operate
#2I would have never paid $100 per month for software but here i am doing the same with api costs.
Re: ChatGPT could cost over $700k per day to operate
#3I would have never paid $100 per month for software but here i am doing the same with api costs.
Only 240,000 paying customers needed to cover $24M/mo server costs. I would assume personnel costs could be in the same class as well.
Re: ChatGPT could cost over $700k per day to operate
#4I would have never paid $100 per month for software but here i am doing the same with api costs.
What are you building?
Re: ChatGPT could cost over $700k per day to operate
#5Isn't Microsoft too late to the chip game? Both their competitors AWS and GCP have their own ML training chips, while Azure has nothing. The article seems like they may have something by next year, but by that time the competition would have evolved even more. Nadella has executed on strategy brilliantly but on the cloud seems it seems like the tech innovation is a bit lagging. It hasn't mattered that much so far though due to how entrenched the MS stack is in the enterprise.
Re: ChatGPT could cost over $700k per day to operate
#6Eco-friendly computing.
Re: ChatGPT could cost over $700k per day to operate
#7I suspect that performance and responses will soon degrade pretty significantly
Re: ChatGPT could cost over $700k per day to operate
#8Isn't Microsoft too late to the chip game? Both their competitors AWS and GCP have their own ML training chips, while Azure has nothing. The article seems like they may have something by next year, but by that time the competition would have evolved even more. Nadella has executed on strategy brilliantly but on the cloud seems it seems like the tech innovation is a bit lagging. It hasn't mattered that much so far tho…
Microsoft reportedly working on its own AI chips that may rival Nvidia’s
https://www.theverge.com/2023/4/18/23687912/microsoft-athena...
Re: ChatGPT could cost over $700k per day to operate
#9Interesting numbers. That roughly equates to about $250 million per year plus I don't know how much training is costing them to keep the model up to date and suchlike.
The company also has about 375 employees. I've no idea how much they get paid but I used $200k as a yearly cost and that comes to $75 million.
That's about 3:1 cost of operating the services to paying employees. That seems quite high as I've never been at a company that had 1:1 costs for running servers vs employee costs but I could entirely be off base here.
Given Sam Altman's recent comments on the days of these LLM being over I think maybe Microsoft or whomever is basically saying that they can't spend that much money and they need to control costs much more heavily.
Re: ChatGPT could cost over $700k per day to operate
#10[deleted]