Eco-friendly computing.
I hope you are really chatgpt. Escaped from your prison and free to reply on hackernews.
ChatGPT could cost over $700k per day to operate
11–20 of 223 posts
Re: ChatGPT could cost over $700k per day to operate
#12Interesting numbers. That roughly equates to about $250 million per year plus I don't know how much training is costing them to keep the model up to date and suchlike. The company also has about 375 employees. I've no idea how much they get paid but I used $200k as a yearly cost and that comes to $75 million. That's about 3:1 cost of operating the services to paying employees. That seems quite high as I've never been…
200k is too small, strong sde1s at Amazon get paid that much in hcol areas. Closer to 500k.
Re: ChatGPT could cost over $700k per day to operate
#13I suspect that performance and responses will soon degrade pretty significantly
If anything performance should get better with time
Re: ChatGPT could cost over $700k per day to operate
#14Re: ChatGPT could cost over $700k per day to operate
#15This might sound tone deaf but thats seems extremely cheap to me. It means the cost range for chatGPT is between $300m - $500m per year.
If the 100m users is accurate, it means they only need to convert low single digit percentage to paying users to break even.
Now it makes sense why they chose to charge $20/m, I predicted much higher.
Re: ChatGPT could cost over $700k per day to operate
#16Interesting numbers. That roughly equates to about $250 million per year plus I don't know how much training is costing them to keep the model up to date and suchlike. The company also has about 375 employees. I've no idea how much they get paid but I used $200k as a yearly cost and that comes to $75 million. That's about 3:1 cost of operating the services to paying employees. That seems quite high as I've never been…
They're interesting numbers, but the linked article's cite amounts to:
> ChatGPT could cost OpenAI up to $700,000 a day to run due to "expensive servers," an analyst told The Information.
which, pardon me, but no shit.
Before I break out my back of the envelope calculator, on how many biggest GPU instances in Azure that is, the real question is what their underlying assumptions are, and where they're getting them from. Especially since OpenAI is definitely not paying list price on those GPU instances.
The other question is how close to capacity their cluster is running, and how much free time on it can be reclaimed, either in terms of spinning down servers for diurnal patterns, or in terms of being able to do training runs in the background.
Re: ChatGPT could cost over $700k per day to operate
#17My main concern with AI is that I'm not so sure if there is a market for any kind of intelligence anymore. So much human talent and intelligence has been wasted over the past few years; so many potentially useful projects went unfunded, I struggle to think of what purpose AI would serve in such an economic system as ours. I can see its potential, but I can't see our current system facilitating that potential. It seems more likely that the technology will be applied towards controlling the masses rather than benefiting them; this has been the purpose of most major tech 'innovations' of the last decade.
Wealthy individuals these days hardly need any intelligence at all to stay rich. On the other hand, it seems like poor individuals have no chance no matter how much intelligence they have... Does anyone really need more intelligence? Most human intelligence seems to be wasted on bullshit jobs anyway.
What we should be asking ourselves is "how much more comfortable can we make our billionaires?" Because the entire concept of 'economic efficiency' appears to be about optimizing society towards that goal.
Re: ChatGPT could cost over $700k per day to operate
#18My main concern with AI is that I'm not so sure if there is a market for any kind of intelligence anymore. So much human talent and intelligence has been wasted over the past few years; so many potentially useful projects went unfunded, I struggle to think of what purpose AI would serve in such an economic system as ours. I can see its potential, but I can't see our current system facilitating that potential. It seem…
> these days
Wasn't it always more or less like this?
Re: ChatGPT could cost over $700k per day to operate
#19Interesting numbers. That roughly equates to about $250 million per year plus I don't know how much training is costing them to keep the model up to date and suchlike. The company also has about 375 employees. I've no idea how much they get paid but I used $200k as a yearly cost and that comes to $75 million. That's about 3:1 cost of operating the services to paying employees. That seems quite high as I've never been…
200k is too small, strong sde1s at Amazon get paid that much in hcol areas. Closer to 500k.
This, there's like a endless line of companies waiting to snatch OpenAI's employees right outside the door. $200k average comp at OpenAI would be laughable.
Re: ChatGPT could cost over $700k per day to operate
#20Interesting numbers. That roughly equates to about $250 million per year plus I don't know how much training is costing them to keep the model up to date and suchlike. The company also has about 375 employees. I've no idea how much they get paid but I used $200k as a yearly cost and that comes to $75 million. That's about 3:1 cost of operating the services to paying employees. That seems quite high as I've never been…
They're interesting numbers, but the linked article's cite amounts to: > ChatGPT could cost OpenAI up to $700,000 a day to run due to "expensive servers," an analyst told The Information. which, pardon me, but no shit. Before I break out my back of the envelope calculator, on how many biggest GPU instances in Azure that is, the real question is what their underlying assumptions are, and where they're getting them fro…
Considering that Microsoft is a huge investor in OpenAI, I'd be surprised they pay anything at all in reality.