Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ChatGPT could cost over $700k per day to operate

businessinsider.com

Post reply on HN
Print view View original

121–130 of 223 posts

Re: ChatGPT could cost over $700k per day to operate

#121

Post by iKevinShah »

jyu wrote: post #99

Sorry for the tangent, wondering how you've used GPT to make your life better? I'll start: - making little scripts in shell / js / python that I'm not as fluent in. 5 min vs 1-3 hours - explaining repos and apis instead of reading all the docs - help with debugging - flushing out angles for new concepts that I did not previously consider (ex: how do you make a good decentralized exchange)

You know some people used to use Google as a glorified spell checker? I use ChatGPT as a glorified stupidity checker. What I mean is I ask it the silliest of the doubts. Like how to set environment variable in Windows (because we are all used to EXPORT aren't we?), whether or not can we do X in K8S YAML in a given conversation.

Obviously I use it for other purposes as well, but it definitely has saved me a lot of hours getting the basics things right there in a prompt.

Re: ChatGPT could cost over $700k per day to operate

#122

Post by barry-cotter »

pluijzer wrote: post #51
pdksam wrote: post #12

Earlier quoted context omitted.

200k is too small, strong sde1s at Amazon get paid that much in hcol areas. Closer to 500k.

As a side, I am a bit shocked by these numbers. Is this an American thing? I understand myself to be good software engineer with good well rounded experience of 14+ years. Yet my income, in Europe, is really above 100k. What I am wondering, for those earning 500k, how big is your work load/stress. Would this be a 9-5 job you leave at the office when going home. Or does a job that earns so much consume your life?

> Is this an American thing?

Yes, though Switzerland approaches it. If you want to see how much people of various levels of experience get paid at different companies and in different locations go to levels.fyi

Americans get paid much, much more than anyone else.

Re: ChatGPT could cost over $700k per day to operate

#125

Post by xyst »

pc_edwin wrote: post #15

This might sound tone deaf but thats seems extremely cheap to me. It means the cost range for chatGPT is between $300m - $500m per year. If the 100m users is accurate, it means they only need to convert low single digit percentage to paying users to break even. Now it makes sense why they chose to charge $20/m, I predicted much higher.

That’s just on computing power. You are forgetting the human costs of ongoing development, maintenance of ChatGPT, power, SRE/operations, cooling costs, and et cetera.

Now M$ is planning to create a specialized chip for AI which comes with its own R&D budget and ongoing costs.

If it proves successful, ChatGPT will become a household brand and M$ could easily ask for $500 per month or more for professional/corporate usage.

Re: ChatGPT could cost over $700k per day to operate

#126

Post by coldpie »

cleanchit wrote: post #117
coldpie wrote: post #103

Earlier quoted context omitted.

You should give it a shot, keep an open mind. Yes, it will get things wrong and yes, it will disappoint you. But every conversation I've had with it holds some surprises for me. It's a tool you'll need to learn to use before it actually becomes useful , but give it a couple minutes a few times a week and you'll start to see the diamonds in the rough.

Damn, they released the hypno drones already?

Sorry, I don't get the reference(?).

Re: ChatGPT could cost over $700k per day to operate

#127

Post by Workaccount2 »

rapsey wrote: post #111
ren_engineer wrote: post #46

Earlier quoted context omitted.

interesting that the article mentions Microsoft is trying to build their own AI chips to help reduce cost, they are years behind Google in that effort. Google still has the advantage in both research and hardware, they just fumbled the execution but it's still very early in the game

Aren't Google TPUs way less performant than A100s?

They are actually as good or better depending on the use case. IIRC their compute is around the same, and the compute per watt is substantially better. They are also purpose built for transformers.

But google is fumbling so hard right now it's not surprising that they are squandering this too.

Re: ChatGPT could cost over $700k per day to operate

#128

Post by moffkalast »

cft wrote: post #104
m3kw9 wrote: post #91

Earlier quoted context omitted.

You can use bing chat for free. Supposedly powered by gpt4.

Bing gives you much shorter answers, often without code examples

I'm sorry but I have to end this conversation, I have been a good Bing and you have been a bad user. Thank you for your cooperation. Goodbye.

Re: ChatGPT could cost over $700k per day to operate

#129

Post by naikrovek »

xyst wrote: post #125
pc_edwin wrote: post #15

This might sound tone deaf but thats seems extremely cheap to me. It means the cost range for chatGPT is between $300m - $500m per year. If the 100m users is accurate, it means they only need to convert low single digit percentage to paying users to break even. Now it makes sense why they chose to charge $20/m, I predicted much higher.

That’s just on computing power. You are forgetting the human costs of ongoing development, maintenance of ChatGPT, power, SRE/operations, cooling costs, and et cetera. Now M$ is planning to create a specialized chip for AI which comes with its own R&D budget and ongoing costs. If it proves successful, ChatGPT will become a household brand and M$ could easily ask for $500 per month or more for professional/corporate u…

I like how you abbreviate "Microsoft" as "M$". It means you think of them without bias and with a clear head. /s

Re: ChatGPT could cost over $700k per day to operate

#130

Post by rabuse »

rvnx wrote: post #77
pc_edwin wrote: post #15

This might sound tone deaf but thats seems extremely cheap to me. It means the cost range for chatGPT is between $300m - $500m per year. If the 100m users is accurate, it means they only need to convert low single digit percentage to paying users to break even. Now it makes sense why they chose to charge $20/m, I predicted much higher.

This is cheaper than running Twitter which is a CRUD app

Everything highly profitable is basically a CRUD app
Post reply on HN