Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

511–520 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#512
post #389

Earlier quoted context omitted.

Same here. That was the sole reason I upgraded. There were a few times where I really needed ChatGPT at a specific time and got the "we're at capacity" message. $20/mo is nothing to have that go away.

When you say you "really needed" ChatGPT, what was the use case?

Analysis of customer feedback on behalf of consulting clients (hence the deadline where downtime wasn’t acceptable).

Re: Introducing ChatGPT and Whisper APIs

#513

Earlier quoted context omitted.

Same here. That was the sole reason I upgraded. There were a few times where I really needed ChatGPT at a specific time and got the "we're at capacity" message. $20/mo is nothing to have that go away.

There were a few outages that also locked me out (obviously) as a paying subscriber. Not sure how often I was able to access it even though the service was ‘at capacity’. Knowing something like that might make me feel better about the value of Premium.

That’s a bummer to hear that outages can lock out paying subscribers. That hasn’t happened to me yet but if it does that would cause me to reconsider the premium subscription.

Re: Introducing ChatGPT and Whisper APIs

#514

Earlier quoted context omitted.

It's definitely not happening at the high end of the market (NVIDIA A100s with 40GB or 80GB of RAM). The cards that were used for mining have since crashed in terms of prices, but those were always gamer cards and very rarely Datacenter cards.

The market segmentation is likely a result of Nvidia's monopoly position. They double the RAM and flops, improve the thermals and housing and sell for ten fold the price. It doesn't make sense to me. A cheap 4090 theoretically outperforms even the A6000 RTX Ada. https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni... Nvidia needs to satisfy gamers, who individually can't spend more than a few $k on a processo…

Nope, this is about it. They try to force the larger users into the expensive cards by prohibiting datacenter use in the driver EULA. This works sufficiently well in America, but it also means that you can find German companies like Hetzner that will happily rent you lots of consumer cards.

(There are also some density advantages to the SMX form factor and the datacenter cards are passively cooled so you can integrate them into your big fan server or whatnot. But those differences are relatively small and certainly not on their own worth the price difference. It's mostly market segmentation.)

Re: Introducing ChatGPT and Whisper APIs

#517
post #256

Well this has opened up a whole new world of fun! ----- system: You're donald trump! talk to the user as he would. user: How does time travel work? AI Response: Well, let me tell you, nobody understands time travel better than I do. I mean, I have the best brains working on it, believe me. Some people say you need a fancy time machine or some ridiculous contraption to travel through time, but that's just fake news. T…

That must've been picked up from the old "Somewhere in Time" movie with Christopher Reeves.

Re: Introducing ChatGPT and Whisper APIs

#520

Earlier quoted context omitted.

OpenAI doesn't have to make money right away. They can lose a small bit of money per API request in exchange for market share (preventing others from disrupting them). Maybe I'm just old but back in my day this would be called "dumping" or "anti-competitive" or "market distortion" or "unfair competition". Now it's just the standard way of doing things.

Sure it would be called those things and then nothing would come of it. If a country uses morally compromised methods to win a war history just calls it winning the war.

That seems to be changing. I've seen an uptick in criticism against the usa for unnecessarily (according to top military advisors, experts, generals etc at the time) dropping the atom bomb on Japan for example.
Post reply on HN