Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

491–500 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#491

Post by LoganDark »

ChickenNugger wrote: post #58
Cantinflas wrote: post #53

Earlier quoted context omitted.

It's amazing that "being two months out of date" in AI means that you are already a dinosaur

For real! This stuff is moving fast . It feels like just last week I was posting about how it's going to change...art. And now there are hilarious deepfake memes of past and current presidents shit talking about video games. There are a handful of ML art subs that have pretty amazing stuff daily. Especially the NSFW ones, which if you've studied any history of media VHS/DVD/Blu-ray/the internet, porn is a major innov…

> porn is a major innovation driver because humans are thirsty creatures.

Hehe, yeah. I'm personally waiting for a model that is good at nonhuman stuff. Not just furries... but the focus seems to be on human content for now.

Re: Introducing ChatGPT and Whisper APIs

#492

Post by tomohelix »

ChickenNugger wrote: post #211
goldfeld wrote: post #129

Earlier quoted context omitted.

What are some niche ML art subs to hang around in? Excepting the NSFW..

I don't know about niche, but MachineLearning and StableDiffusion are the only SFW ones. FWIW, the NSFW ones are unstable_diffusion, sdforall, sdnsfw, aipornhub

Oh yes, that part worths a lot...

Re: Introducing ChatGPT and Whisper APIs

#493

Post by thehours »

tchock23 wrote: post #337
juice_bus wrote: post #206

Earlier quoted context omitted.

Most of the value for me with ChatGPT+ is getting access when the system is at capacity.

Same here. That was the sole reason I upgraded. There were a few times where I really needed ChatGPT at a specific time and got the "we're at capacity" message. $20/mo is nothing to have that go away.

There were a few outages that also locked me out (obviously) as a paying subscriber. Not sure how often I was able to access it even though the service was ‘at capacity’. Knowing something like that might make me feel better about the value of Premium.

Re: Introducing ChatGPT and Whisper APIs

#494

Post by [deleted] »

shostack wrote: post #440
bicx wrote: post #183

Earlier quoted context omitted.

You can do this to an extent via fine-tuning, but you will need to do so via one of the other GPT-3 models rather than the ChatGPT API model (`GPT-3.5-turbo`). The latter is not available for fine-tuning.

I wonder if it would be possible to simply fine tune another GPT-3 model, have ChatGPT form the query based on input into ChatGPT's API, then pass that response into a call to the GPT-3 model, and take the response from that, pass it into ChatGPT, and ask for it to parse it and make sense of it.

[deleted]

Re: Introducing ChatGPT and Whisper APIs

#495

Post by skybrian »

novaRom wrote: post #376
skybrian wrote: post #177

Earlier quoted context omitted.

Stable Diffusion isn’t free if you include the cost of the machine. Maybe you already have the hardware for some other reason, though? To compare total cost of ownership for a business, you need to compare using someone else’s service to running a similar service yourself. There’s no particular reason to assume OpenAI can’t do better at running a cloud service. Maybe someday you can assume end users have the hardware…

Ever heard about Federated Learning? This is the way it goes. Also, I do run training with no matrix multiplication, just 3-bit weights, addition in log space, slight accuracy degradation, but much faster CPU only training.

Okay but I meant generating results, not training. If you're running Stable Diffusion, the weights are given, but it's not going to run on a random PC.

Re: Introducing ChatGPT and Whisper APIs

#496

Post by lumost »

inciampati wrote: post #408
freeqaz wrote: post #382

Earlier quoted context omitted.

It's definitely not happening at the high end of the market (NVIDIA A100s with 40GB or 80GB of RAM). The cards that were used for mining have since crashed in terms of prices, but those were always gamer cards and very rarely Datacenter cards.

The market segmentation is likely a result of Nvidia's monopoly position. They double the RAM and flops, improve the thermals and housing and sell for ten fold the price. It doesn't make sense to me. A cheap 4090 theoretically outperforms even the A6000 RTX Ada. https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni... Nvidia needs to satisfy gamers, who individually can't spend more than a few $k on a processo…

The main limiter in the data center setting is licensing, interconnects, and ram.

By contract - you can’t sell 4090s in a data center. You’ll find a few shops skirting this, but nobody can get their hands on 100k 4090s without raising legal concerns.

Likewise, nvidia A100s have more than a few optimizations through nvlink which are only available on data center chips.

Lastly, per card memory matters a lot Nvidia has lead the market on the high end here.

Re: Introducing ChatGPT and Whisper APIs

#497

Post by superkuh »

I switched from their gpt3 davinci model to the new chatgpt3.5-turbo and everyone who used the IRC bot was really disappointed. The chatgpt3.5-turbo is incredibly puritanical and refuses to answer a good fraction of the type of input bots on IRC get. Even innocuous stuff. I was excited about the system/user prompts and being able to easily add short term memory and contexts but if it only responds with, "Oh, it wouldn't be right for me to talk about that." it's not fun.

Re: Introducing ChatGPT and Whisper APIs

#498

Post by braingenious »

TeMPOraL wrote: post #485
braingenious wrote: post #448

Earlier quoted context omitted.

If I’m interacting with it without my knowledge or intent then I am _ DEFINITELY _ not paying $20 per month for that.

Well, let's put it differently: all those hypothetical services are using the API in question, so your marginal cost for them taken together adds to $20/month, which they'll pass onto you, and you'll then happily pay, because you find the services useful.

Maybe. I’m pretty frugal and a big fan of doing things myself. I certainly hope that they can some day can provide me with enough value to make spending $20 a no-brainer, but until that’s obvious or unavoidable, I’m not giving them $20 ¯\_(ツ)_/¯

Re: Introducing ChatGPT and Whisper APIs

#499

Post by gridlocdev »

ChickenNugger wrote: post #429

FYI: you can't sign up without an email address (which you have to verify) and then a phone number (which can't be a google voice / voip number). So count me out.

Those restrictions seem intended to prevent people from creating a bunch of bot accounts that exploit the free tier. (Which is a common problem among free tiers for CI services and free online games)

I’m curious, what are some better alternative authentication methods to combat that problem than requiring a phone number?

Re: Introducing ChatGPT and Whisper APIs

#500

Post by Tepix »

rictic wrote: post #437
alchemist1e9 wrote: post #243

Earlier quoted context omitted.

And $2.25 per hour on 1 year reservation means 8,760 hours x 2.25 = $19,710 rent for the year. Not a bad yield for the provider at all, but makes sense given overheads and ROI expected.

Cost of power usage is marginal compared to that too: 300W per A100 * 8766 hours per year * $0.12 per kWh = $316 to power an A100 for a year

$0.12 per kWh is a very low price these days
Post reply on HN