Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

401–410 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#401

Post by TechBro8615 »

wolverine876 wrote: post #340
rootusrootus wrote: post #173

Earlier quoted context omitted.

> Do you find yourself frustrated working with your colleagues, thinking, “you know, I bet if they felt more free to utter racist slurs or endorse illegal activities, we would get a ton more done around here”? I once visited Parler just to see what it was like, and pretty quickly found that the answer to your question seems to be yes. There are definitely people who feel they need that kind of dialog in their life. Y…

I've never experienced that in any setting in my life. People will say yes to advocate a political point, but that's not how humans socialize anywhere, anytime in history afaik.

I agree with you for IRL interactions, but we need to accept that we now operate in two planes of (para-)socialization: IRL and online.

There are plenty of humans who enjoy vulgar online socialization, and for many of them, online (para-)socializing is the increasingly dominant form of socialization. The mere fact that it's easier to socialize over the internet means it will always be the plane of least resistance. I won't be meeting anyone at 3am but I'll happily shitpost on HN about Covid vaccines.

For anyone who gets angry during their two minutes of hate sessions, consider this: try to imagine the most absurd caricature of your out-group (whether that be "leftists" or "ultra MAGA republicans"). Then try to imagine all the people you know in real life who belong to that group. Do they really fit the stereotype in your head, or have you applied all the worst attributes of the collective to everyone in it?

This is why I don't buy all the "civil war" talk - just because people interact more angrily online doesn't mean they're willing to fight each other in real life. We need to modulate our emotional responses to the tiny slice of hyperreality we consume through our phones.

Re: Introducing ChatGPT and Whisper APIs

#402

Post by mk_stjames »

r3trohack3r wrote: post #12

Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.

I've ran Whisper locally via [1] with one of the medium sized models and it was damn good at transcribing audio from a video of two people having a conversation.

I don't know exactly what the use case is where people would need to run this via API; the compute isn't huge, I used CPU only (an M1) and the memory requirements aren't much.

[1] https://github.com/ggerganov/whisper.cpp

Re: Introducing ChatGPT and Whisper APIs

#404

Post by [deleted] »

osrec wrote: post #389
tchock23 wrote: post #337

Earlier quoted context omitted.

Same here. That was the sole reason I upgraded. There were a few times where I really needed ChatGPT at a specific time and got the "we're at capacity" message. $20/mo is nothing to have that go away.

When you say you "really needed" ChatGPT, what was the use case?

[deleted]

Re: Introducing ChatGPT and Whisper APIs

#405

Post by mike_d »

banana_giraffe wrote: post #100
travisjungroth wrote: post #79

Earlier quoted context omitted.

You split up the audio and send it over in a loop. Pass in the transcript of the last call as the prompt for the next one. See item 2 here: https://platform.openai.com/docs/guides/speech-to-text/promp...

And: > we suggest that you avoid breaking the audio up mid-sentence as this may cause some context to be lost. That's really easy to put in a document, much harder to do in practice. Granted, it might not matter much in the real world, not sure yet. Still, this will require more hand holding than I'd like.

The page includes a five line Python example of how to split audio without breaking mid-word.

Re: Introducing ChatGPT and Whisper APIs

#407

Post by sroussey »

pelasaco wrote: post #332
alchemist1e9 wrote: post #243

Earlier quoted context omitted.

And $2.25 per hour on 1 year reservation means 8,760 hours x 2.25 = $19,710 rent for the year. Not a bad yield for the provider at all, but makes sense given overheads and ROI expected.

yes, specially that you don't have to deal with buying it, maintaining it, etc...

Not sure why people are so scared of this (in general). Yes, it’s a pain, but only an occasional pain.

I’ve had servers locked up in a cage for years without seeing them. And the cost for bandwidth has plummeted over the last two decades. (Not at AWS, lol)

Re: Introducing ChatGPT and Whisper APIs

#408

Post by inciampati »

freeqaz wrote: post #382
UncleOxidant wrote: post #359

Earlier quoted context omitted.

> As the cost of GPUs goes down Has that been happening? I guess there's been a bit of a dip after the crypto crash, but are prices staying significantly lower? > or they develop at ASIC or more efficient model This seems likely. Probably developing in partnership with Microsoft.

It's definitely not happening at the high end of the market (NVIDIA A100s with 40GB or 80GB of RAM). The cards that were used for mining have since crashed in terms of prices, but those were always gamer cards and very rarely Datacenter cards.

The market segmentation is likely a result of Nvidia's monopoly position. They double the RAM and flops, improve the thermals and housing and sell for ten fold the price. It doesn't make sense to me. A cheap 4090 theoretically outperforms even the A6000 RTX Ada. https://timdettmers.com/2023/01/30/which-gpu-for-deep-learni...

Nvidia needs to satisfy gamers, who individually can't spend more than a few $k on a processor. But they also have the server sector on lockdown due to CUDA. Seems they can easily make money in both places. Maybe those H100s aren't such a good deal...

If someone understands these dynamics better I'd be curious to learn!

Re: Introducing ChatGPT and Whisper APIs

#409

Post by nodemaker »

wolverine876 wrote: post #349
nodemaker wrote: post #268

Earlier quoted context omitted.

Not anything racist or illegal but yes I find pc culture insufferable. It stifles creativity and most importantly reduces trust between parties. For context I am an Indian guy.

Politeness, lack of hate, etc. generally increase trust; that's much of their purpose. How do racial slurs increase trust? How do you define "pc culture", and what specifically causes problems and how? Attacking other people's beliefs as "insufferable", and aggressively demonstrating close-mindedness to them, tends to reduce trust.

In general trust is increased when all parties are speaking openly about whatever they are thinking.

Re: Introducing ChatGPT and Whisper APIs

#410

Post by Retr0id »

whatshisface wrote: post #362
npunt wrote: post #338

Earlier quoted context omitted.

Yeah we're in an AI landgrab right now where at- or below-cost pricing is buying marketshare, lock-in, and underdevelopment of competitors. Smart move for them to pour money into it.

We have got to find a word for plans that are plainly harmful yet advantageous to their executors that's more descriptive than "smart..."

capitalistic, monopolistic
Post reply on HN