Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Introducing ChatGPT and Whisper APIs

openai.com

Post reply on HN
Print view View original

541–550 of 696 posts

Re: Introducing ChatGPT and Whisper APIs

#541

Post by pelasaco »

sroussey wrote: post #407
pelasaco wrote: post #332

Earlier quoted context omitted.

yes, specially that you don't have to deal with buying it, maintaining it, etc...

Not sure why people are so scared of this (in general). Yes, it’s a pain, but only an occasional pain. I’ve had servers locked up in a cage for years without seeing them. And the cost for bandwidth has plummeted over the last two decades. (Not at AWS, lol)

exactly, you pay for the case where a down time on Sunday happens or you are in vacation out of the city and something happens.. I had this issue back in the days with my bitcoin miners.. Always when I was out of the city, one of them went down and I wanted to go back ASAP

Re: Introducing ChatGPT and Whisper APIs

#542

Post by wolverine876 »

nodemaker wrote: post #409
wolverine876 wrote: post #349

Earlier quoted context omitted.

Politeness, lack of hate, etc. generally increase trust; that's much of their purpose. How do racial slurs increase trust? How do you define "pc culture", and what specifically causes problems and how? Attacking other people's beliefs as "insufferable", and aggressively demonstrating close-mindedness to them, tends to reduce trust.

In general trust is increased when all parties are speaking openly about whatever they are thinking.

It's a sort of philosophical idea - openness and free expression - taken to a logical and inhuman extreme. I cannot think of a situation where it is appropriate to say whatever I'm thinking. I think it would destroy trust, not least by demonstrating the unreliability of my judgment.

Re: Introducing ChatGPT and Whisper APIs

#543

Post by wolverine876 »

TechBro8615 wrote: post #401
wolverine876 wrote: post #340

Earlier quoted context omitted.

I've never experienced that in any setting in my life. People will say yes to advocate a political point, but that's not how humans socialize anywhere, anytime in history afaik.

I agree with you for IRL interactions, but we need to accept that we now operate in two planes of (para-)socialization: IRL and online. There are plenty of humans who enjoy vulgar online socialization, and for many of them, online (para-)socializing is the increasingly dominant form of socialization. The mere fact that it's easier to socialize over the internet means it will always be the plane of least resistance. I…

> just because people interact more angrily online doesn't mean they're willing to fight each other in real life

There is a lot of evidence that says online experiences influence offline behavior (both are "real life"). Look at the very many, online-inspired, extremist attacks. Look at the impact of misinformation and disinformation - as a simple example, it killed possibly hundreds of thousands of Americans do to poor vaccination rates.

Re: Introducing ChatGPT and Whisper APIs

#544

Post by shostack »

Kiro wrote: post #220
phas0ruk wrote: post #122

Feels like people running small websites monetised with ads will get killed. Why go to a recipe website to search for healthy meals for your kids if you can ask chat gpt in Instacart? :(

These small websites have been dead for years and replaced with SEO spam.

Except now Microsoft can hurt Google's ability to monetize it by stealing search traffic with people switching to ChatGPT.

Re: Introducing ChatGPT and Whisper APIs

#545

Post by Tenoke »

mk_stjames wrote: post #402
r3trohack3r wrote: post #12

Whisper as an API is great, but having to send the whole payload upfront is a bummer. Most use cases I can build for would want streaming support. Like establish a WebRTC connection and stream audio to OpenAI and get back a live transcription until the audio channel closes.

I've ran Whisper locally via [1] with one of the medium sized models and it was damn good at transcribing audio from a video of two people having a conversation. I don't know exactly what the use case is where people would need to run this via API; the compute isn't huge, I used CPU only (an M1) and the memory requirements aren't much. [1] https://github.com/ggerganov/whisper.cpp

The 5gb model is likely too big for 95% of people's machines and renting gpus is likely not much cheaper.

I'm using also whisper myself locally to transcribe my voice notes though.

Re: Introducing ChatGPT and Whisper APIs

#547

Post by cubefox »

habitue wrote: post #456
dougmwne wrote: post #198

Earlier quoted context omitted.

I think you mean GPT-4 since Chinchilla is a Deepmind project. But yes, I was also suspecting that also as it seems unlikely this was the full 175b parameter model with such big improvements in speed and price. In fact, given the pricing for OpenAI Foundry, that seems even more likely as this GPTTurbo model was listed along with two other models with much larger context windows of 8k and 32k tokens.

I just meant chinchilla optimal in terms of the corrected scaling curves from the chinchilla paper. The original GPT-3 was way larger than it needed to be for the amount of data they put into it based on the curves from the chinchilla paper.

It's also worth noting that we don't know any specifics (parameters, training tokens) of GPT-3.5. Only for GPT-3 those numbers have been published.

Re: Introducing ChatGPT and Whisper APIs

#548

Post by sama »

minimaxir wrote: post #2

> It is priced at $0.002 per 1k tokens, which is 10x cheaper than our existing GPT-3.5 models. This is a massive, massive deal. For context, the reason GPT-3 apps took off over the past few months before ChatGPT went viral is because a) text-davinci-003 was released and was a significant performance increase and b) the cost was cut from $0.06/1k tokens to $0.02/1k tokens, which made consumer applications feasible wit…

we make a little money on it!

Re: Introducing ChatGPT and Whisper APIs

#549

Post by cubefox »

ShamelessC wrote: post #352
osigurdson wrote: post #210

I always wondered if ChatGPT was somehow stateful. I assumed that it was not and the statefulness was simulated. Assumption validated.

It’s stateful in the web demo. But they do so by prepending chat history to new requests and automatically summarizing history once the model’s context window is exceeded.

I don't think they are doing summaries actually. Just cutting off the oldest parts of the conversation.
Post reply on HN