Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI charges by the minute, so speed up your audio

george.mand.is

Post reply on HN
Print view View original

71–80 of 234 posts

Re: OpenAI charges by the minute, so speed up your audio

#71

Post by jerjerjer »

georgemandis wrote: post #39
rob wrote: post #33

For anybody trying to do this in bulk, instead of using OpenAI's whisper via their API, you can also use Groq [0] which is much cheaper: [0] https://groq.com/pricing/ Groq is ~$0.02/hr with distil-large-v3, or ~$0.04/hr with whisper-large-v3-turbo. I believe OpenAI comes out to like ~$0.36/hr. We do this internally with our tool that automatically transcribes local government council meetings right when they get uplo…

Interesting! At $0.02 to $0.04 an hour I don't suspect you've been hunting for optimizations, but I wonder if this "speed up the audio" trick would save you even more. > We do this internally with our tool that automatically transcribes local government council meetings right when they get uploaded to YouTube Doesn't YouTube do this for you automatically these days within a day or so?

> I wonder if this "speed up the audio" trick would save you even more.

At this point you'll need to at least check how much running ffmpeg costs. Probably less than $0.01 per hour of audio (approximate savings) but still.

Re: OpenAI charges by the minute, so speed up your audio

#72

Post by colechristensen »

pluc wrote: post #15
heeton wrote: post #8

A point on skimming vs taking the time to read something properly. I read a transcript + summary of that exact talk. I thought it was fine, but uninteresting, I moved on. Later I saw it had been put on youtube and I was on the train, so I watched the whole thing at normal speed. I had a huge number of different ideas, thoughts and decisions, sparked by watching the whole thing. This happens to me in other areas too.…

Seriously this is bonkers to me. I, like many hackers, hated school because they just threw one-size-fits-all knowledge at you and here we are, paying for the privilege to have that in every facet of our lives. Reading is a pleasure. Watching a lecture or a talk and feeling the pieces fall into place is great. Having your brain work out the meaning of things is surely something that defines us as a species. We're wil…

University didn't agree with me mostly because I can't pay attention to the average lecturer. Getting bored in between words or while waiting for them to write means I absorbed very little and had to teach myself nearly everything.

Audiobooks before speed tools were the worst (are they trying to speak extra slow?) But when I can speed things up comprehension is just fine.

Re: OpenAI charges by the minute, so speed up your audio

#73

Post by ks2048 »

georgemandis wrote: post #39
rob wrote: post #33

For anybody trying to do this in bulk, instead of using OpenAI's whisper via their API, you can also use Groq [0] which is much cheaper: [0] https://groq.com/pricing/ Groq is ~$0.02/hr with distil-large-v3, or ~$0.04/hr with whisper-large-v3-turbo. I believe OpenAI comes out to like ~$0.36/hr. We do this internally with our tool that automatically transcribes local government council meetings right when they get uplo…

Interesting! At $0.02 to $0.04 an hour I don't suspect you've been hunting for optimizations, but I wonder if this "speed up the audio" trick would save you even more. > We do this internally with our tool that automatically transcribes local government council meetings right when they get uploaded to YouTube Doesn't YouTube do this for you automatically these days within a day or so?

> Doesn't YouTube do this for you automatically these days within a day or so?

Last time I checked, I think the Google auto-captions were noticeably worse quality than whisper, but maybe that has changed.

Re: OpenAI charges by the minute, so speed up your audio

#75

Post by colechristensen »

rob wrote: post #33

For anybody trying to do this in bulk, instead of using OpenAI's whisper via their API, you can also use Groq [0] which is much cheaper: [0] https://groq.com/pricing/ Groq is ~$0.02/hr with distil-large-v3, or ~$0.04/hr with whisper-large-v3-turbo. I believe OpenAI comes out to like ~$0.36/hr. We do this internally with our tool that automatically transcribes local government council meetings right when they get uplo…

If you have a recent macbook you can run the same whisper model locally for free. People are really sleeping on how cheap the compute you own hardware for already is.

Re: OpenAI charges by the minute, so speed up your audio

#76

Post by janalsncm »

behnamoh wrote: post #30
w-m wrote: post #13

With transcribing a talk by Andrej, you already picked the most challenging case possible, speed-wise. His natural talking speed is already >=1.5x that of a normal human. One of the people you absolutely have to set your YouTube speed back down to 1x when listening to follow what's going on. In the idea of making more of an OpenAI minute, don't send it any silence. E.g. ffmpeg -i video-audio.m4a \ -af "silenceremove=…

> His natural talking speed is already >=1.5x that of a normal human. One of the people you absolutely have to set your YouTube speed back down to 1x when listening to follow what's going on. I wonder if there's a way to automatically detect how "fast" a person talks in an audio file. I know it's subjective and different people talk at different paces in an audio, but it'd be cool to kinda know when OP's trick fails…

> I wonder if there's a way to automatically detect how "fast" a person talks in an audio file

Transcribe it locally using whisper and output tokens/sec?

Re: OpenAI charges by the minute, so speed up your audio

#77

Post by pzo »

rob wrote: post #33

For anybody trying to do this in bulk, instead of using OpenAI's whisper via their API, you can also use Groq [0] which is much cheaper: [0] https://groq.com/pricing/ Groq is ~$0.02/hr with distil-large-v3, or ~$0.04/hr with whisper-large-v3-turbo. I believe OpenAI comes out to like ~$0.36/hr. We do this internally with our tool that automatically transcribes local government council meetings right when they get uplo…

there is also cloudflare workers ai where you can have whisper-large-v3-turbo for around $0.03 per hour:

https://developers.cloudflare.com/workers-ai/models/whisper-...

Re: OpenAI charges by the minute, so speed up your audio

#78

Post by rob »

colechristensen wrote: post #75
rob wrote: post #33

For anybody trying to do this in bulk, instead of using OpenAI's whisper via their API, you can also use Groq [0] which is much cheaper: [0] https://groq.com/pricing/ Groq is ~$0.02/hr with distil-large-v3, or ~$0.04/hr with whisper-large-v3-turbo. I believe OpenAI comes out to like ~$0.36/hr. We do this internally with our tool that automatically transcribes local government council meetings right when they get uplo…

If you have a recent macbook you can run the same whisper model locally for free. People are really sleeping on how cheap the compute you own hardware for already is.

I don't. I have a MacBook Pro from 2019 with an Intel chip and 16 GB of memory. Pretty sure when I tried the large whisper model it took like 30 minutes to an hour to do something that took hardly any time via Groq. It's been a while though so maybe my times are off.

Re: OpenAI charges by the minute, so speed up your audio

#80

Post by bisby »

pluc wrote: post #15
heeton wrote: post #8

A point on skimming vs taking the time to read something properly. I read a transcript + summary of that exact talk. I thought it was fine, but uninteresting, I moved on. Later I saw it had been put on youtube and I was on the train, so I watched the whole thing at normal speed. I had a huge number of different ideas, thoughts and decisions, sparked by watching the whole thing. This happens to me in other areas too.…

Seriously this is bonkers to me. I, like many hackers, hated school because they just threw one-size-fits-all knowledge at you and here we are, paying for the privilege to have that in every facet of our lives. Reading is a pleasure. Watching a lecture or a talk and feeling the pieces fall into place is great. Having your brain work out the meaning of things is surely something that defines us as a species. We're wil…

> I, like many hackers, hated school because they just threw one-size-fits-all knowledge at you

"This specific knowledge format doesnt work for me, so I'm asking OpenAI to convert this knowledge into a format that is easier for me to digest" is exactly what this is about.

I'm not quite sure what you're upset about? Unless you're referring to "one size fits all knowledge" as simplified topics, so you can tackle things at a surface level? I love having surface level knowledge about a LOT of things. I certainly don't have time to have go deep on every topic out there. But if this is a topic I find I am interested in, the full talk is still available.

Breadth and depth are both important, and well summarized talks are important for breadth, but not helpful at all for depth, and that's ok.

Post reply on HN