Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Transcribe.cpp

workshop.cjpais.com

Post reply on HN
Print view View original

61–70 of 180 posts

Re: Transcribe.cpp

#61

Post by PhilippGille »

mmmmbbbhb wrote: post #51
abdullahkhalids wrote: post #46

For anyone looking to build on top of this. I have tried a few different STT systems, and they accurately capture what I am saying. Unfortunately, they don't support the reasonable workflow I want to open an office document, for example, and start talking. And I want the software to continuously type what I am saying at the cursor with minimal latency. The continuous part is crucial. Many software will paste whatever…

You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking.

So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.

Re: Transcribe.cpp

#62

Post by atonse »

nilslindemann wrote: post #54
mmmmbbbhb wrote: post #51

Earlier quoted context omitted.

You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

It may be interesting to have it immediately insert the words, even if they are wrong, and when a sentence is finished, replace what has been written with the final corrected sentence.

Google released this awkwardly named app called edge eloquent recently that does exactly that.

In fact, it cleans up the entire paragraph that you just said, and even if you have meandering thoughts, it cleans those up too.

Actually, this above statement was fully dictated with iOS and it added all the punctuation automatically, so I think that iOS is also doing some of this natively. In fact, I’m on the iOS 27 beta and it seems to be doing an even better job of correcting itself and correcting earlier words and adding punctuation too.

Re: Transcribe.cpp

#63

Post by sipjca »

dostick wrote: post #56

Does this support filtering of “umm”,”err”, “ugh”, or that is nit yet possible with open source models?

Not in the library itself, it’s pure inference. Some models have this trained out of them anyhow. Otherwise this is a post processing task which is not really inference

Re: Transcribe.cpp

#64

Post by primaprashant »

Handy is an amazing cross-platform app for dictation from the author. There are other awesome open-source dictation tools as well like native macOS ones. You do not need SaaS subscription in this day and age for transcription.

I maintain this list of all the best open-source ones in this awesome-style GitHub repo. People looking for open-source dictation tools, hope you find something that works for you here:

https://github.com/primaprashant/awesome-voice-typing

Re: Transcribe.cpp

#65

Post by kristiandupont »

atonse wrote: post #59
mmmmbbbhb wrote: post #51

Earlier quoted context omitted.

You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually. I believe the built-in iOS dictation already does this.

What would be the benefit of this, besides from looking cool?

Re: Transcribe.cpp

#66

Post by sneak »

ghm2199 wrote: post #11

Congrats on shipping this. I love handy on my Mac, my phone for STT in situations where it’s not possible/poor performance of the native Model for STT(e.g apple’s thing is not upto scruff, like mistranslating words corresponding to a domain). Noob question: How do you think about funding from a foundation(i have no clue if you need it or not, I do hope you have a way to get paid one way or another because handy is am…

OS-native dictation on iOS requires uploading your address book to Apple on every request, even if you don’t use iCloud. I unfortunately have to leave it disabled for this reason.

Re: Transcribe.cpp

#67

Post by regularfry »

PhilippGille wrote: post #61
mmmmbbbhb wrote: post #51

Earlier quoted context omitted.

You know English doesn't work like that. The word you're saying only becomes clear with the surrounding context. Eg, 'there' vs 'their'.

Handy already supports streaming transcription models, and you can see the words in the small Handy pop-up while you are talking. So in general this definitely works. Handy is just missing the feature to insert these streamed words into the app where the cursor is.

I suspect the hard bit is that it sometimes needs to back up and redo, and that's an interface they haven't got figured out. I'm fairly sure I remember Dragon Naturally Speaking doing it in Word years ago though, so the interfaces should be there.

Re: Transcribe.cpp

#68

Post by knowknowledge »

kristiandupont wrote: post #65
atonse wrote: post #59

Earlier quoted context omitted.

But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually. I believe the built-in iOS dictation already does this.

What would be the benefit of this, besides from looking cool?

In iOS this means you can edit the text as it’s being transcribed. For example, I want to dictate a todo list and after each item I can hit enter to go to the next line.

Re: Transcribe.cpp

#69

Post by 0xnyn »

handy has been invaluable in my workflow, and having a fast, local, c++-based transcription library with first-party ts bindings is incredibleee

tysm for shipping this, keep up the great work OP

Re: Transcribe.cpp

#70

Post by atonse »

kristiandupont wrote: post #65
atonse wrote: post #59

Earlier quoted context omitted.

But this is still possible to do if you track the whole run of text. You could replace all of it each time so it LOOKS like it’s streaming but earlier words also change. I’m hoping the streaming models do this eventually. I believe the built-in iOS dictation already does this.

What would be the benefit of this, besides from looking cool?

More accuracy. Like others have said, homonyms (their, they're, there) is easier to determine once you have more context. So then you may need to go back a couple words and update them.

Same with punctuation, you could determine that a comma belonged in a certain place once you have enough words.

Post reply on HN