Live data from Hacker News

Transcribro: On-device Accurate Speech-to-text

github.com

1–10 of 66 posts

Re: Transcribro: On-device Accurate Speech-to-text

#7
post #5
post #3

Documentation severely lacking. I wanted to know whether this does streaming or only batch, as well as examples for integrating with Android apps.

Considering it uses Whisper, it's probably not streaming

I did some core work on TTS at Google, at several layers, and I've never quite understood what people mean by streaming vs. not.

In each and every case I'm familiar with, streaming means "send the whole audio thus far to the inference engine, inference it, and send back the transcription"

I have a Flutter library that does the same flow as this (though via ONNX, so I can cover all platforms), and Whisper + Silero is ~identical to the interfaces I used at Google.

If the idea is streaming is when each audio byte is only sent once to the server, there's still an audio buffer accumulated -- its just on the server.

Re: Transcribro: On-device Accurate Speech-to-text

#8

Looks similar to the new FUTO keyboard: https://voiceinput.futo.org/

I've been using this for a while (the voice input, not their keyboard) and it's so refreshing to be able to just speak and have the output come out as fully formed, well punctuated sentences with proper capitalization.

Re: Transcribro: On-device Accurate Speech-to-text

#9
post #5

Earlier quoted context omitted.

Considering it uses Whisper, it's probably not streaming

I did some core work on TTS at Google, at several layers, and I've never quite understood what people mean by streaming vs. not. In each and every case I'm familiar with, streaming means "send the whole audio thus far to the inference engine, inference it, and send back the transcription" I have a Flutter library that does the same flow as this (though via ONNX, so I can cover all platforms), and Whisper + Silero is…

I think in practical terms (at least for me):

- streaming == I talk and the text appears as I talk

- batched == I talk, and after I'm done talking some processing happens and the text gets populated

Re: Transcribro: On-device Accurate Speech-to-text

#10
post #5

Earlier quoted context omitted.

Considering it uses Whisper, it's probably not streaming

I did some core work on TTS at Google, at several layers, and I've never quite understood what people mean by streaming vs. not. In each and every case I'm familiar with, streaming means "send the whole audio thus far to the inference engine, inference it, and send back the transcription" I have a Flutter library that does the same flow as this (though via ONNX, so I can cover all platforms), and Whisper + Silero is…

"streaming" in this case is like another reply said: transcriptions appear as I talk. Compared to not-streaming in which the service waits for silence, then processes the captured speech, then returns some transcription.

Is your Flutter library available? And does it run locally? I'm looking for a good Flutter streaming (in the sense above) speech recognition library. vosk looks good, but it's lacking some configurability such as selecting audio source.

Post reply on HN