Ask HN: How does Google Voice search get input w/o flash?

#1

Post by tibbon » Wed, Jun 22, 2011, 1:57 PM UTC

In Google search now you can use your audio input to search. My question is how are they technically doing that in HTML/Javascript?

I've been told that HTML5 doesn't have an audio input object, but that's what it seems they are doing here. Any tips of how I'd implement similar?

Re: Ask HN: How does Google Voice search get input w/o flash?

#2

Post by Khao » Wed, Jun 22, 2011, 2:04 PM UTC

They have this feature implemented inside of Google Chrome (or maybe it is Webkit, I am unsure) and I take it that you're using Chrome to test this feature. As far as I know, it's an experimental API that they have added to the HTML5 specs. In the video in that blog post they say that you need to have the latest version of Chrome to use it : http://googleblog.blogspot.com/2011/06/knocking-down-barrier...

Re: Ask HN: How does Google Voice search get input w/o flash?

#3

Post by dstein » Wed, Jun 22, 2011, 3:04 PM UTC

Yeah this is a Google Chrome specific feature. Chrome records your voice, uploads an mp3 to a Google server and returns the text. It is about the least efficient way to accomplish the task. Ridiculous really. Our operating systems (even Windows95) have had speech features forever, but it's implemented in a very clunky way. Instead there should be a standardized speech-to-text input, or JavaScript API where I can use my operating system's built-in speech features.

Re: Ask HN: How does Google Voice search get input w/o flash?

#4

Post by wmf » Wed, Jun 22, 2011, 3:35 PM UTC

dstein wrote: post #3

Yeah this is a Google Chrome specific feature. Chrome records your voice, uploads an mp3 to a Google server and returns the text. It is about the least efficient way to accomplish the task. Ridiculous really. Our operating systems (even Windows95) have had speech features forever, but it's implemented in a very clunky way. Instead there should be a standardized speech-to-text input, or JavaScript API where I can use…

The built-in speech recognition in your OS isn't as good as Google's (and it may not even be there — think Linux or Chrome OS).

Re: Ask HN: How does Google Voice search get input w/o flash?

#5

Post by pradeek » Wed, Jun 22, 2011, 3:36 PM UTC

Here is Google's proposal to W3C : http://www.w3.org/2005/Incubator/htmlspeech/2010/10/google-a...

Re: Ask HN: How does Google Voice search get input w/o flash?

#6

Post by dstein » Wed, Jun 22, 2011, 4:27 PM UTC

wmf wrote: post #4

dstein wrote: post #3

Yeah this is a Google Chrome specific feature. Chrome records your voice, uploads an mp3 to a Google server and returns the text. It is about the least efficient way to accomplish the task. Ridiculous really. Our operating systems (even Windows95) have had speech features forever, but it's implemented in a very clunky way. Instead there should be a standardized speech-to-text input, or JavaScript API where I can use…

The built-in speech recognition in your OS isn't as good as Google's (and it may not even be there — think Linux or Chrome OS).

My quick experiments with the Chrome speech input says otherwise. It is both less accurate, and less useful than the built-in speech-to-text in MacOS. There exists speech systems for Windows and open source ones for Linux that are "good enough".

The point isn't really about accuracy, it's about usability. The way this is implemented in Chrome does not make it possible to use voice commands to do operations in a web browser. That's what we need. We don't just need a voice input for Google search.