Recognizing Speech from Smartphone Gyroscopes (2014)
crypto.stanford.edu
Recognizing Speech from Smartphone Gyroscopes (2014)
1–10 of 15 posts
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#2[deleted]
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#3This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data?
On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid.
This is distinct from the "No device motion data" message presented on my desktop though. So it seems to me that the page sees that a gyroscope is present, and requests data from it, but Firefox is just feeding it null values?
I haven't tried the apk yet.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#4This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data? On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid. This is distinct from the "No device motion data" message p…
Chrome on Android shows the proper data - with no special permissions or warnings. It updates at ~57 samples/s.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#5This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data? On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid. This is distinct from the "No device motion data" message p…
Chrome on Android shows the proper data - with no special permissions or warnings. It updates at ~57 samples/s.
If you check the paper the authors indeed mention some rate limitations using Chrome. However Firefox provides samples at 200 Hz.
Also, every application can access those measurements without any permissions.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#6This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data? On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid. This is distinct from the "No device motion data" message p…
Re. web pages, the feature is called DeviceOrientation Event and no, the spec doesn't require user permission: https://www.w3.org/TR/orientation-event/
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#7Would accelerometers also be usable in a similar way? Presumably magnetometers wouldn't be quite as sensitive to such vibrations.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#8This is a fantastic idea, but do web pages really not require special permissions to access gyroscope data? On Android (like, 4.2 or something) with Firefox, the page and the CSV just displays `null` for alpha, beta and gamma. And the calculated rate is 9.1 samples per second, which seems way too low to extract any speech details even if the data were valid. This is distinct from the "No device motion data" message p…
Tried it on Mobile Safari (iOS 9.2) - works. Pretty crazy, there was no need to give permissions.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#9Seems like if auto rotate is off, this does not work.
Re: Recognizing Speech from Smartphone Gyroscopes (2014)
#10Solution: low pass filter gyroscope sensor data before the application can access it. Is there a legitimate reason for an application to need gyroscope data in the range of ~200Hz?