Man, I've been spreading disinformation for years.
the closest i have been, was acoustic phase discrimination by owls. there appears to be no software for this, its all hardware, the signal format flips as it travels through the anatomy.
How the cochlea computes (2024)
41–50 of 159 posts
Re: How the cochlea computes (2024)
#42To summarize: the ear does not do a Fourier transform, but it does do a time-localized frequency-domain transform akin to wavelets (specifically, intermediate between wavelet and Gabor transforms). It does this because the sounds processed by the ear are often localized in time. The article also describes a theory that human speech evolved to occupy an unoccupied space in frequency vs. envelope duration space. It mak…
Do you believe it might be possible that the frequency band of human speech is not determined by such factors at all but more of a function of height? kids have higher voices adults have deeper voices. Similar to stringed instruments: viola high pitched and bass low pitched. I'm no expert in these matters just speculating...
Re: How the cochlea computes (2024)
#43Earlier quoted context omitted.
the very simplest way to describe it: it is what turns a waveform (amplitude x time) to a spectrogram like on a stereo (amplitude x frequency)
And phase. People always forget about the phase as if it was purely imaginary.
I have been told that reversing the process — creating a time-based waveform — will not resemble (visually) the original due to this phase loss in the round-tripping. But then our brain never paid phase any mind so it will sound the same to our ears. (Yay, MP3!)
Re: How the cochlea computes (2024)
#44> A Fourier transform has no explicit temporal precision, and resembles something closer to the waveforms on the right; this is not what the filters in the cochlea look like. Perhaps the ear does someting more vaguely analogous to a discrete Fourier transforms on samples of data, which is what we do in a lot of signal processing. In signal processing, we take windowed samples, and do discrete transforms on these. The…
Sure, and the FFT isn't inherently biased towards one vs the other. If you take an FFT over a long time window (narrowband spectrogram) then you get good frequency resolution at the cost of time resolution, and vice versa for a short time window (wideband spectrogram).
For speech recognition ideally you'd want to use both since they are detecting different things. TFA is saying that this is in fact what our cochlea filter bank is doing, using different types of filter at different frequency ranges - better frequency resolution at lower frequencies where the formants are (carrying articulatory information), and better time resolution at the high frequencies generated by fricatives where frequency doesn't matter but accurate onset detection is useful for detecting plosives.
Re: How the cochlea computes (2024)
#45Man, I've been spreading disinformation for years.
Re: How the cochlea computes (2024)
#46The thesis about human speech occupying less crowded spectrum is well aligned with a book called "The Great Animal Orchestra" ( https://www.amazon.com/Great-Animal-Orchestra-Finding-Origin... ). That author details how the "dawn chorus" is composed of a vast number of species making noise, but who are able to pick out mating calls and other signals due to evolving their vocalizations into unique sonic niches. It's qu…
Re: How the cochlea computes (2024)
#47To summarize: the ear does not do a Fourier transform, but it does do a time-localized frequency-domain transform akin to wavelets (specifically, intermediate between wavelet and Gabor transforms). It does this because the sounds processed by the ear are often localized in time. The article also describes a theory that human speech evolved to occupy an unoccupied space in frequency vs. envelope duration space. It mak…
Why do we need a summary in a post that adds nothing new to the conversation?
Re: How the cochlea computes (2024)
#48man I need to finally learn what a Fourier transform is
It's very comprehensive, but it's also very well written and walks you through the mechanics of Fourier transforms in a way that makes them intuitive.
Re: How the cochlea computes (2024)
#49To summarize: the ear does not do a Fourier transform, but it does do a time-localized frequency-domain transform akin to wavelets (specifically, intermediate between wavelet and Gabor transforms). It does this because the sounds processed by the ear are often localized in time. The article also describes a theory that human speech evolved to occupy an unoccupied space in frequency vs. envelope duration space. It mak…
Is that an human understanding or is it just an AI that read the text and ignored the pictures? Why do we need a summary in a post that adds nothing new to the conversation?
Re: How the cochlea computes (2024)
#50To summarize: the ear does not do a Fourier transform, but it does do a time-localized frequency-domain transform akin to wavelets (specifically, intermediate between wavelet and Gabor transforms). It does this because the sounds processed by the ear are often localized in time. The article also describes a theory that human speech evolved to occupy an unoccupied space in frequency vs. envelope duration space. It mak…
We can make a short-time fourier transform or a wavelet transform in the same way either by:
- filterbank approach integrating signals in time
- take fourier transform of time slices, integrating in frequency
The same machinery just with different filters.