How AI hears accents: An audible visualization of accent clusters
accent-explorer.boldvoice.com
How AI hears accents: An audible visualization of accent clusters
1–10 of 133 posts
Re: How AI hears accents: An audible visualization of accent clusters
#2really fun discovery clicking a dot and hearing the accent. neat visualization, lots to think about!
Re: How AI hears accents: An audible visualization of accent clusters
#3Fascinating! How did you decouple the speaker-specific vocal characteristics (timbre, pitch range) from the accent-defining phonetic and prosodic features in the latent space?
Re: How AI hears accents: An audible visualization of accent clusters
#4Fascinating! How did you decouple the speaker-specific vocal characteristics (timbre, pitch range) from the accent-defining phonetic and prosodic features in the latent space?
We didn't explicitly. Because we finetuned this model for accent classification, the later transformer layers appear to ignore non-accent vocal characteristics. I verified this for gender for example.
Re: How AI hears accents: An audible visualization of accent clusters
#5Thank you for sharing! the 3d visual was an interesting application of the UMAP technique.
Is there a way to subscribe to these blog posts for auto-notification?
Re: How AI hears accents: An audible visualization of accent clusters
#6why is spanish so distributed?
Re: How AI hears accents: An audible visualization of accent clusters
#7why is spanish so distributed?
Good question! It's likely because there are lots of different accents of Spanish that are distinct from each other. Our labels only capture the native language of the speaker right now, so they're all grouped together but it's definitely on our to-do list to go deeper into the sub accents of each language family!
Re: How AI hears accents: An audible visualization of accent clusters
#8why is spanish so distributed?
Not sure, could be the large number of Spanish dialects represented in the dataset, label noise, or something else. There may just be too much diversity in the class to fit neatly in a cluster.
Also, the training dataset is highly imbalanced and Spanish is the most common class, so the model predicts it as a sort of default when it isn't confident -- this could lead to artifacts in the reduced 3d space.
Re: How AI hears accents: An audible visualization of accent clusters
#9This is a fascinating look at how AI interprets accents! It reminds me of some recent advancements in speech recognition tech, like Google's Dialect Recognition feature, which also attempts to adapt to different accents. I wonder how these models could be improved further to not just recognize but also appreciate the nuances of regional
Re: How AI hears accents: An audible visualization of accent clusters
#10Thank you for sharing! the 3d visual was an interesting application of the UMAP technique. Is there a way to subscribe to these blog posts for auto-notification?
Yeah, if only there was a protocol for that.