Live data from Hacker News

How AI hears accents: An audible visualization of accent clusters

accent-explorer.boldvoice.com

21–30 of 133 posts

Re: How AI hears accents: An audible visualization of accent clusters

#21
post #17

Earlier quoted context omitted.

When I went to Portugal I was struck by how much Portuguese there does sound like Spanish with a Russian accent!

Part of this is the "dark L" sound

I’d guess that the sibilants, consonant clusters, and/or vowel reduction would play a big role.

Re: How AI hears accents: An audible visualization of accent clusters

#22

Apparently Persian and Russian are close. Which is surprising to say the least. I know people keep getting confused about how Portuguese from Portugal and Russian sound close yet the Persian is new to me.

Idea: Farsi and Russian both have simple list of vowel sounds and no diphtongs. Making it hard/obvious when attempting to speak english, which is rife with them and many different vowel sounds

Re: How AI hears accents: An audible visualization of accent clusters

#25

The source code for this is unminified and very readable if you’re one of the rare few who has interesting latent spaces to visualize. https://accent-explorer.boldvoice.com/script.js?v=5

Good catch. I really hate javascript so i never got into d3js, so plptly was such a life saver.

Re: How AI hears accents: An audible visualization of accent clusters

#27

it would've been nice to be able to visualize the differences between the different accents in the spanish language, really cool tho

Yeh, we would've loved to see that too. It's on our roadmap for sure. Same for some of the other languages with a large amount of unique accents like e.g. French, Chinese, Arabic, etc...

Re: How AI hears accents: An audible visualization of accent clusters

#28
post #25

The source code for this is unminified and very readable if you’re one of the rare few who has interesting latent spaces to visualize. https://accent-explorer.boldvoice.com/script.js?v=5

Good catch. I really hate javascript so i never got into d3js, so plptly was such a life saver.

Plotly is great! Much love.

Re: How AI hears accents: An audible visualization of accent clusters

#29

Apparently Persian and Russian are close. Which is surprising to say the least. I know people keep getting confused about how Portuguese from Portugal and Russian sound close yet the Persian is new to me.

Yeh they seem to be in the same "major" cluster, although Serbian/Croatian, Romanian, Bulgarian, Turkish, Polish and Czech are all close.

Turkish and Persian seem to be the nearest neighbors.

Re: How AI hears accents: An audible visualization of accent clusters

#30
I just got a project running whereby I used python + pdfplumber to read in 1100 pdf files, most of my humble bundle collection. I extracted the text and dumped it into a 'documents' table in postgresql. Then I used sentence transformers to reduce each 1K chunk to a single 384D vector which I wrote back to the db. Then I averaged these to produce a document level embedding as a single vector.

Then I was able to apply UMAP + HDBSCAN to this dataset and it produced a 2D plot of all my books. Later I put the discovered topic back in the db and used that to compute tf-idf for my clusters from which I could pick the top 5 terms to serve as a crude cluster label.

It took about 20 to 30 hours to finish all these steps and I was very impressed with the results. I could see my cookbooks clearly separated from my programming and math books. I could drill in and see subclusters for baking, bbq, salads etc.

Currently I'm putting it into a 2 container docker compose file, base postgresql + a python container I'm working on.

Post reply on HN