First, let me say that this is impressive. And then let me pose some questions: As a linguist, I would like to know more about the kinds of languages this works well with, or does not work well with. For example, half the world's languages are tone languages, and the way tones work varies greatly among these. Some just have high and low tones, while others are considerably more complicated; Thai has high, mid, low, r…
Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
41–48 of 48 posts
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#42Just killed my startup. https://6k.ai Half joking - hopefully, we can still contribute something to this to this field. Looking forward to doing some tests with this.
what is the "Penguin" language? Also, 1.6k < 6k, and I highly doubt this model is anywhere near as good as it is on EU languages for most of them.
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#43What I really want to know is how well these could work for non-human languages. No, not aliens, but chimpanzees, dolphins, bonobos. We have hundreds or thousands of hours of recordings. What would it take to start working on them?
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#44What I really want to know is how well these could work for non-human languages. No, not aliens, but chimpanzees, dolphins, bonobos. We have hundreds or thousands of hours of recordings. What would it take to start working on them?
I think linguistics, don't deem animals to have languages as you require human level intelligence to use and understand some of the features in human languages like communicating about things that are away from your current timespace location. Animals have communication systems
"You haven't experienced Shakespeare until you've read him in the original Bonobo". :-)
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#45What I really want to know is how well these could work for non-human languages. No, not aliens, but chimpanzees, dolphins, bonobos. We have hundreds or thousands of hours of recordings. What would it take to start working on them?
There is a dolphin language model project from Google and Georgia Tech: https://blog.google/technology/ai/dolphingemma/
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#46Earlier quoted context omitted.
I think linguistics, don't deem animals to have languages as you require human level intelligence to use and understand some of the features in human languages like communicating about things that are away from your current timespace location. Animals have communication systems
I'm not asserting that bonobos, for example, have as complex a language as humans, just that it would be interesting to understand what language that they do have. "You haven't experienced Shakespeare until you've read him in the original Bonobo". :-)
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#47I'm going to test this with Voice AI to see how it works compared to Whisper and Parakeet https://voice-ai.knowii.net
looks like a paid and closed source fork of the free and open source project Handy: https://github.com/cjpais/Handy can't say for sure, but a lot of the UI (and text) is quite familiar. the history page is a near rip off which is a giveaway. i believe the mit license should be distributed since it's almost certainly a derivative work. "The above copyright notice and this permission notice shall be included in all cop…
I am trying to approach this will full transparency, honesty and respect for what the creator of Handy did. I'm not a grifter.
Please consider that my project is still very young. I didn't include the third-party licenses in my first few releases (I honestly didn't know this about the MIT license, my bad!), but will fix this asap with the next release (hopefully coming out in a few days), and I'll pull the previous releases to avoid distributing versions that don't include the licenses. I'll also add information about the other production dependencies that I'm using.
If you look at my announcement, you'll see that I'm being fully transparent about this and am not interested in cloning Handy at all. My code is already very distant from the initial version I started with and I'm exploring and building features that will probably never be included in Handy. For instance, my app's UI has been created from scratch (with a lot of inspiration from Handy), it is fully responsive and now works on Omarchy (Hyprland/Wayland), which Handy doesn't support at the moment. I have added various features for my own needs and for my first customers (e.g., . In the roadmap of the product, you can see some of the ideas I intend to develop.
I also intend to contribute back to Handy over time. I already have and will continue to do so.
Re: Omnilingual ASR: Advancing automatic speech recognition for 1600 languages
#48Earlier quoted context omitted.
looks like a paid and closed source fork of the free and open source project Handy: https://github.com/cjpais/Handy can't say for sure, but a lot of the UI (and text) is quite familiar. the history page is a near rip off which is a giveaway. i believe the mit license should be distributed since it's almost certainly a derivative work. "The above copyright notice and this permission notice shall be included in all cop…
I thought it looked familiar! Looks like they only changed some of the UI/colors lol.
The core of the transcription process is mostly the same and uses the same libraries, but I've rebuilt the UI from scratch to be fully responsive, added support for Wayland/Hyprland (with adaptive window size), implemented lazy loading/filtering/group by date/editing/search/filtering etc to the history screen, implemented history storage/handling differently, added more control over the history feature, added support for custom sounds, improved UX around managing sounds, added a loading screen, added support for model download pause/resume/cancel/delete etc.
These might seem like details, but it all takes time. I started this project 3 weeks ago and this is just the beginning.
In my roadmap I've listed many ideas I have in mind and will be focusing on: https://docs.voice-ai.knowii.net/roadmap
I want to go in a different direction than Handy, and my customers (who are mainly interested in Knowledge Management) too.