Most of languages support only LID (language identification) task. Still impressive
Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
61–70 of 232 posts
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#62Does it do American Sign Language, US fifth largest language? I didn’t think so.
Perhaps you could help by inventing a written version of ASL, since one doesn't currently exist. [EDIT: I was wrong, sorry, see my response below.] Seems like that would be a prerequisite for a model based on written language.
And of course if you could also create an entire corpus of training material in your written ASL?
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#63Earlier quoted context omitted.
Because to download and run it you need to have a laptop nearby to download and run it on, with the correct operating system and often additional dependencies too. I do most of my research reading on my phone. I want to be able to understand things without breaking out a laptop.
There's a paper associated with it that you can read on your phone. And I don't think demo videos are really associated with "research". I agree they could've added both, but let's be honest here you'll have demo videos on this in the next 12 hours for sure.
That's a related complaint: everyone continues to insist on releasing papers as PDFs, ignoring the fact that those are still pretty nasty to read on a mobile device.
Sure, release a PDF (some people like those), but having an additional responsive web page version of a paper makes research much more readable to the majority of content consumption devices. It's 2023.
I'll generally use https://www.arxiv-vanity.com/ to generate those but that doesn't work with this specific paper since it's not hosted on arXiv.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#64Earlier quoted context omitted.
Based on the availability of STT, TTS, and translation models available to download in that github repo, a real-life babelfish is 'only' some glue code away. Wild times we're living in.
Nah, full-on babelfish is simply not possible. The meaning of the beginning of a sentence can be modified retroactively by the end of the sentence. This means that the Babelfish must either be greatly delayed or awkwardly correct itself every once in a while.
Ah, reminds me of learning German, where you can chuck all the verbs onto the end. There was this sentence we had as a fun toy example, where it was like half a paragraphs of verbs in the end, and you had to try and match them up with the beginning of the sentence.
Edit:found a reference to it https://www.reddit.com/r/German/comments/ul0xgt/just_for_fun...
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#65Earlier quoted context omitted.
There's a paper associated with it that you can read on your phone. And I don't think demo videos are really associated with "research". I agree they could've added both, but let's be honest here you'll have demo videos on this in the next 12 hours for sure.
That's a related complaint: everyone continues to insist on releasing papers as PDFs, ignoring the fact that those are still pretty nasty to read on a mobile device. Sure, release a PDF (some people like those), but having an additional responsive web page version of a paper makes research much more readable to the majority of content consumption devices. It's 2023. I'll generally use https://www.arxiv-vanity.com/ to…
Would you like a back rub while I'm at it?
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#66Anyone know what hardware it takes to run this? Asking as an enthusiastic newbie
At a guess, based on model size, just about anything, even a Raspberry Pi 4 etc.
As comparison the GGML port of Whisper (OpenAI's equivalent), runs in the browser, via WASM: https://whisper.ggerganov.com/
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#67Does it do American Sign Language, US fifth largest language? I didn’t think so.
Perhaps you could help by inventing a written version of ASL, since one doesn't currently exist. [EDIT: I was wrong, sorry, see my response below.] Seems like that would be a prerequisite for a model based on written language. And of course if you could also create an entire corpus of training material in your written ASL?
It is called SignWriting for all you multiple naysayers.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#68I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done.
The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really something great to do experiments on. Like do some ASR with Whisper, images with Stable Diffusion or load a LLM onto it, or this project here from Facebook.
Renting a GPU in the cloud doesn't seem to be a solution for this use case, where you just want to let something run for a couple of days and see if it's useful for something.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#69Code: https://github.com/facebookresearch/fairseq/tree/main/exampl... Blog Post: https://ai.facebook.com/blog/multilingual-model-speech-recog... Paper: https://research.facebook.com/publications/scaling-speech-te... Languages coverage: https://dl.fbaipublicfiles.com/mms/misc/language_coverage_mm...
I loaded the language coverage into Datasette Lite and added some facets here: https://lite.datasette.io/?json=https://gist.github.com/simo... Here's how I did that: https://gist.github.com/simonw/63aa33ec827b093f9c6a2797df950... Here are the top 20 represented language families: Niger-Congo 1,019 Austronesian 609 Sino-Tibetan 288 Indo-European 278 Afro-Asiatic 222 Trans-New Guinea 219 Otomanguean 149 Nilo-Saharan 13…
Thanks -- great way to visualize how massive this set of languages really is.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#70I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…
Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case.
Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for cheap. Not something I'd use for uhhh...basically anything corporate, but for a personal project with no data security or uptime issues it would probably work great.