Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

Post by segmondy » Mon, May 22, 2023, 11:10 PM UTC

qwertox wrote: post #68

I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…

Post by ginko » Mon, May 22, 2023, 11:14 PM UTC

nharada wrote: post #70

qwertox wrote: post #68

I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…

Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…

Post by cmgbhm » Mon, May 22, 2023, 11:23 PM UTC

itake wrote: post #106

nomel wrote: post #91

Earlier quoted context omitted.

Besides some great tooling out there if you wanted to roll your own, you can literally rent windows/linux computers, with persistent disks. If you have good internet, you can even use it as a gaming PC, as I do.

Is there an easy way to off-board the persistent disk to cheaper machines when you don't need the gpus? Like imagine, setting up and installing everything with the gpu attached, but when you're not using the gpu or all the cpu cores, you can disconnect them. If you have docs on how to do this, please let me know.

Post by mackman » Mon, May 22, 2023, 11:36 PM UTC

itake wrote: post #76

nharada wrote: post #70

Earlier quoted context omitted.

Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…

My annoyance was managing state. I’d have to spend hours installing tools, downloading data, updating code, then when I want to go to bed I have to package it up and store as much as I can on s3 before shutting off the $$ server.

Post by qumpis » Mon, May 22, 2023, 11:39 PM UTC

RheingoldRiver wrote: post #112

mkl wrote: post #89

Earlier quoted context omitted.

Most are at risk of extinction. "half of the languages spoken today have fewer than 10,000 speakers and that a quarter have fewer than 1,000 speakers" ( https://en.wikipedia.org/wiki/Language_death ). "Today, on average, we lose one language in the world every six weeks. There are approximately 6800 languages. But four percent of the population speaks 96 percent of the languages, and 96 percent of the population spea…

Wow, preserving almost-dead languages sounds like something that LLMs would be pretty appropriate for, right? We would primarily need as large a body of written text translated into both a "known" language and the dying language as possible.