I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…
Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…
Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
91–100 of 232 posts
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#92Earlier quoted context omitted.
My annoyance was managing state. I’d have to spend hours installing tools, downloading data, updating code, then when I want to go to bed I have to package it up and store as much as I can on s3 before shutting off the $$ server.
This is what containers solve. Don't waste time manually installing things. Store state in a database via the app on a different host.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#93Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#94Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#95Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#96Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#97Earlier quoted context omitted.
My annoyance was managing state. I’d have to spend hours installing tools, downloading data, updating code, then when I want to go to bed I have to package it up and store as much as I can on s3 before shutting off the $$ server.
This is what containers solve. Don't waste time manually installing things. Store state in a database via the app on a different host.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#98Earlier quoted context omitted.
Perhaps you could help by inventing a written version of ASL, since one doesn't currently exist. [EDIT: I was wrong, sorry, see my response below.] Seems like that would be a prerequisite for a model based on written language. And of course if you could also create an entire corpus of training material in your written ASL?
It is called SignWriting for all you multiple naysayers. https://en.m.wikipedia.org/wiki/SignWriting
Looking into it, it seems very much at the experimental stage in terms of digital representation -- while Unicode symbols exist, they require being placed in 2D boxes (using a drawing tool like SVG). It seems like it's only in the past few years that there have been proposals for how to turn it into a linear canonical text encoding?
Is anyone actually using those linear encodings -- SignPuddle or Formal SignWriting, they seem to be called -- in the wild, outside of demonstration texts or academia? Especially since they only date to 2016 and 2019.
Is there anywhere close at all to a corpus that Meta could train on? Because it still seems like the answer is no, but I also got my research wrong when Google gave no indication that SignWriting existed in the first place.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#99Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#100Earlier quoted context omitted.
Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…
Besides some great tooling out there if you wanted to roll your own, you can literally rent windows/linux computers, with persistent disks. If you have good internet, you can even use it as a gaming PC, as I do.