Live data from Hacker News

Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

github.com

91–100 of 232 posts

Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

#91
post #70
post #68

I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…

Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…

Besides some great tooling out there if you wanted to roll your own, you can literally rent windows/linux computers, with persistent disks. If you have good internet, you can even use it as a gaming PC, as I do.

Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

#92
post #77
post #76

Earlier quoted context omitted.

My annoyance was managing state. I’d have to spend hours installing tools, downloading data, updating code, then when I want to go to bed I have to package it up and store as much as I can on s3 before shutting off the $$ server.

This is what containers solve. Don't waste time manually installing things. Store state in a database via the app on a different host.

Speaking as someone who has encountered similar difficulties, this response has strong 'Draw the rest of the owl' vibes

Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

#97
post #77
post #76

Earlier quoted context omitted.

My annoyance was managing state. I’d have to spend hours installing tools, downloading data, updating code, then when I want to go to bed I have to package it up and store as much as I can on s3 before shutting off the $$ server.

This is what containers solve. Don't waste time manually installing things. Store state in a database via the app on a different host.

Well then you're wasting time managing your containers? Have you ever used k8s, it's a full time job lol

Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

#98

Earlier quoted context omitted.

Perhaps you could help by inventing a written version of ASL, since one doesn't currently exist. [EDIT: I was wrong, sorry, see my response below.] Seems like that would be a prerequisite for a model based on written language. And of course if you could also create an entire corpus of training material in your written ASL?

It is called SignWriting for all you multiple naysayers. https://en.m.wikipedia.org/wiki/SignWriting

I stand corrected, thanks. There's a lot of info on the internet that says a written form of ASL doesn't exist, which is what I found when I Googled it.

Looking into it, it seems very much at the experimental stage in terms of digital representation -- while Unicode symbols exist, they require being placed in 2D boxes (using a drawing tool like SVG). It seems like it's only in the past few years that there have been proposals for how to turn it into a linear canonical text encoding?

Is anyone actually using those linear encodings -- SignPuddle or Formal SignWriting, they seem to be called -- in the wild, outside of demonstration texts or academia? Especially since they only date to 2016 and 2019.

Is there anywhere close at all to a corpus that Meta could train on? Because it still seems like the answer is no, but I also got my research wrong when Google gave no indication that SignWriting existed in the first place.

Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages

#100
post #91
post #70

Earlier quoted context omitted.

Wait why is renting a GPU in the cloud not a solution? You can even try multiple options and see which ones are capable enough for your use case. Look into some barebones cloud GPU services, for example Lambda Labs which is significantly cheaper than AWS/GCP but offers basically nothing besides the machine with a GPU. You could even try something like Vast in which people rent out their personal GPU machines for chea…

Besides some great tooling out there if you wanted to roll your own, you can literally rent windows/linux computers, with persistent disks. If you have good internet, you can even use it as a gaming PC, as I do.

What sort of frame rate and cost do you get? I have the highest tier GeForce now subscription and it sometimes drops to horrible conditions.
Post reply on HN