meta is doing more for open ai than openai
I don't think open source LLMs over a certain capability will be legal soon, in the same way an open source SDR transmitter would not be legal.
Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
151–160 of 232 posts
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#152ASR: "Automatic Speech Recognition"; also known as "Speech to Text" (STT) TTS: "Text to Speech" LID: "Language Identification" In case anyone else was confused about what the acronyms mean.
TLA: “Text LLM Application.” ;)
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#153Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#154I just wanted to test out the TTS locally on a powerful Ubuntu 22.04 machine, but the process for setting it up seems pretty broken and poorly documented. After 20 minutes of trying I finally gave up since I couldn't get the VITS dependency to build (despite having a fully updated machine with all required compilers). It seems like they never really bother to see if the stuff works on a fresh machine starting from sc…
I wrote a colab to run TTS, it takes some time to install dependencies : https://colab.research.google.com/drive/11tZ1c7kQJ5uKImm9t-C...
Overall I got pretty poor results in english and french, I guess it would require some fine-tuning
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#155Why is Meta open sourcing their AI work like this? Is it because they don't have a great reputation even among tech companies?
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#156I would like to use stuff like this as a side-project. Buy a Nvidia Geforce GPU and stick it into my 24/7 server and play around with it in my free time, to see what can be done. The issue with all these AI models is that there's no information on which GPU is enough for which task. I'm absolutely clueless if a single RTX 4000 SFF with its 20GB VRAM and only 70W of max power usage will be a waste of money, or really…
[deleted]
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#157Why is Meta open sourcing their AI work like this? Is it because they don't have a great reputation even among tech companies?
My speculation: the repo hasnt been in active development for at least a year, all the main contributors left to found Character.AI, so Meta is open sourcing it because it only rots sitting there and going open means goodwill, and maybe someone else picks it up and runs with it and contributes back to make it more useful.
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#158I was super excited at this, but digging through the release [0] one can see the following [1]. While using Bible translations is indeed better than nothing, I don't think the stylistic choices in the Bible are representative of how people actually speak the language, in any of the languages I can speak (i.e. that I am able to evaluate personally). Religious recordings tend to be liturgical, so even the pronunciation…
This paragraph justifies the decision, IMHO. > Collecting audio data for thousands of languages was our first challenge because the largest existing speech datasets cover 100 languages at most. To overcome this, we turned to religious texts, such as the Bible, that have been translated in many different languages and whose translations have been widely studied for text-based language translation research. I think the…
While AFAIU the UN: UDHR United Nations Universal Declaration of Human Rights is the most-translated document in the world, relative to the given training texts there likely hasn't been as much subjective translation analysis of UDHR.
Awesome-legal-nlp links to benchmarks like LexGLUE and FairLex but not yet LegalBench; in re: AI alignment and ethics / regional law https://github.com/maastrichtlawtech/awesome-legal-nlp#bench...
A "who hath done it" exercise:
[For each of these things, tell me whether God, Others, or You did it:] https://twitter.com/westurner/status/1641842843973976082?
"Did God do this?"
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#159Why is Meta open sourcing their AI work like this? Is it because they don't have a great reputation even among tech companies?
Meta has had a culture of open source, even before their reputation got bad (React, RocksDB, Thrift, folly, etc). They open source a lot of their AI models (instead of just source) because they don't have an enterprise cloud to sell these things, unlike Amazon/Google/Microsoft's offerings (which all offer speech transcription and text to speech as services).
Re: Meta AI announces Massive Multilingual Speech code, models for 1000+ languages
#160fairseq is a fairly missed naming opportunity. C-3PO would have been better.