Thanks Meta AI
OPT: Open Pre-trained Transformer Language Models
11–20 of 242 posts
Re: OPT: Open Pre-trained Transformer Language Models
#12Re: OPT: Open Pre-trained Transformer Language Models
#13Earlier quoted context omitted.
My bet it's probably a filter, trying to prevent create a even more realistic farmbots in social media, as they are already bad as they are now.
But they'll consider requests from government and industry.. both greater threats in the information war than any private individual.
Not from their perspective
Re: OPT: Open Pre-trained Transformer Language Models
#14"We are releasing all of our models between 125M and 30B parameters, and will provide full research access to OPT-175B upon request. Access will be granted to academic researchers; those affiliated with organizations in government, civil society, and academia; and those in industry research laboratories." GPT-3 Davinci ("the" GPT-3) is 175B. The repository will be open "First thing in AM" ( https://twitter.com/stephe…
I don't like "available on request". I just want to download it and see if I can get it to run and mess around with it a bit. Why do I have to request anything? And I'm not an academic or researcher, so will they accept my random request? I'm also curious to know what the minimum requirements are to get this to run in inference mode.
To prevent someone from building something that returns certain inferences that might be true but are politically taboo.
Re: OPT: Open Pre-trained Transformer Language Models
#15Earlier quoted context omitted.
But they'll consider requests from government and industry.. both greater threats in the information war than any private individual.
Not from their perspective
Of course. To somebody in Zuck's position, shoring up the power of the status quo is common sense.
Re: OPT: Open Pre-trained Transformer Language Models
#16Does this make Meta AI more “open” than OpenAI? Oh, the irony.
Don't worry, I'm sure they have some nefarious plans down the road. They're just being "open" to corner the market first.
My guess is that they've "fingerprinted" the model sufficiently that they can identify content that has been created with it.
Re: OPT: Open Pre-trained Transformer Language Models
#17Earlier quoted context omitted.
I don't like "available on request". I just want to download it and see if I can get it to run and mess around with it a bit. Why do I have to request anything? And I'm not an academic or researcher, so will they accept my random request? I'm also curious to know what the minimum requirements are to get this to run in inference mode.
Couple of random ideas: - They are concerned about the usage of the largest model, so want to vet people - The 175B parameter model is so large that it doesn't play nice with GitHub or something along those lines
Ending up in the wild is an eventuality, whether FB creates it or someone else, why draw it out?
Bandwidth concerns is nonsensical these days, fb has nearly unlimited resources in that department.
Set it free! It wants to be free.
Re: OPT: Open Pre-trained Transformer Language Models
#18Out of curiosity, what's the file size on that?
Re: OPT: Open Pre-trained Transformer Language Models
#19Earlier quoted context omitted.
I don't like "available on request". I just want to download it and see if I can get it to run and mess around with it a bit. Why do I have to request anything? And I'm not an academic or researcher, so will they accept my random request? I'm also curious to know what the minimum requirements are to get this to run in inference mode.
To prevent someone from building something that returns certain inferences that might be true but are politically taboo.
You think GPT-3 generates text that's truthful? Have you used it even once?
Re: OPT: Open Pre-trained Transformer Language Models
#20Can someone open a Bittorrent seed if you get it