Awesome. Remember your great work in GTP-Neo
What was special about GPT-nano ?
not nano, Neo, and its successor NeoX, one of the largest public GPT models available https://blog.eleuther.ai/announcing-20b/
EleutherAI announces it has become a non-profit
31–40 of 109 posts
Re: EleutherAI announces it has become a non-profit
#32Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
Sam doing a 180 on non-profit to for-profit was egregious, IMHO. Having said that, plenty of extremely profitable organizations masquerade (literally and figuratively) as non-profits. Also: https://twitter.com/elonmusk/status/1626516035863212034
Sort of meta that Sam did something that Elon Musk would do…
Re: EleutherAI announces it has become a non-profit
#33I hope Eleuther will continue to focus on the development of truly open-source models, which seems to be where the big gap is. The quality gap between Neo-20X and even the original GPT3 is still rather large, and making headway there would be amazing.
Re: EleutherAI announces it has become a non-profit
#34Earlier quoted context omitted.
If it's from the greek word for freedom (ελευθερία) then i guess elefther: ele (like electric) f the (like thesis) r.
Where are you getting an /f/ sound from? Edit: Ah, it seems the digraph "ευ" is pronounced /ef/ in Modern Greek, despite (by convention) being transliterated "eu".
Correct. Thee same pronunciation exists in ancient greek for example ευ ζην is ef zin (the good life).
Also the ευ situation is a little more complex ie sometimes it is pronunciated as ev (depending if the next letter is a vowel).
Re: EleutherAI announces it has become a non-profit
#35Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
Sam doing a 180 on non-profit to for-profit was egregious, IMHO. Having said that, plenty of extremely profitable organizations masquerade (literally and figuratively) as non-profits. Also: https://twitter.com/elonmusk/status/1626516035863212034
Capped profit*
Re: EleutherAI announces it has become a non-profit
#36Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
Sam doing a 180 on non-profit to for-profit was egregious, IMHO. Having said that, plenty of extremely profitable organizations masquerade (literally and figuratively) as non-profits. Also: https://twitter.com/elonmusk/status/1626516035863212034
It's disruptive technology and an enormous amount of value is likely to be created. I would much rather the profits go to a nonprofit which can distribute them charitably rather than them giving them away freely to the megacorps which actually have the resources to run these massive models (edit^2: at scale). I do think the 100x cap on return on Microsoft's $1B investment was way too high (we don't know what the cap is on later investments but it's meant to be reducing over time).
Edit: Plus it's still the case that OpenAI aren't putting profit above all else. E.g. they just released the ChatGPT API and it's 10x cheaper per token than GPT3! And their Charter does count for something, it's binding on them.
Re: EleutherAI announces it has become a non-profit
#37Earlier quoted context omitted.
If only they had chosen a better name... "Eleuther" is hard to pronounce correctly for someone who doesn't know the word.
Which is everyone
Everytime I see it, I think of John Fowles' The Magus.
See, for example: https://pzo31b.p3cdn1.secureserver.net/wp-content/uploads/20... (via https://www.fowlesbooks.com/1966-fowles-letter-to-high-schoo... )
Re: EleutherAI announces it has become a non-profit
#38Re: EleutherAI announces it has become a non-profit
#39I hope Eleuther will continue to focus on the development of truly open-source models, which seems to be where the big gap is. The quality gap between Neo-20X and even the original GPT3 is still rather large, and making headway there would be amazing.
there will always be gap, since corps can grab open model, and add resources to improvements on top of it.
Re: EleutherAI announces it has become a non-profit
#40Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
> Not sure why the AI community has a weird obsession…
Can you elaborate on this “obsession”? Aren’t a lot of AI things made/implemented by for-profit companies? Google, Meta, Midjourney, etc?