I really appreciate how the work of EAI has truly focused on making models accessible to the general public.
EleutherAI announces it has become a non-profit
91–100 of 109 posts
Re: EleutherAI announces it has become a non-profit
#92Earlier quoted context omitted.
The English convention is to pronounce -eu- in Greek words as /ju/, not /ef/.
My name is Ελευθέριος and I transliterate it as Eleftherios in English.
There's a "standard" way of how greek words should be transliterated in English (ELOT 743). You can test it here https://www.passport.gov.gr/passports/GrElotConverter/GrElot...
And yes, Eleftherios is the correct transliteration :)
Re: EleutherAI announces it has become a non-profit
#93Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
I was looking for open alternatives to self hosted, or crowd hosted finetuned LLMs like ChatGPT and found LAION Open Assistant. Then found resources to further optimize inference as well as training:
- Open source fine tuned assistants like LAION Open-Assistant [1]
- inference optimizations like VoltaML, FlexGenm Distributed Inference [2]
- training optimizations like Hivemind [2]
1 https://github.com/LAION-AI/Open-Assistant
2 https://github.com/underlines/awesome-marketing-datascience/...
Re: EleutherAI announces it has become a non-profit
#94Earlier quoted context omitted.
I don't want to be too cynical, but OpenAI used to be more open too until they decided releasing weights was too dangerous (/not profitable enough?), what guarantee is there that Eleuther doesn't also close their doors at some point?
Yes but in their wake they still left great contributions (CLIP, whisper, etc). So far they still seem net positive, even if they’re now for profit
I fail to see creating and releasing models as black boxes and strictly monetizing them while harvesting public data under the name of academic research as net positive.
They suck in public data, create models, let them loose, let hyped people improve them and profit off of data and people's free work.
IOW, a mechanical Turk which doesn't pay.
Re: EleutherAI announces it has become a non-profit
#95Earlier quoted context omitted.
It's disruptive technology and an enormous amount of value is likely to be created. I would much rather the profits go to a nonprofit which can distribute them charitably rather than them giving them away freely to the megacorps which actually have the resources to run these massive models (edit^2: at scale). I do think the 100x cap on return on Microsoft's $1B investment was way too high (we don't know what the cap…
I just looked up the the top CEO salaries of non-profit organizations in the USA - as of 2020, they ranged from about $16 million to $8 million. A non-profit appears to simply be a 'non-stock corporation' and can have the same ridiculouly pyramidal compensation structures that shareholder corporations do. Overhauling the legal definition of non-profit to require the highest-paid employees to make no more than ~10X as…
> Overhauling the legal definition of non-profit to require the highest-paid employees to make no more than ~10X as much as the lowest-paid employees would make a lot of sense.
Very easy to work around by outsourcing most operations. If you really want to prevent high salaries there you'd need to link it to some more fixed measure, such as a multiple of median salary.
Re: EleutherAI announces it has become a non-profit
#96Earlier quoted context omitted.
TIL Amazon was basically a non profit
No, Amazon has shareholders, nonprofits do not.
The use of the word “basically” means that the previous commenter is saying that Amazon operated like a non-profit because it re-invested the vast majority of its profits.
Re: EleutherAI announces it has become a non-profit
#97While I appreciate what Eleuther have done - why are they highlighting "research" consisting of removing a bit of whitespace from some source code... is it April 1st already?
Heres my addition! Or subtraction, i guess... (-4 chars by changing call to AdaptiveAvgPool2d):
from torch.nn import*
def c(h,d,k,p,n):S,C,A=Sequential,Conv2d,lambda x:S(x,GELU(),BatchNorm2d(h));R=type('',(S,),{'forward':lambda s,x:s0+x});return S(A(C(3,h,p,p)),*[S(R(A(C(h,h,k,1,k//2,1,h))),A(C(h,h,1)))for _ in[0]*d],AdaptiveAvgPool2d(1),Flatten(),Linear(h,n))Re: EleutherAI announces it has become a non-profit
#98Earlier quoted context omitted.
Sam doing a 180 on non-profit to for-profit was egregious, IMHO. Having said that, plenty of extremely profitable organizations masquerade (literally and figuratively) as non-profits. Also: https://twitter.com/elonmusk/status/1626516035863212034
It's disruptive technology and an enormous amount of value is likely to be created. I would much rather the profits go to a nonprofit which can distribute them charitably rather than them giving them away freely to the megacorps which actually have the resources to run these massive models (edit^2: at scale). I do think the 100x cap on return on Microsoft's $1B investment was way too high (we don't know what the cap…
Well, "they are doing something amazing, so ethics can be suspended for T amount time in the name of value" is equally egregious from my point of view.
Re: EleutherAI announces it has become a non-profit
#99While I appreciate what Eleuther have done - why are they highlighting "research" consisting of removing a bit of whitespace from some source code... is it April 1st already? Heres my addition! Or subtraction, i guess... (-4 chars by changing call to AdaptiveAvgPool2d): from torch.nn import* def c(h,d,k,p,n):S,C,A=Sequential,Conv2d,lambda x:S(x,GELU(),BatchNorm2d(h));R=type('',(S,),{'forward':lambda s,x:s0+x});return…
[deleted]
Re: EleutherAI announces it has become a non-profit
#100Earlier quoted context omitted.
You're in luck! EleutherAI has trained and released open source weights of several LLMs, including GPT-Neo (2.7B parameters), GPT-J (6B parameters), and GPT-NeoX (20B parameters). This last model is currently tied for second on the list of the largest open source LLMs in the world. We also developed VQGAN-CLIP and CLIP-Guided Diffusion, techniques for doing text-to-image synthesis that don't require training and can…
I don't want to be too cynical, but OpenAI used to be more open too until they decided releasing weights was too dangerous (/not profitable enough?), what guarantee is there that Eleuther doesn't also close their doors at some point?
There is no guarantee, but it sounds like if they didn't incorporate they wouldn't be doing much of anything, public or not.