EleutherAI announces it has become a non-profit

Post by ImprobableTruth » Fri, Mar 03, 2023, 1:56 AM UTC

stellaathena wrote: post #59

dvt wrote: post #11

Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…

You're in luck! EleutherAI has trained and released open source weights of several LLMs, including GPT-Neo (2.7B parameters), GPT-J (6B parameters), and GPT-NeoX (20B parameters). This last model is currently tied for second on the list of the largest open source LLMs in the world. We also developed VQGAN-CLIP and CLIP-Guided Diffusion, techniques for doing text-to-image synthesis that don't require training and can…

Post by rvnx » Fri, Mar 03, 2023, 2:12 AM UTC

ketzo wrote: post #52

versteegen wrote: post #36

Earlier quoted context omitted.

It's disruptive technology and an enormous amount of value is likely to be created. I would much rather the profits go to a nonprofit which can distribute them charitably rather than them giving them away freely to the megacorps which actually have the resources to run these massive models (edit^2: at scale). I do think the 100x cap on return on Microsoft's $1B investment was way too high (we don't know what the cap…

A nonprofit wouldn't have to distribute profits to charity. It just can't distribute profits to private or public shareholders (because it can't have them). A nonprofit is obligated to reinvest any earnings towards its mission. Not remotely an expert, this is just my basic understanding. "Nonprofit" is a pretty abused term.

Post by layer8 » Fri, Mar 03, 2023, 2:19 AM UTC

Dalewyn wrote: post #48

behnamoh wrote: post #6

Earlier quoted context omitted.

If only they had chosen a better name... "Eleuther" is hard to pronounce correctly for someone who doesn't know the word.

One measure of likelihood for success is how well the name rolls off the tongue.

Post by [deleted] » Fri, Mar 03, 2023, 2:27 AM UTC

ImprobableTruth wrote: post #81

stellaathena wrote: post #59

Earlier quoted context omitted.

You're in luck! EleutherAI has trained and released open source weights of several LLMs, including GPT-Neo (2.7B parameters), GPT-J (6B parameters), and GPT-NeoX (20B parameters). This last model is currently tied for second on the list of the largest open source LLMs in the world. We also developed VQGAN-CLIP and CLIP-Guided Diffusion, techniques for doing text-to-image synthesis that don't require training and can…

I don't want to be too cynical, but OpenAI used to be more open too until they decided releasing weights was too dangerous (/not profitable enough?), what guarantee is there that Eleuther doesn't also close their doors at some point?

Post by ttt3ts » Fri, Mar 03, 2023, 3:36 AM UTC

wokwokwok wrote: post #78

Taek wrote: post #75

Earlier quoted context omitted.

This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models

Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models. Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere. Hardly anyone has done anything interesting with any of the ex…