101–109 of 109 posts
While I appreciate what Eleuther have done - why are they highlighting "research" consisting of removing a bit of whitespace from some source code... is it April 1st already? Heres my addition! Or subtraction, i guess... (-4 chars by changing call to AdaptiveAvgPool2d): from torch.nn import* def c(h,d,k,p,n):S,C,A=Sequential,Conv2d,lambda x:S(x,GELU(),BatchNorm2d(h));R=type('',(S,),{'forward':lambda s,x:s0+x});return…
Earlier quoted context omitted.
This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models
Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models. Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere. Hardly anyone has done anything interesting with any of the ex…
Spot on. Everyone is talking about hos "fast moving" and "innovative" SD community is. Is it? I don't see many models that generate something that is NOT pretty anime girls. There are some... but if you exclude all "female focused" models, SD community doesn't seem particularly active.
Earlier quoted context omitted.
You're in luck! EleutherAI has trained and released open source weights of several LLMs, including GPT-Neo (2.7B parameters), GPT-J (6B parameters), and GPT-NeoX (20B parameters). This last model is currently tied for second on the list of the largest open source LLMs in the world. We also developed VQGAN-CLIP and CLIP-Guided Diffusion, techniques for doing text-to-image synthesis that don't require training and can…
I don't want to be too cynical, but OpenAI used to be more open too until they decided releasing weights was too dangerous (/not profitable enough?), what guarantee is there that Eleuther doesn't also close their doors at some point?
But I’m confused by the anti non-profit vibes in this comment section. We aren’t saying that becoming a non-profit makes us ethical people, that would be a silly argument. But people do realize that the alternative would be to become a for-profit entity right?
We’re still the same community-driven open collaborative research lab we’ve always been. But incorporating allows us to do things like hire full time staff, enter organizationally binding legal agreements, and protect our members. Between the options of becoming a for-profit and a non-profit, the later seems clearly better suited for our goals.
Earlier quoted context omitted.
Yes, we are currently bottlenecked primarily by engineering manpower.
Not access to GPUs for training? What would it take to get a 65B model out of eleuther?
Earlier quoted context omitted.
No, Amazon has shareholders, nonprofits do not.
The use of the word “basically” means that the previous commenter is saying that Amazon operated like a non-profit because it re-invested the vast majority of its profits.
Earlier quoted context omitted.
I don't want to be too cynical, but OpenAI used to be more open too until they decided releasing weights was too dangerous (/not profitable enough?), what guarantee is there that Eleuther doesn't also close their doors at some point?
I mean, ultimately there isn’t one. I’m just providing examples of how we fulfill the things that the OP says they want, as they seem unaware of our work. But I’m confused by the anti non-profit vibes in this comment section. We aren’t saying that becoming a non-profit makes us ethical people , that would be a silly argument. But people do realize that the alternative would be to become a for-profit entity right? We’…
Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…
Earlier quoted context omitted.
My name is Ελευθέριος and I transliterate it as Eleftherios in English.
There's a "standard" way of how greek words should be transliterated in English (ELOT 743). You can test it here https://www.passport.gov.gr/passports/GrElotConverter/GrElot... And yes, Eleftherios is the correct transliteration :)
Earlier quoted context omitted.
This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models
Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models. Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere. Hardly anyone has done anything interesting with any of the ex…
People want good text models at home.