Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

EleutherAI announces it has become a non-profit

blog.eleuther.ai

Post reply on HN
Print view View original

71–80 of 109 posts

Re: EleutherAI announces it has become a non-profit

#71

Post by hotstickyballs »

ketzo wrote: post #52
versteegen wrote: post #36

Earlier quoted context omitted.

It's disruptive technology and an enormous amount of value is likely to be created. I would much rather the profits go to a nonprofit which can distribute them charitably rather than them giving them away freely to the megacorps which actually have the resources to run these massive models (edit^2: at scale). I do think the 100x cap on return on Microsoft's $1B investment was way too high (we don't know what the cap…

A nonprofit wouldn't have to distribute profits to charity. It just can't distribute profits to private or public shareholders (because it can't have them). A nonprofit is obligated to reinvest any earnings towards its mission. Not remotely an expert, this is just my basic understanding. "Nonprofit" is a pretty abused term.

TIL Amazon was basically a non profit

Re: EleutherAI announces it has become a non-profit

#72

Post by O__________O »

hotstickyballs wrote: post #71
ketzo wrote: post #52

Earlier quoted context omitted.

A nonprofit wouldn't have to distribute profits to charity. It just can't distribute profits to private or public shareholders (because it can't have them). A nonprofit is obligated to reinvest any earnings towards its mission. Not remotely an expert, this is just my basic understanding. "Nonprofit" is a pretty abused term.

TIL Amazon was basically a non profit

No, Amazon has shareholders, nonprofits do not.

Re: EleutherAI announces it has become a non-profit

#73

Post by TeMPOraL »

e12e wrote: post #45
1f60c wrote: post #28

Earlier quoted context omitted.

I'm just going to keep saying YOO-luh-tuhr, thank you very much.

Reminds me of Yog-Sothoth, which would be a great name for an anthropomorphized statistical model... > Yog-Sothoth knows the gate. Yog-Sothoth is the gate. Yog-Sothoth is the key and guardian of the gate. Past, present, future, all are one in Yog-Sothoth. He knows where the Old Ones broke through of old, and where They shall break through again. He knows where They have trod earth's fields, and where They still tread…

Reminds me of how there was a post on LessWrong some good decade ago, with a chilling premise: we somehow manage to get a safe, trustworthy, correct AI working, and as we fire it up and ask to tell us about our world, it starts talking about things we somehow can't perceive...

Re: EleutherAI announces it has become a non-profit

#74

Post by TeMPOraL »

corysama wrote: post #70
e12e wrote: post #45

Earlier quoted context omitted.

Reminds me of Yog-Sothoth, which would be a great name for an anthropomorphized statistical model... > Yog-Sothoth knows the gate. Yog-Sothoth is the gate. Yog-Sothoth is the key and guardian of the gate. Past, present, future, all are one in Yog-Sothoth. He knows where the Old Ones broke through of old, and where They shall break through again. He knows where They have trod earth's fields, and where They still tread…

You laugh. But, that has been the meme about GPT for a bit now https://twitter.com/natfriedman/status/1625850766039842824?c... RLHF = Reinforcement Learning from Human Feedback

A meme that quickly became a long-form article: https://astralcodexten.substack.com/p/janus-simulators.

Re: EleutherAI announces it has become a non-profit

#75

Post by Taek »

riku_iki wrote: post #39
rahidz wrote: post #33

I hope Eleuther will continue to focus on the development of truly open-source models, which seems to be where the big gap is. The quality gap between Neo-20X and even the original GPT3 is still rather large, and making headway there would be amazing.

there will always be gap, since corps can grab open model, and add resources to improvements on top of it.

This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models

Re: EleutherAI announces it has become a non-profit

#76

Post by Taek »

stellaathena wrote: post #55
ftxbro wrote: post #12

Earlier quoted context omitted.

are you bottlenecked by engineering

Yes, we are currently bottlenecked primarily by engineering manpower.

Not access to GPUs for training? What would it take to get a 65B model out of eleuther?

Re: EleutherAI announces it has become a non-profit

#77

Post by __loam »

braingenious wrote: post #40
dvt wrote: post #11

Not sure why the AI community has a weird obsession with being non-profit (or not). It's not like non-profits can't be evil, and it's not like OpenAI has done anything particularly egregious, either. What we do need is more weights being released in the public domain (hard to find even on Huggingface), easier ways to train models locally, better pruned models for embedded device inference (e.g. running on a Jetson Na…

> Not sure why the AI community has a weird obsession… Can you elaborate on this “obsession”? Aren’t a lot of AI things made/implemented by for-profit companies? Google, Meta, Midjourney, etc?

Yeah lol. The obsession is understanding this is going to be pretty impactful technology and thinking it might be nice to not have that be closed source for once

Re: EleutherAI announces it has become a non-profit

#78

Post by wokwokwok »

Taek wrote: post #75
riku_iki wrote: post #39

Earlier quoted context omitted.

there will always be gap, since corps can grab open model, and add resources to improvements on top of it.

This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models

Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models.

Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere.

Hardly anyone has done anything interesting with any of the existing ones and they’ve been out for longer than SD has.

Text models just aren’t that interesting to people.

Re: EleutherAI announces it has become a non-profit

#80

Post by Winsaucerer »

wokwokwok wrote: post #78
Taek wrote: post #75

Earlier quoted context omitted.

This is not the case with Stable Diffusion. The open source community is moving faster and innovating faster, and the open models are by far the best. Midjourney is a contender, but it doesn't hold a candle to the best open models

Let’s be honest though; the number of people willing to devote their time to tireless effort generating porn (or suggestive images) is >> the number who will ever be willing to do it for text models. Add the size barrier (an order of magnitude > SD for text models) and it’s pretty questionable the open source text models ecosystem is going to go anywhere. Hardly anyone has done anything interesting with any of the ex…

I’m more interested in text models. So much potential there. I was fascinated by the person who hooked up a Siri shortcut to one of the openai models, asking it to return a json response. I think with a little imagination the potential applications are just as compelling as image models like SD.

Just one example, using these in games to generate unique conversations, actions, and events.

Post reply on HN