Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

The makers of Eleuther hope it will be an open source alternative to GPT-3

wired.com

Post reply on HN
Print view View original

11–20 of 100 posts

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#11

Post by grogenaut »

spideymans wrote: post #4

It'll be interesting to see how colleges and universities react to GPT-3. Students will surely use it to write entire assignments.

Have you read much gpt3 stuff? While it's coherent in a sentence it is very rambling over paragraphs to pages. It could probably do fine for a grade school or bad highschool paper. I think if you turned it in for college you'd get an f.

On an unrelated note my fake daughter is now a TA and the professor lead off saying "we are in a golden age of cheating". They're going for way more short assignments as it's a lot more work to cheat on those than one make or break test.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#12

Post by grapecookie »

ravi-delia wrote: post #7
grapecookie wrote: post #3

The fact that there are no advanced AI chat-bots because they might (I mean they will lol) say something offensive is absurd. we are such babies. General AI is already here. It should be implemented on twitter or wherever and used to teach us about ourselves. driven by engagement, untethered by morals. A dispassionate glimpse into what sells. An AI that exploits our engagement, for good or evil. The bot would become…

Ah yes, the only possible issue with releasing fully general AI is that it might say something offensive. Not because we don't have it at all, not because if we did we shouldn't just let it out like a lion in the gazelle pen to see what it does, because of those snowflakes!

Wrong, gpt4 is new and has not been implmented as a chat bot.

Also wrong that previous chat bots were not shut down for being offensive. https://en.wikipedia.org/wiki/Tay_(bot)

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#13

Post by SubiculumCode »

grogenaut wrote: post #11
spideymans wrote: post #4

It'll be interesting to see how colleges and universities react to GPT-3. Students will surely use it to write entire assignments.

Have you read much gpt3 stuff? While it's coherent in a sentence it is very rambling over paragraphs to pages. It could probably do fine for a grade school or bad highschool paper. I think if you turned it in for college you'd get an f. On an unrelated note my fake daughter is now a TA and the professor lead off saying "we are in a golden age of cheating". They're going for way more short assignments as it's a lot mo…

Have you read college freshman essays? While it's coherent in a sentence it is very rambling over paragraphs to pages.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#14

Post by minimaxir »

As someone who works on a Python library solely devoted to making AI text generation more accessible to the normal person (https://github.com/minimaxir/aitextgen ) I think the headline is misleading.

Although the article focuses on the release of GPT-Neo, even GPT-2 released in 2019 was good at generating text, it just spat out a lot of garbage requiring curation, which GPT-3/GPT-Neo still requires albeit with a better signal-to-noise ratio. Most GPT-3 demos on social media are survivorship bias. (in fact OpenAI's rules for the GPT-3 API strongly encourage curating such output)

GPT-Neo, meanwhile, is such a big model that it requires a bit of data engineering work to get operating and generating text (see the README: https://github.com/EleutherAI/gpt-neo ), and it's unclear currently if it's as good as GPT-3, even when comparing models apples-to-apples (i.e. the 2.7B GPT-Neo with the "ada" GPT-3 via OpenAI's API).

That said, Hugging Face is adding support for GPT-Neo to Transformers (https://github.com/huggingface/transformers/pull/10848 ) which will help make playing with the model easier, and I'll add support to aitextgen if it pans out.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#15

Post by burlesona »

everdrive wrote: post #2

People already believe garbage at a pretty alarming rate. It's easy to guess at a number of possible outcomes here: - More junk text moves the public to doubt legitimate information even further than they currently do. - There is so much human-generated junk text that adding more of it via AI actually doesn't have much of an effect. - People return to lean on experts, perhaps even more than before. (just as a number…

I think we may come to see the era of roughly 1990-2010 as the golden age of information: relative abundance creating new opportunity, before the noise drowned it all out.

I suspect that in the future people will, ironically, return more strictly to tribal knowledge, as the media and the internet will be (already is) a vast ocean from which you can pull anything you want to believe. Thus nothing you see or hear from mass media or the internet can be trusted, there are no experts, and you go back to information scarcity as you have to rely on your immediate human network for trust. Actually I think we’re already seeing the return to tribal authority, the early waves are already here on Facebook and YouTube... they just haven’t devolved to strictly local circles of trust yet.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#17

Post by leereeves »

grapecookie wrote: post #3

The fact that there are no advanced AI chat-bots because they might (I mean they will lol) say something offensive is absurd. we are such babies. General AI is already here. It should be implemented on twitter or wherever and used to teach us about ourselves. driven by engagement, untethered by morals. A dispassionate glimpse into what sells. An AI that exploits our engagement, for good or evil. The bot would become…

What do you mean by General AI?

If you mean AGI (artificial general intelligence) it's definitely not here yet.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#18

Post by droopyEyelids »

pabe wrote: post #16

Did anybody set up a webinterface for testing this already?

I apologize for joking on Hacker News, but go to Google and type in anything to do with a consumer product comparison, and you'll get a billion results of webpages filled with text indistinguishable from AI generated blather.

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#19

Post by ravi-delia »

grapecookie wrote: post #12
ravi-delia wrote: post #7

Earlier quoted context omitted.

Ah yes, the only possible issue with releasing fully general AI is that it might say something offensive. Not because we don't have it at all, not because if we did we shouldn't just let it out like a lion in the gazelle pen to see what it does, because of those snowflakes!

Wrong, gpt4 is new and has not been implmented as a chat bot. Also wrong that previous chat bots were not shut down for being offensive. https://en.wikipedia.org/wiki/Tay_(bot)

Mmm, and was Tay General AI also?

Re: The makers of Eleuther hope it will be an open source alternative to GPT-3

#20

Post by grogenaut »

SubiculumCode wrote: post #13
grogenaut wrote: post #11

Earlier quoted context omitted.

Have you read much gpt3 stuff? While it's coherent in a sentence it is very rambling over paragraphs to pages. It could probably do fine for a grade school or bad highschool paper. I think if you turned it in for college you'd get an f. On an unrelated note my fake daughter is now a TA and the professor lead off saying "we are in a golden age of cheating". They're going for way more short assignments as it's a lot mo…

Have you read college freshman essays? While it's coherent in a sentence it is very rambling over paragraphs to pages.

yes I've read them, would those pass an English composition class in college? This comment generated by Gpt3
Post reply on HN