Live data from Hacker News

GPT-Neo – Building a GPT-3-sized model, open source and free

eleuther.ai

51–60 of 260 posts

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#52

Earlier quoted context omitted.

So OpenAI employees get Microsoft RSUs?

What is an RSU?

It means restricted stock unit, and it's a kind of company stock unit that may be distributed to some "valued" employees. There is usually a vesting schedule, and you can't do whatever you want with it.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#53
post #37

Earlier quoted context omitted.

Touch ups where done before photoshop but now it’s ALWAYS done. The issues this has created in society might have a bigger emotional impact than we give it credit for. Regarding photo news there has been quite a lot of scandals to the point that I’d guess the touchups is more or less accepted.

I conducted a workshop in media compentency for teenage girls and one of the key learnings was that every image of a female subject they encounter in printed media (this was before Instagram) has been retouched. To hammer the point home I let them retouch a picture by themselves to see what is possible even for a completely untrained manipulator. It was eye-opening - one of the things that should absolutely be taught…

"one of the things that should absolutely be taught in school but isn't."

Namely, critical thinking?

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#54
Is there any real justification behind this fear of close nature of OpenAI or this is just frustration coming out? We had this debate of closed Vs open source 20 years back and eventually opensource won it because of various reasons. Won't those same reasons apply to this situation of close nature of OpenAI? If so then why are people worried about this? What is differnt this time?

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#55

Earlier quoted context omitted.

Don't read news. Go to original sources and scientific papers. If you really want to understand something, a news website should only be your starting point to look for keywords. That is true today as it will be "post-GPT-3".

Besides the time scalability aspect highlighted by someone else, I am worried that GPT-3 will have the potential to produce even "fake scientific papers". Our trust fabric is already quite fragile post-truth. GPT-3 might make it even more fragile.

I wouldn't worry about the science bit. No one worries about the university library getting larger and larger or how its going to confuse or misguide people even though everyone knows there are many books in there, full of errors, outdated information, badly written, boring etc etc etc.

Why? Cause there is always someone on campus who knows something about a subject to guide you to the right stuff.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#56

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

I know! One day it's going to get so bad people are going to have to deploy critical thinking instead of accepting what they read at face value and suffer the indignity of having to think for themselves.

10,000 years of human civilization and this hasn't happened yet, huh? Any day now, I'm sure

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#57
post #13

Earlier quoted context omitted.

Don't read news. Go to original sources and scientific papers. If you really want to understand something, a news website should only be your starting point to look for keywords. That is true today as it will be "post-GPT-3".

Primary sources need to be approached with caution https://clas.uiowa.edu/history/teaching-and-writing-center/g...

And so does every other source. You can play that analysis game with any source material. The problem is that the accuracy and detail of the reporting usually fades with each step towards mass media content.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#58

Earlier quoted context omitted.

Photoshop has existed for decades. Is it really that big of a problem for photo news?

The concern is not so much AI generated news, but malicious actors misleading, influencing or scamming people online at scale with realistic conversations. Today we already have large scale automated scams via email and robo call. Less scalable scams like Tinder love catfish scams or Russian/China trolls on reddit are now run by real people, imagine it being automated. If human moderators cannot distinguish these bot…

why does this matter? the internet is filled with millions of very low quality human generated discussions right now. There might not be much of a difference between thousands of humans generating comment spam and thousands of gpt-3 instances doing the same

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#59

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

I know! One day it's going to get so bad people are going to have to deploy critical thinking instead of accepting what they read at face value and suffer the indignity of having to think for themselves.

Maybe somebody could create an AI that evaluates the factfulness of articles.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#60
post #53
post #37

Earlier quoted context omitted.

I conducted a workshop in media compentency for teenage girls and one of the key learnings was that every image of a female subject they encounter in printed media (this was before Instagram) has been retouched. To hammer the point home I let them retouch a picture by themselves to see what is possible even for a completely untrained manipulator. It was eye-opening - one of the things that should absolutely be taught…

"one of the things that should absolutely be taught in school but isn't." Namely, critical thinking?

I don't think "critical thinking" is the point here. Because first you need to know that such modifications CAN be done. And not everybody knows what can be retouched with PS or programs. So yeah, if you see some super-model on a magazine cover, and you don't know PS can edit photos easily, it would be not that immediate to think "hey maybe that's not real!".

As an extreme example: would you ever checked 20 years ago a newspaper text to know if it was generated by an AI or by a human? Obviously no, because you didn't know of any AI that could do that.

Post reply on HN