Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-Neo – Building a GPT-3-sized model, open source and free

eleuther.ai

Post reply on HN
Print view View original

21–30 of 260 posts

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#21

Post by Rastonbury »

Erlich_Bachman wrote: post #6
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

Photoshop has existed for decades. Is it really that big of a problem for photo news?

The concern is not so much AI generated news, but malicious actors misleading, influencing or scamming people online at scale with realistic conversations. Today we already have large scale automated scams via email and robo call. Less scalable scams like Tinder love catfish scams or Russian/China trolls on reddit are now run by real people, imagine it being automated. If human moderators cannot distinguish these bots from real humans, that is a scary thought, imagine not being able to tell if this comment was written by a human or robot.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#22

Post by Agentlien »

draugadrotten wrote: post #12
Erlich_Bachman wrote: post #6

Earlier quoted context omitted.

Photoshop has existed for decades. Is it really that big of a problem for photo news?

Yes! https://en.wikipedia.org/wiki/Adnan_Hajj_photographs_controv... https://www.bbc.com/news/world-asia-china-55140848 and many more

Wow, that first Adnan Hajj photograph looks absolutely terrible.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#23

Post by Yetanfou »

Erlich_Bachman wrote: post #6
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

Photoshop has existed for decades. Is it really that big of a problem for photo news?

That is like saying "black powder has existed for centuries, are nuclear weapons really that big a problem?". The difference between an image editor like Photoshop and an automated image generation program is the far greater production capacity, speed, the lower cost and the fact that anyone with the right equipment can use it whereas the end result of of an image editor only is as good as the person using it,

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#24

Post by falcor84 »

anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

> already struggling to distinguish ... automated customer request replies from genuine replies

I hope it's not only due to a decline in the quality of human support. If we could have really useful automated support agents, I for one would applaud that.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#25

Post by anticristi »

turing_complete wrote: post #9
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

Don't read news. Go to original sources and scientific papers. If you really want to understand something, a news website should only be your starting point to look for keywords. That is true today as it will be "post-GPT-3".

Besides the time scalability aspect highlighted by someone else, I am worried that GPT-3 will have the potential to produce even "fake scientific papers".

Our trust fabric is already quite fragile post-truth. GPT-3 might make it even more fragile.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#26

Post by danwills »

newswasboring wrote: post #2

The intention behind it is pretty good. Best of luck to them. I wonder if I can donate computing power to this remotely. Like the old SETI or protein folding things. Use idle CPU to calculate for the network. Otherwise the estimates I have seen on how much it would take to train these models are enormous.

Yeah! sounds great, if I could easily run a SETI-at-home style thing to contribute to training a (future) model similar to GPT-x, but with the result freely available to play with, I reckon i'd do it. Could even be made into a game I'd say! I am totally aware that gpt3 itself can't be run on a regular workstation, but maybe hosting for instances of models from the best/most-interesting training runs could be worked out by crowd-funding?

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#27

Post by bencollier49 »

anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

We'll go full circle and you'll be forced to meet people in person again.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#28

Post by anticristi »

falcor84 wrote: post #24
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

> already struggling to distinguish ... automated customer request replies from genuine replies I hope it's not only due to a decline in the quality of human support. If we could have really useful automated support agents, I for one would applaud that.

I agree. As long as it is transparent that I am speaking to an automated agent and I can easily escalate the issue to a human that can solve my problem when the agent gets stuck.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#29

Post by hntrader »

turing_complete wrote: post #9
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

Don't read news. Go to original sources and scientific papers. If you really want to understand something, a news website should only be your starting point to look for keywords. That is true today as it will be "post-GPT-3".

That's what people should do, and that's what you and I will do, but many won't, especially the less educated (no condescension intended). They'll buy into the increased proliferation of fake info. It's because of these people that I think the concerns are valid.

Re: GPT-Neo – Building a GPT-3-sized model, open source and free

#30

Post by Drakim »

taneq wrote: post #14
anticristi wrote: post #3

I love the initiative, but I'm starting to get scared of what a post-GPT-3 world will look like. We are already struggling to distinguish fake news from real ones, automated customer request replies from genuine replies, etc. How will I know that I have a conversation with a real human in the future? On the other side, the prospect of having an oracle that answers all trivia, fixes spelling and grammar, and allows hu…

The fake news thing is a real problem (and may become worse under GPT3 but certainly exists already). As for the others - to quote Westworld, "if you can't tell the difference, does it really matter?"

What scares me personally is the idea that I might be floating in a sea of uncanny valley content. Content that's 98% human-like, but then that 2% sticks out like a nail and snaps me out of it.

Sure, I might not be able to tell the difference the majority of the time, but when I can tell the difference it's gonna bother me a lot.

Post reply on HN