Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What we still don’t know about how A.I. is trained

newyorker.com

Post reply on HN
Print view View original

111–120 of 211 posts

Re: What we still don’t know about how A.I. is trained

#111

Post by majormajor »

matheusmoreira wrote: post #16
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

If you excise the concern about "did a government make this tech secretly for their own purposes," do the problems and possibilities it raises actually differ if it emerged from "pure research" or a conspiracy?

I don't believe anyone needed a conspiracy to try to make it impossible to tell what's real or fake, people have been trying to use technology to do that for decades (if not centuries) all on their own.

Re: What we still don’t know about how A.I. is trained

#112

Post by rvba »

1vuio0pswjnm7 wrote: post #78

"To avoid this problem, according to Time, OpenAI engaged an outsourcing company that hired contractors in Kenya to label vile, offensive, and potentially illegal material that would then be included in the training data so that the company could create a tool to detect toxic information before it could reach the user. Time reported that some of the material "described situations in graphic detail like child sexual a…

I wonder how much better the labeling of everything (not just the bad stuff) would be if it wasnt outsourced to the lowest bidder

Re: What we still don’t know about how A.I. is trained

#113

Post by golemotron »

ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

It would be hard for me to believe that GPT systems are not being trained on the vast corpus of intercepted data has been collected and warehoused.

Re: What we still don’t know about how A.I. is trained

#114

Post by chatmasta »

ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

If you want a conspiracy theory, consider this: it's likely there is at least one Chinese spy already working for OpenAI.

Re: What we still don’t know about how A.I. is trained

#115

Post by ftxbro »

kzrdude wrote: post #102
saiya-jin wrote: post #75

Earlier quoted context omitted.

> GPT-4 is closely resembles AGI already Thats a very bold statement and goes against everything I've read on it so far, care to backup such a claim with some facts? Of course each of us has their own bar for such things, but for most its pretty darn high

OpenAI people put out this paper https://arxiv.org/abs/2303.12712 called Sparks of Artificial General Intelligence: Early experiments with GPT-4 and as the title makes clear, they think it has hints of AGI. I guess that's a good place to start to answer your question. I don't think this is AGI, but the paper is full of examples where GPT-4 works well and does impressive stuff.

you can download tex source for that pdf which at one point (idk if it still does) included the comment "WORK IN PROGRESS - DO NOT SHARE" and the commented out title "First Contact with an AGI System" which they ended up toning down for publication lol

Re: What we still don’t know about how A.I. is trained

#116

Post by beaned »

rvba wrote: post #112
1vuio0pswjnm7 wrote: post #78

"To avoid this problem, according to Time, OpenAI engaged an outsourcing company that hired contractors in Kenya to label vile, offensive, and potentially illegal material that would then be included in the training data so that the company could create a tool to detect toxic information before it could reach the user. Time reported that some of the material "described situations in graphic detail like child sexual a…

I wonder how much better the labeling of everything (not just the bad stuff) would be if it wasnt outsourced to the lowest bidder

Is there a specific capacity in regards to labeling that is enabled by more money? I can see it for like.. heart surgery. But don't most of us know what things are to be called when we see them? ChatGPT seems to be pretty good at knowing what bad stuff is.

Re: What we still don’t know about how A.I. is trained

#117

Post by slg »

airstrike wrote: post #109
slg wrote: post #82

Earlier quoted context omitted.

Are you suggesting an alternative of not caring about how this technology will negatively impact society is a preferable approach?

There's a difference between caring and saying you care

You could argue this is true for people, but I think it is pointless to personify a company like this. We should judge them by their actions and not their motivations because their motivations are almost always just to make more money.

Re: What we still don’t know about how A.I. is trained

#118

Post by pazimzadeh »

rwmj wrote: post #60
elif wrote: post #41

Earlier quoted context omitted.

It is hardly different from saying "you could put cash in duffel bags and the transaction would be hard to trace" Is that assistance? It is just a basic statement of fact. Is wikipedia guilty of providing assistance to NK? They provide far more in depth "assistance" to anyone wanting to perform a Bitcoin transaction. Bringing this back to my original comment, you can see why the federal government would restrict the…

So wait, if the North Koreans can just read all about it on Wikipedia, why did they invite him to the conference? Also North Korea is a strange hill to die on. It's a brutal dictatorship which represses their own people and threatens to reign nuclear hell on their neighbours and the US. There's a very clear moral line that it's wrong to help them to launder money and evade sanctions, even if it weren't illegal.

So, basically the same as Saudi Arabia, except they don't grovel for the US?

And has the US has not repressed its people and threatened its neighbors? Has not been brutal?

Re: What we still don’t know about how A.I. is trained

#119

Post by FeteCommuniste »

chatmasta wrote: post #114
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

If you want a conspiracy theory, consider this: it's likely there is at least one Chinese spy already working for OpenAI.

Wouldn't even have to be someone from China. Just need a big enough carrot or stick to get a well-placed employee to hand over secrets.

Re: What we still don’t know about how A.I. is trained

#120

Post by chatmasta »

FeteCommuniste wrote: post #119
chatmasta wrote: post #114

Earlier quoted context omitted.

If you want a conspiracy theory, consider this: it's likely there is at least one Chinese spy already working for OpenAI.

Wouldn't even have to be someone from China. Just need a big enough carrot or stick to get a well-placed employee to hand over secrets.

I haven't checked their hiring page, but I'm guessing they only hire US citizens. But it's well established that China has an industrial espionage strategy with assets active throughout many American companies. It's hard to imagine that OpenAI wouldn't have been a priority target, starting from at least five years ago.
Post reply on HN