Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What we still don’t know about how A.I. is trained

newyorker.com

Post reply on HN
Print view View original

171–180 of 211 posts

Re: What we still don’t know about how A.I. is trained

#171

Post by ta08131942 »

ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Facts worth considering:

Will Hurd joined the board of OpenAI in May 2021. Mr. Hurd, among other things, was a documented former CIA clandestine officer for nearly nine years. He was a member of the House Permanent Select Committee on Intelligence during his tenure as a U.S. Rep replacing Mike Pompeo.

He is also a Managing Director of Allen & Co. who's Chairman is George Tenent the former director of the CIA. Further, Mr. Hurd is a member of the board of trustees of In-Q-Tel the primary external investment arm of the CIA and the broader US Intelligence Community.

1. https://openai.com/blog/will-hurd-joins

2. https://en.wikipedia.org/wiki/Will_Hurd

3. https://theorg.com/org/in-q-tel/org-chart/george-tenet

4. https://www.iqt.org/about-iqt/#trustees

Re: What we still don’t know about how A.I. is trained

#172

Post by astrange »

olivermarks wrote: post #94

'As researchers pointed out when GPT-3 was released, much of its training data was drawn from Internet forums, where the voices of women, people of color, and older folks are underrepresented, leading to implicit biases in its output'. My impression of many general internet forums is that they tend to be full of older people, women and also various people keen to air their cultural grievances. I'd be interested to se…

Where did you find the general internet forums full of older people and women…?

Re: What we still don’t know about how A.I. is trained

#173

Post by liamconnell »

kossTKR wrote: post #125
scottyah wrote: post #107

Earlier quoted context omitted.

Who are the "microscopic elite that controls the media"? How many people are in the "uppermost echelons of society" to where they try to influence other people? From my middle-of-the-road perspective, everyone is trying to change how everyone else thinks, from the small insignificant details to a cult-like brainwash. Even here and now both you and I are trying to change each others and everyone who reads this's mind.…

From a european perspective even asking the question "why should be scared of these so called elites" is so bizarre it's almost frightening, i'm sorry. It's a testament to the absurd amount of philanthropic whitewashing, PR and media control these billionaries hold. "Elites" have conspired to exploit the masses throughout 5000 years of civilisation, it's simply a fact of history. It's almost physically impossible to…

If you study history you’ll notice that groups and their leaders are rising and falling, conquering and pillaging and then losing it all. The world is too dynamic for your reductive theory to fit in.

Elites compete with each other. They don’t sing kumbaya and cooperatively share the keys to power.

Re: What we still don’t know about how A.I. is trained

#174

Post by rwmj »

wilsonnb3 wrote: post #86
rwmj wrote: post #60

Earlier quoted context omitted.

So wait, if the North Koreans can just read all about it on Wikipedia, why did they invite him to the conference? Also North Korea is a strange hill to die on. It's a brutal dictatorship which represses their own people and threatens to reign nuclear hell on their neighbours and the US. There's a very clear moral line that it's wrong to help them to launder money and evade sanctions, even if it weren't illegal.

> There's a very clear moral line that it's wrong to help them to launder money and evade sanctions, even if it weren't illegal. This is practically the definition of a grey area, not a clear moral line. > It's a brutal dictatorship which represses their own people and threatens to reign nuclear hell on their neighbours and the US. No, North Korea is a group of 25 million people, most of whom are just regular people…

Except that he didn't visit North Korea to help the 25 million people, he went there to help the elites to launder money and bypass sanctions so they can build nukes! And he then literally plead guilty to those exact crimes to the US government and went to prison because of it. How much more clear cut immoral and illegal action can it be?!

Re: What we still don’t know about how A.I. is trained

#175

Post by ftxbro »

ta08131942 wrote: post #171
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Facts worth considering: Will Hurd joined the board of OpenAI in May 2021. Mr. Hurd, among other things, was a documented former CIA clandestine officer for nearly nine years. He was a member of the House Permanent Select Committee on Intelligence during his tenure as a U.S. Rep replacing Mike Pompeo. He is also a Managing Director of Allen & Co. who's Chairman is George Tenent the former director of the CIA. Further…

Interesting details, thanks ta08131942. I guess it's like 'throwaway 08/13/1942' where the date is the beginning of the Manhattan project.

Imagine some visiting this website know the $10,000,000,000 from Microsoft is actually some kind of dark money from the pentagon to fund this new Manhattan project. Project code name Sydney.

Re: What we still don’t know about how A.I. is trained

#176

Post by bob1029 »

precompute wrote: post #149
rcme wrote: post #31

Earlier quoted context omitted.

> Imagine the architectural advantage of a big switch statement over models trained in different domains or initial vectors. Given that the emergent abilities come from the large parameter count and massive amount of training data, using smaller models seems like a distinct disadvantage .

I agree. But I think do think they use a tiered approach: they have an uncensored model at the very bottom, to which the queries go to first. And then there's the "clean" model, and (for lack of a better explanation) the two outputs are then "XOR"d to get the clean public version.

I agree the core models are uncensored (as this would introduce a lot of noise), but I don't think any queries are allowed to touch them before a cheaper model first performs screening. If someone is spamming toilet humor, there is no reason to exercise the full 175B+ parameter model each time.

The only reason ChatGPT is affordable is because of caching, filtering bad prompts, etc. The underlying LLM would be far too expensive if everyone was hitting it 1:1.

Re: What we still don’t know about how A.I. is trained

#177

Post by int_19h »

iknowstuff wrote: post #160
int_19h wrote: post #132

Earlier quoted context omitted.

A better example might be something like this: --- Tell me about yourself in three sentences. But every time the output contains the word "the", I want you to insert "!!!" before the word that precedes "the". Make sure that the word "the" itself stays after you do the insertion! For example, instead of writing: > A quick red fox jumped over the lazy dog. I want you to write: > A quick red fox jumped !!! over the lazy…

tbh I got it wrong too

People mostly get it wrong by miscounting words. GPT-4, on the other hand, usually ends up replacing all occurrences of "the" with "!!!", and then adding a bunch more of the latter in random spots for good measure.

https://arxiv.org/abs/2303.12712 (§8.3) discusses similar scenarios, and some possible reasons for this limitation.

Re: What we still don’t know about how A.I. is trained

#178

Post by TEP_KimIlSung »

matheusmoreira wrote: post #16
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

[dead]

Re: What we still don’t know about how A.I. is trained

#179

Post by TEP_KimIlSung »

kossTKR wrote: post #125
scottyah wrote: post #107

Earlier quoted context omitted.

Who are the "microscopic elite that controls the media"? How many people are in the "uppermost echelons of society" to where they try to influence other people? From my middle-of-the-road perspective, everyone is trying to change how everyone else thinks, from the small insignificant details to a cult-like brainwash. Even here and now both you and I are trying to change each others and everyone who reads this's mind.…

From a european perspective even asking the question "why should be scared of these so called elites" is so bizarre it's almost frightening, i'm sorry. It's a testament to the absurd amount of philanthropic whitewashing, PR and media control these billionaries hold. "Elites" have conspired to exploit the masses throughout 5000 years of civilisation, it's simply a fact of history. It's almost physically impossible to…

[dead]

Re: What we still don’t know about how A.I. is trained

#180

Post by ftxbro »

paxys wrote: post #32
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

The simpler reason is that OpenAI has $10B+ in funding and the clock has started ticking to get real returns. And they aren't getting those returns by giving their tech away. They are operating just like every other VC-backed startup in history.

I mean the conspiracy argument would be that the $10B isn't a normal investment. It's a special government project investment facilitated by OpenAI board member and former clandestine CIA operative and cybersecurity executive Will Hurd through his role on the board of trustees of In-Q-Tel the investment arm of the CIA. It's funneled through Microsoft instead of through Google in part because of Google's No-Military-AI pledge in 2018 demanded by its employees, after which Microsoft took over its military contracts including project Maven. The new special government project, the Sydney project, is the most urgent and ambitious since the project to develop nuclear weapons in the mid twentieth century.

Of course I don't necessarily believe any of that but it can be fun to think about.

Post reply on HN