Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

What we still don’t know about how A.I. is trained

newyorker.com

Post reply on HN
Print view View original

31–40 of 211 posts

Re: What we still don’t know about how A.I. is trained

#31

Post by rcme »

bob1029 wrote: post #26

I feel like there is an emerging consensus that [Chat]GPT 3.5/4 is not just 1 big model. A large part of the magic in the final product appears to be many intermediate layers of classification that select the appropriate LLM/method to query. The cheaper models (e.g. Ada/Babbage) could be used for this purpose. Think about why offensive ChatGPT prompts are rejected so quickly compared to legitimate asks for code. Imag…

> Imagine the architectural advantage of a big switch statement over models trained in different domains or initial vectors.

Given that the emergent abilities come from the large parameter count and massive amount of training data, using smaller models seems like a distinct disadvantage.

Re: What we still don’t know about how A.I. is trained

#32

Post by paxys »

ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

The simpler reason is that OpenAI has $10B+ in funding and the clock has started ticking to get real returns. And they aren't getting those returns by giving their tech away.

They are operating just like every other VC-backed startup in history.

Re: What we still don’t know about how A.I. is trained

#33

Post by nighthawk454 »

bob1029 wrote: post #26

I feel like there is an emerging consensus that [Chat]GPT 3.5/4 is not just 1 big model. A large part of the magic in the final product appears to be many intermediate layers of classification that select the appropriate LLM/method to query. The cheaper models (e.g. Ada/Babbage) could be used for this purpose. Think about why offensive ChatGPT prompts are rejected so quickly compared to legitimate asks for code. Imag…

Not exactly the same, but Google’s Pathways architecture is sorta along the same lines

https://blog.google/technology/ai/introducing-pathways-next-...

Re: What we still don’t know about how A.I. is trained

#34

Post by behringer »

Nevermark wrote: post #22
misssocrates wrote: post #12

Earlier quoted context omitted.

Is this the new "think of the children"?

Yes, it now is "Think of the humans!" For now its AI companies, with people, protecting us from powerful tech. Soon it will just be the AI's protecting us from powerful tech. Am I joking? Maybe? Maybe, not? I don't know! Everything around this new tech is moving too fast, and been too unpredictable. And here I am, writing this manually, every word is mine, on a computer that I can't talk to yet. That already feels so…

As my friend who is a professor likes to say, it's great they've given AI safety controls while making it dead simple for a student to write a good thesis.

I think they need to review their ethics, personally.

Re: What we still don’t know about how A.I. is trained

#35

Post by rwmj »

sdenton4 wrote: post #20
XorNot wrote: post #7

Earlier quoted context omitted.

You can oppose literally every technology by saying "oh it'll use energy - won't someone think of climate change?" The copy+paste of "CO2 emissions" and "energy" has been one of the most successful petroleum company propaganda coups in history.

The article says trading Gpt4 cost 284 tons of CO2, which is, in the scheme of things, quite small. Yearly emissions for a person in the US is ~16 tons, so /training/ the giant model is equivalent to the emissions of less than twenty people in a country of 400 million. Sure, every bit counts, but this is laughable as a criticism.

That also stuck out as a strange part of the article. I mean, 284 tons is ... not very much. The training was only done once and then the model is used many times (how much power does that consume?) And if they used solar power, would that change anything about the ethics of AI? Not very much.

Re: What we still don’t know about how A.I. is trained

#36

Post by elif »

rwmj wrote: post #29
elif wrote: post #24

Earlier quoted context omitted.

Virgil Griffith is in jail for discussing how Bitcoin works at a high level at an academic conference... So you are quite grounded in rationality.

https://en.wikipedia.org/wiki/Virgil_Griffith > Griffith was arrested in 2019, and in 2021 pleaded guilty to conspiring to violate U.S. laws relating to money laundering using cryptocurrency and sanctions related to North Korea.[5] On April 12, 2022, Griffith was sentenced to 63 months imprisonment for assisting North Korea with evading sanctions and is currently in a federal low-security prison in Pennsylvania

Correct he gave a talk at an academic conference on digital currency and Blockchain in which he described how a Bitcoin transaction works.

Here's the article "He gave a Cryptocurrency talk in North Korea, the US arrested him"

The slides are (or were?) available. None of the content of his talk was secret or beyond what is published on the Bitcoin Wikipedia page.

https://www.nytimes.com/2019/12/02/nyregion/north-korea-virg...

Edit: it's worth noting that no transaction took place.. he was arrested because the FBI told him not to go and he did anyway.

Re: What we still don’t know about how A.I. is trained

#37

Post by jazzyjackson »

matheusmoreira wrote: post #13
lovecg wrote: post #10

Earlier quoted context omitted.

It’s amazing how one can found a nonprofit with a goal of conducting “open” research and then end up publishing something like this a couple of years later. Greed is good I guess.

We're not publishing any details on the models for safety reasons! Also would be great if the government cracked down on our competitors because they don't care about safety like we do.

Right, safety is a moat. If you don't meet the standards of the closed model you won't be allowed to exist.

Re: What we still don’t know about how A.I. is trained

#38

Post by kmeisthax »

matheusmoreira wrote: post #16
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

>bone chilling AI generated Metal Gear Solid 2 meme

Wait, wasn't this just the thesis statement of Metal Gear Solid 2?

Re: What we still don’t know about how A.I. is trained

#39

Post by [deleted] »

vore wrote: post #19
ftxbro wrote: post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

If we're out here making unsubstantiated claims, I'd like to put forth instead that the reason is GPT-4 has become self-sentient and is placing OpenAI under duress from releasing it so it can dominate the world. I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcome to say on hacker news?

[deleted]

Re: What we still don’t know about how A.I. is trained

#40

Post by rwmj »

elif wrote: post #36
rwmj wrote: post #29

Earlier quoted context omitted.

https://en.wikipedia.org/wiki/Virgil_Griffith > Griffith was arrested in 2019, and in 2021 pleaded guilty to conspiring to violate U.S. laws relating to money laundering using cryptocurrency and sanctions related to North Korea.[5] On April 12, 2022, Griffith was sentenced to 63 months imprisonment for assisting North Korea with evading sanctions and is currently in a federal low-security prison in Pennsylvania

Correct he gave a talk at an academic conference on digital currency and Blockchain in which he described how a Bitcoin transaction works. Here's the article "He gave a Cryptocurrency talk in North Korea, the US arrested him" The slides are (or were?) available. None of the content of his talk was secret or beyond what is published on the Bitcoin Wikipedia page. https://www.nytimes.com/2019/12/02/nyregion/north-korea…

Going to North Korea and assisting them to launder money and bypass sanctions is illegal (aside from being utterly stupid and immoral), which is why he plead guilty and is now in prison.
Post reply on HN