Live data from Hacker News

What we still don’t know about how A.I. is trained

newyorker.com

61–70 of 211 posts

Re: What we still don’t know about how A.I. is trained

#61

Earlier quoted context omitted.

The article says trading Gpt4 cost 284 tons of CO2, which is, in the scheme of things, quite small. Yearly emissions for a person in the US is ~16 tons, so /training/ the giant model is equivalent to the emissions of less than twenty people in a country of 400 million. Sure, every bit counts, but this is laughable as a criticism.

Just for some more perspective, a 747 outputs 12,500 tons of CO2 per year. So training GPT4 is basically of no major CO2 concern, especially when you consider how much CO2 it saves. Saves in the sense that humans no longer have to do the work, GPT-4 can just spit it out in seconds so no need for lights, computers to run, food to be produced for the human to eat, etc.

Except of course, now everyone is going to be doing the same thing as OpenAI, pretty much every day, until forever? We'll want to keep throwing hardware at the problem until who knows when and what happens.

Re: What we still don’t know about how A.I. is trained

#62

Earlier quoted context omitted.

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

>bone chilling AI generated Metal Gear Solid 2 meme Wait, wasn't this just the thesis statement of Metal Gear Solid 2?

Yeah. I actually confused it for real dialogue at first.

Re: What we still don’t know about how A.I. is trained

#63
post #14

Earlier quoted context omitted.

> It's far more likely Would be interested to see your math and assumptions behind this conclusion. There’s no way that their plans to monetize this don’t include the defense/natsec industry

> There’s no way... Sorry but where's your maths for this?

[deleted]

Re: What we still don’t know about how A.I. is trained

#65
post #10

Earlier quoted context omitted.

It’s amazing how one can found a nonprofit with a goal of conducting “open” research and then end up publishing something like this a couple of years later. Greed is good I guess.

We're not publishing any details on the models for safety reasons! Also would be great if the government cracked down on our competitors because they don't care about safety like we do.

Genuinely can't tell if this is sarcasm or not..?

Re: What we still don’t know about how A.I. is trained

#67

Earlier quoted context omitted.

What is OpenAI is right and the risks are real? They likely already have some glimpses of GPT-5 internally. And GPT-4 is closely resembles AGI already.

That’s the excuse they’ll use when they convince the government to require a special license to buy powerful GPUs.

nvidia won't go for that.

Re: What we still don’t know about how A.I. is trained

#68
post #26

I feel like there is an emerging consensus that [Chat]GPT 3.5/4 is not just 1 big model. A large part of the magic in the final product appears to be many intermediate layers of classification that select the appropriate LLM/method to query. The cheaper models (e.g. Ada/Babbage) could be used for this purpose. Think about why offensive ChatGPT prompts are rejected so quickly compared to legitimate asks for code. Imag…

[deleted]

Re: What we still don’t know about how A.I. is trained

#69
post #4

Say I'm a conspiracy theorist but I'm calling it, that the pentagon isn't letting OpenAI tell the details of GPT-4 even if they wanted to (which they don't except for some of the researchers probably). National security, export restrictions, munitions classification, new Manhattan project etc. EDIT: I know that most people think it's unlikely and I can't give any direct evidence for it. Does that mean it's not welcom…

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

Yes, this is the real dark future right here.

It will be a continuation though.

The uppermost echelons of society have waged information warfare since the dawn of modern PR in the beginning of the 20'th century. Lots of theory on this have apparently been memoryholed, but it's easy to just start with the genealogy around Edward Bernais and the plutocracy and robber baron families still existing in the interwar period.

The masses don't really think about or realise that manufactured circus and foreverwars have been going on for a hundred years while a microscopic elite that controls the media and various organs in the state have been siphoning most wealth towards themselves in a increasingly dense cloud of smoke, while promoting rebranded ideologies for the genpop and systems of control that has become advanced cybernetic systems that steer the flow of information 100% from top to bottom.

The sad thing is that you could deduce this in the noise if you visited the last remnants of actual research journalism on the internet, but that will end now.

So where is one going to get to know the powerstructures of the world? Old physical libraries only, some dude on the corner, some "crazy guy" with a harddisk from before AI took over.

Re: What we still don’t know about how A.I. is trained

#70

Earlier quoted context omitted.

Just say what's on your mind and don't mind the votes. One thing you'll discover is that you're not alone in your views, whatever they are. Few days ago I came across this bone chilling AI generated Metal Gear Solid 2 meme with Hideo Kojima characters talking about how the purpose of this technology is to make it impossible to tell what's real or fake, leading directly to regulation of information networks with ident…

MGS2 and MGS4 explore ideas about AI, misinformation, the media, and society that are only now being discussed in the mainstream. The concept of an autonomous AGI that generates and filters news stories to provoke humanity into a state of constant division and war is fascinating and worth exploring IMO. Death Stranding also explores ideas of what it means to find connection in a disconnected world that I think are re…

Kojima is kind of prescient, he was talking about AI and fake news years before it became mainstream, and Death Stranding was scarily well-timed with COVID.
Post reply on HN