Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Training for one trillion parameter model backed by Intel and US govt has begun

techradar.com

Post reply on HN
Print view View original

141–150 of 267 posts

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#141

Post by nyc_data_geek1 »

AndrewKemendo wrote: post #132
munksbeer wrote: post #99

Earlier quoted context omitted.

The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.

Except governments don’t currently go do war on behalf of the citizens or for protection of the “homeland.” They go to war “overseas” on behalf of the corporations that employ citizens that vote certain ways, in order to maintain the current global structure of US political dominion. I know because I served as an officer in one of those wars on behalf of the United States (among other things that were also not benefi…

War Is A Racket, as Smedley Butler accurately wrote.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#142

Post by londons_explore »

stormfather wrote: post #90
londons_explore wrote: post #85

Earlier quoted context omitted.

At least initially, any AGI is likely to be limited by compute capacity. Ie. it might have greater-than-human intelligence, but is only able to make a certain number of decisions/actions per day. However, we have seen with other AI models that as soon as something useful is proved possible, we can expect rapid reductions in the amount of compute necessary to achieve the same.

Then the first thing the AGI will do is figure out ultra-high throughput analog computing for LLMs

An AGI will likely be scared of even more powerful AGI's that it itself cannot control.

It might take steps to try to prevent anyone building such a thing.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#143

Post by AndrewKemendo »

nyc_data_geek1 wrote: post #141
AndrewKemendo wrote: post #132

Earlier quoted context omitted.

Except governments don’t currently go do war on behalf of the citizens or for protection of the “homeland.” They go to war “overseas” on behalf of the corporations that employ citizens that vote certain ways, in order to maintain the current global structure of US political dominion. I know because I served as an officer in one of those wars on behalf of the United States (among other things that were also not benefi…

War Is A Racket, as Smedley Butler accurately wrote.

Precisely this

Link here too for everyone:

https://archive.org/details/WarIsARacket

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#144

Post by lazide »

dumbfoundded wrote: post #134
munksbeer wrote: post #99

Earlier quoted context omitted.

The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.

The difference between a government and a corporation is the ability to use violence. A government is just a corporation with a monopoly on violence (police, military, jails...). The structure of how people are organized is more significant. Are we talking about a dictatorship or a functioning democracy? Are we discussing a non-profit or a publicly listed company?

Do you think it would not become a dictatorship if a controllable AGI was developed at the gov’t level?

It probably wouldn’t be hard for whoever had the most direct control of it to have it start pushing buttons population wide.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#145

Post by jvanderbot »

munksbeer wrote: post #99
theropost wrote: post #58

Earlier quoted context omitted.

Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.

The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.

I think these "you can trust greed" arguments tend to short change all the benefits of government sponsored research. There's been a lot of good that's come of it.

Don't get me wrong, corps have brought good as well, but saying one is necessarily better than the other is just betraying political leanings more than providing sound arguments.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#146

Post by lazide »

Jensson wrote: post #138
nanis wrote: post #114

Earlier quoted context omitted.

> [The Queen] granted her charter to their corporation named Governor and Company of Merchants of London trading into the East Indies.[15] For a period of fifteen years, the charter awarded the company a monopoly[26] on English trade with all countries east of the Cape of Good Hope and west of the Straits of Magellan.[27] Any traders there without a licence from the company were liable to forfeiture of their ships an…

The government didn't tell them to kill or enslave people, they did that on their own since that was more profitable than not doing it. The government then stepped in and forced them to stop killing and enslaving, which made the world a better place, today we don't have many companies that kill or enslave thanks to governments.

Do you want someone to add up the gov’t direct death tolls so we can compare?

Just off the top of my head; holodomir, the Great Leap Forward, the holocaust, the Khmer Rouge are at least 10x the East India companies death toll. We should probably add in war casualties too - at a minimum WW1 and WW2. I think I could list off probably 10 more with about 5 more minutes of work.

People can be terrible. More direct power usually means more terrible.

Gov’ts usually have the most direct power.

East India company was an odd case because they were granted defacto delegated gov’t power over a region that was full of ‘others’.

Considering the factors involved, it’s amazing they weren’t worse. Like the French Congo [https://en.m.wikipedia.org/wiki/French_Congo].

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#147

Post by saberience »

Majromax wrote: post #41
jonplackett wrote: post #33

Earlier quoted context omitted.

Yeah I'm not totally convinced humans don't have a tremendous amount of training data - interacting with the world for years with constant input from all our senses and parental corrections. I bet if you add up that data it's a lot. But once we are partially trained, training more requires a lot less.

> I bet if you add up that data it's a lot. Let's Fermi estimate that. A 4k video stream is about 50 megabits/second. Let's say that humans have the equivalent of two of those going during waking hours, one for vision and one for everything else. Humans are awake for 18 hours/day, and we'll say a human's training is 'complete' at 25. Multiply that together, and you end up with 1.8e17 bytes, or 180 petabytes of data.…

So much of that data is totally useless though. Most of the data we get is visual and I would argue that visual data is some of the least useful data (with respect to volume). Think about the amount of time we're looking at blank colours with nothing to learn from. Once you've seen one wall, one chair, one table etc, there's not much left to know about those things. An encyclopedia though for example is much less data than a few hours of high res video of clouds passing by yet clearly its orders of magnitude information rich.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#149

Post by jonnycomputer »

dumbfoundded wrote: post #134
munksbeer wrote: post #99

Earlier quoted context omitted.

The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.

The difference between a government and a corporation is the ability to use violence. A government is just a corporation with a monopoly on violence (police, military, jails...). The structure of how people are organized is more significant. Are we talking about a dictatorship or a functioning democracy? Are we discussing a non-profit or a publicly listed company?

Companies have a long history of using violence, and of local officials looking the other way when they do.
Post reply on HN