Earlier quoted context omitted.
Governments are reasonably good at controlling humans.
Yes, Governments have a monopoly on violence.
It’s not inconceivable that violence will be necessary to control AGI at some point.
Training for one trillion parameter model backed by Intel and US govt has begun
101–110 of 267 posts
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#102I'm sure the government's mission is also to develop an AGI that benefits us all.
This is a particular interesting part of American culture: The sentiment is that it is problematic when the government develops these technologies, but it is completely OK to let private entities develop them.
There's only one US Government and we know it did fairly bad things.
There are many private entities, although often not benevolent, most still have space for the benefit of doubt. OpenAI, DeepMind or Anthropic haven't done anything that compares to, say, MKUltra or lying about Iraqi WMDs to start decade long wars.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#103Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
Governments have killed more people than any other institution. Corporations have largely made our lives better.
Uhm the east indian company has an estimated death toll in the dozens of million people? [1]
[1] https://en.m.wikipedia.org/wiki/Timeline_of_major_famines_in...
The company was only nationalised in 1858 and until then effectively colonised india until then
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#104Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
Governments have killed more people than any other institution. Corporations have largely made our lives better.
Off the top of my head, dutch and british corporation colonize a lot of lands for hundreds of years. I don't think they left the place much better than when they came.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#105Earlier quoted context omitted.
Was thinking the same, so 1T might bring you to the league of GPT-4. Actually in the best case, since it seems that meta, google, openai and so on have the most talent. Anyway, to bring it to the next level, how big should it be? Maybe 10T? 100T?
> Maybe 10T? 100T? I don't think we have enough training data to train models so big in a way to efficiently use all the params. We would need to generate training data, but then I don't know how effective it would be.
Have seen an interview with someone from openai. At least they claimed, that they are far away from running out of data and they are able to generate data if needed.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#106I'm sure the government's mission is also to develop an AGI that benefits us all.
This is a particular interesting part of American culture: The sentiment is that it is problematic when the government develops these technologies, but it is completely OK to let private entities develop them.
Yeah because the government already has an enormous power that no private entities have, the monopoly on violence. They have enough power.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#107Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
Governments have killed more people than any other institution. Corporations have largely made our lives better.
Both governments and corporations have generally made our lives better.
Both governments and corporations kill people (look up annual tobacco deaths, for just one fun example).
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#108I'm sure the government's mission is also to develop an AGI that benefits us all.
I am not too keen on the US Government being in command of an AGI, but there is only one other entity capable of developing an AGI before the US Government. And I'm less keen on it being the one to control it.
>there is only one other entity capable of developing an AGI before the US Government.
Microsoft?
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#109Earlier quoted context omitted.
Yeah I'm not totally convinced humans don't have a tremendous amount of training data - interacting with the world for years with constant input from all our senses and parental corrections. I bet if you add up that data it's a lot. But once we are partially trained, training more requires a lot less.
> I bet if you add up that data it's a lot. Let's Fermi estimate that. A 4k video stream is about 50 megabits/second. Let's say that humans have the equivalent of two of those going during waking hours, one for vision and one for everything else. Humans are awake for 18 hours/day, and we'll say a human's training is 'complete' at 25. Multiply that together, and you end up with 1.8e17 bytes, or 180 petabytes of data.…
Children are awake 12 hours per day, a 90 minute movie used to fit on a CD-ROM, 8 700MB CD-ROMs times 365 is 2TB per year. Alexander the Great became king aged 20, he seemed trained enough by then, so that's 400TB, 4e14 bytes of data.
Pretty unconvinced by this argument, it mostly hinges on the video stream size.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#110Earlier quoted context omitted.
> you had biplanes; then you had triplanes. You could have followed that farther, and added more wings - but it wouldn't have improved things. But people did try! https://en.wikipedia.org/wiki/Besson_H-5 https://en.wikipedia.org/wiki/Multiplane_(aeronautics)#Quadr...
Why stop here? This engineer experimented with 20 wings and more: https://en.wikipedia.org/wiki/Horatio_Frederick_Phillips
Should've kept going.