Cool! Purpose built, trained in science related content.
As a US taxpayer and as a Libertarian, I approve of this project!
Training for one trillion parameter model backed by Intel and US govt has begun
111–120 of 267 posts
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#112Earlier quoted context omitted.
> Maybe 10T? 100T? I don't think we have enough training data to train models so big in a way to efficiently use all the params. We would need to generate training data, but then I don't know how effective it would be.
Have seen an interview with someone from openai. At least they claimed, that they are far away from running out of data and they are able to generate data if needed.
> they are able to generate data if needed.
If they can generate data they should use that instead of piping it through a million-dollar lossy compressor.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#113Isn't GPT-4 already over 1T parameters? And GPT-5 should be even "an order of magnitude" bigger than GPT-4...
Was it ever confirmed whether GPT-4 is a Mixture of Experts or not?
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#114Earlier quoted context omitted.
Governments have killed more people than any other institution. Corporations have largely made our lives better.
Uhm the east indian company has an estimated death toll in the dozens of million people? [1] [1] https://en.m.wikipedia.org/wiki/Timeline_of_major_famines_in... The company was only nationalised in 1858 and until then effectively colonised india until then
> [The Queen] granted her charter to their corporation named Governor and Company of Merchants of London trading into the East Indies.[15] For a period of fifteen years, the charter awarded the company a monopoly[26] on English trade with all countries east of the Cape of Good Hope and west of the Straits of Magellan.[27] Any traders there without a licence from the company were liable to forfeiture of their ships and cargo (half of which would go to the Crown and half to the company), as well as imprisonment at the "royal pleasure".[28]
Government granted monopoly.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#115Earlier quoted context omitted.
Governments have killed more people than any other institution. Corporations have largely made our lives better.
Uhm the east indian company has an estimated death toll in the dozens of million people? [1] [1] https://en.m.wikipedia.org/wiki/Timeline_of_major_famines_in... The company was only nationalised in 1858 and until then effectively colonised india until then
Dozens of millions of dead people is chump change to any empire.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#116Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.
I'm sure Peter Thiel has no power motive!
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#117Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
The opposite for me. Corporation have naked greed as their driving motivation, but that usually doesn't involve killing off all of their customers. That would be quite unprofitable. People elected to government often seem to seek power for powers sake and I have less faith that they'll not harm us.
Such as when energy companies buried research about climate change...?
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#118I'm sure the government's mission is also to develop an AGI that benefits us all.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
For everyone who responds to this question, thinking they're right, please look back and try to find the reason or reasons as to why you pick a government vs corporation. You'll realize you yourself are not making this decision. The number of news stories that have been pushed in front of you, or talking points from people you value as smart or worthy of listening to, all fabricate your reactions and who you consider yourself to be.
It's not only this one, but all of your opinions are dependent on cases from the past that you've been trained on.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#119I'm sure the government's mission is also to develop an AGI that benefits us all.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
Depends on the government. If it’s one that’s reasonably answerable to the public, then that may be preferable to a multinational corp. But if it’s an inherently authoritarian govt with a track record of human rights abuse and oppression, then the corp is probably the lesser evil.
Re: Training for one trillion parameter model backed by Intel and US govt has begun
#120Earlier quoted context omitted.
Ideally no one person or entity controls such a thing. But, would I rather have a Government, or a corporation control AGI? If I had to pick one of two evils, the Government would be the lesser of the two.
Has a corporation ever tried to commit genocide?
Corporations participated in genocide yes.
Here's a list of corporations who profited from the holocaust in various ways.
https://en.m.wikipedia.org/wiki/List_of_companies_involved_i...