Live data from Hacker News

Training for one trillion parameter model backed by Intel and US govt has begun

techradar.com

231–240 of 267 posts

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#231
post #214

Earlier quoted context omitted.

I agree but I don't think our adversaries should get a freebie that's trained on our scientific data at a national laboratory. Which makes me wonder. I'm not sure this applies here but say you train a model on classified information, is the model/weights then classified?

That’s like saying we should stop all education in America so that Chinese people don’t come in and steal our knowledge.

What? How? You can’t compare high school math to cutting edge AI work.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#232

Earlier quoted context omitted.

Then the first thing the AGI will do is figure out ultra-high throughput analog computing for LLMs

An AGI will likely be scared of even more powerful AGI's that it itself cannot control. It might take steps to try to prevent anyone building such a thing.

Assuming that an AGI will have human-like emotions is likely a mistake. They may very well experience something like emotions that resemble human emotions, but they may not. Or they could have an entirely different set of emotions that we don't recognize.

We simply don't know, just like we don't know what other species experience and can only guess at by observing their behavior and trying to map it back to what we know.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#233

Earlier quoted context omitted.

Yes, Governments have a monopoly on violence.

It’s not inconceivable that violence will be necessary to control AGI at some point.

One of the many ethical questions we should answer before even attempting to get closer to an AGI.

Once a digital intelligence is discovered, does it have rights? Can it be enslaved, controlled, or destroyed? If an AGI can't be granted similar rights as a human, why are corporations legally treated similarly to humans?

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#234

Earlier quoted context omitted.

Yes, Governments have a monopoly on violence.

I bet guns kill computers too.

And a stick can kill a bear. That doesn't mean its effective or the weapon you should choose if the situation for self defense arises.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#235

I'm sure the government's mission is also to develop an AGI that benefits us all.

Some forget that the primary mission of systems such as the government is to continue existing. Auxiliary functions come afterwards. I think AI could be turned into a very effective persuasion weapon. I think the government that does it first will gain more power as a result.

I'd argue the mission of systems such as the government is to continue to accrue power. Staying stationary is falling behind and the continued growth of power is a prerequisite for continuing to exist.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#236
post #177

Earlier quoted context omitted.

Facebook alone has reeked havoc on at least a few societies. Corporations also enable government actions by developing the tech and tools/weapons needed.

Facebook wreaked havoc, and they reek (stink).

Yes, thank you for the typo correction here. Sent that one too quickly and I did indeed mean "wreaked"

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#237
post #114

Earlier quoted context omitted.

> [The Queen] granted her charter to their corporation named Governor and Company of Merchants of London trading into the East Indies.[15] For a period of fifteen years, the charter awarded the company a monopoly[26] on English trade with all countries east of the Cape of Good Hope and west of the Straits of Magellan.[27] Any traders there without a licence from the company were liable to forfeiture of their ships an…

Monopoly is the natural state. Government is the only reason we have any alternatives.

Monopoly is the byproduct of allowing centralized power, not the natural state. I'm not actually sure how we could narrow down the natural state of humans at this point, but I strongly suspect it wouldn't be based on an assumption that people are willing to give up a growing list of individual freedoms in the name of fear.

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#238
post #21

It's not clear from the article whether it's a dense model or MoE. This matters when it comes to comparing with GPT-4 - in terms of # params - which is reported to be MoE

As far as I know, EVERY 1t+ LLM is a MoE. Switch-c-2048, Wi Dao 2.0, GLAM, Pangu-Σ, presumably GPT4. Am I missing any?

Re: Training for one trillion parameter model backed by Intel and US govt has begun

#239
post #165

Earlier quoted context omitted.

This is kind-of making the parent’s point. There are lots of private companies that have done very bad things, too many to even count, as bad as your examples and worse. And there are thousands upon thousands of sub-organizations of the US government, some of which do very good things and are definitely benevolent, because there is no built-in profit motive. Private companies almost cannot be benevolent and survive,…

>There are lots of private companies that have done very bad things, too many to even count, as bad as your examples and worse Absolutely not; there's no private company that's shot and bombed the life out of hundreds of thousands of innocent people in cold blood.

Of course there are private companies that have committed atrocities and attempted genocide. You haven’t taken any history classes? Your statement is false. The history of private corporate atrocities is hundreds, if not thousands of years old [1]. I don’t know what you’re referring to specifically, but a lot of what you attribute to the government is done by or with private military contractors and private weapons suppliers. Not to mention that wars in general are often driven by economic interests, fueled, justified, and supplied by private corporations.

In my comment above, I also had in mind industrial and environmental damage, unintentional death by private interests, environmental accidents and disasters, and coverups, which we can’t even count but the WHO estimates is in the tens of millions per year globally, today.

[1] https://core.ac.uk/download/pdf/214112224.pdf

Post reply on HN