John Carmack's new AGI company, Keen Technologies, has raised a $20M round • Hacker News Board

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#101

Post by jpambrun » Fri, Aug 19, 2022, 9:34 PM UTC

mellosouls wrote: post #87

I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…

Presumably you don't have to code in emotions and self awareness. Many people initially had the same reaction for single task AI/ML.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#102

Post by buu700 » Fri, Aug 19, 2022, 9:34 PM UTC

yazzku wrote: post #35

Andrew_nenakhov wrote: post #27

Earlier quoted context omitted.

They briefly considered the name "Doom technologies" before settling on Keen.

Guess the former wouldn't work very well for PR.

About a decade ago, a friend and I thought it would be fun to register a non-profit with a similar name. We'd listed the registered address as my friend's cousin's house, where he was renting a room at the time.

The friend moved out at some point. A year later, his cousin became rather concerned when he suddenly started receiving mail from the California Secretary of State that was addressed to The Legion of Doom.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#103

Post by Isinlor » Fri, Aug 19, 2022, 9:34 PM UTC

efficax wrote: post #41

gfodor wrote: post #40

Earlier quoted context omitted.

You have some catching up to do. Consensus is dropping to this lifetime for sure, if not this decade.

what consensus? i think most researchers remain skeptical

The survey [0], fielded in late 2019 (before GPT-3, Chinchilla, Flamingo, PaLM, Codex, Dall-E, Minerva etc.), elicited forecasts for near-term AI development milestones and high- or human-level machine intelligence, defined as when machines are able to accomplish every or almost every task humans are able to do currently. They sample 296 researchers who presented at two important AI/ML conferences ICML and NeurIPS. Results from their 2019 survey show that, in aggregate, AI/ML researchers surveyed placed a 50% likelihood of human-level machine intelligence being achieved by 2060. The results show researchers newly contacted in 2019 expressed similar beliefs about the progress of advanced AI as respondents in the Grace et al. (2018) survey.

[0] https://arxiv.org/abs/2206.04132

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#104

Post by wudangmonk » Fri, Aug 19, 2022, 9:34 PM UTC

mellosouls wrote: post #87

I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…

I sure hope this sentiment is not widely shared. Its debatable if its possible to safely contain AGI by itself. With self righteous people that think they are in the right its just hopeless. Isn't the road to hell paved with good intentions?.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#105

Post by Jensson » Fri, Aug 19, 2022, 9:35 PM UTC

gizajob wrote: post #68

blibble wrote: post #58

Earlier quoted context omitted.

> This is human-experience changing stuff. that's one way of putting it it will remove the need for the vast majority of the population, which will end extremely badly

But by the same token, there's no need for billions of humans now. AGI isn't really going to change that except for making work even more superfluous than it already is.

Currently the life of leaders gets better the more people they can control, since it creates a larger tax base. That means leaders tries to encourage population increase, they want more immigration, encourages people to multiply and sees population reduction as harmful.

With AGI that is no longer true, they can just replace most people with computers and automated combat drones while they keep a small number of personal servants to look after them. Currently most jobs either is there to support other humans or can be replaced by a computer, remove the need for humans and all of those jobs just disappear and leaders no longer care about having lots of people around.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#106

Post by nomel » Fri, Aug 19, 2022, 9:35 PM UTC

echelon wrote: post #19

haasted wrote: post #15

"AGI"?

Artificial General Intelligence. Machines as smart and capable of thought as we are and eventually smarter.

> Machines as smart and capable of thought as we are and eventually smarter.

This is perhaps an end goal of AGI, but not a definition of AGI. A relatively dumb AGI is how it will start, but it will still be an AGI.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#107

Post by laluser » Fri, Aug 19, 2022, 9:35 PM UTC

mellosouls wrote: post #87

I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…

Honestly, I can't tell if this is sarcasm or not.

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#108

Post by mooktakim » Fri, Aug 19, 2022, 9:35 PM UTC

mellosouls wrote: post #87

I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…

Artificial General Intelligence != sentient being

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#109

Post by newaccount2021 » Fri, Aug 19, 2022, 9:35 PM UTC

not sure why people are getting bent out of shape, $20 million is a modest raise, and he strikes me as the type to spend it wisely

Re: John Carmack's new AGI company, Keen Technologies, has raised a $20M round

#110

Post by paxys » Fri, Aug 19, 2022, 9:35 PM UTC

mellosouls wrote: post #87

I am not saying the intention here is the same, but the headline doesn't inspire confidence. There's something incredibly creepy and immoral about the rush to create then commercialise sentient beings. Let's not beat about the bush - we are basically talking slavery. Every "ethical" discussion on the matter has been about protecting humans, and none of it about protecting the beings we are in a rush to bring into lif…

Let's make a single iota of progress in the area first before discussing doomsday scenarios. There is no "slavery" because there are no artificial sentient beings. The concept doesn't exist, and as far as we know will never exist, no matter how many if-else branches we write. Heck we don't even know our own brains enough to define intelligence or sentience. The morality and ethics talks can wait another few hundred years.