John Carmack and Rich Sutton partner to accelerate development of AGI

Post by garblegarble » Sat, Oct 07, 2023, 12:35 PM UTC

JKCalhoun wrote: post #26

mark_l_watson wrote: post #13

Their focus is long running digital intelligences that interact with their environment over long periods of time. I enjoyed reading The Alberta Plan when it was released earlier this year https://arxiv.org/abs/2208.11173

Ethics/privacy aside ... I wondered the other day what the result would be if you strapped a microphone on a baby and every utterance that both the baby and mic heard was fed through speech-to-text and went toward training the baby's personal LLM . By the time the child had grown to an adult I wonder what kind of results their LLM would produce and the degree to which it might compare to what the child (now grown) wo…

Post by 4death4 » Sat, Oct 07, 2023, 12:40 PM UTC

volent wrote: post #28

JKCalhoun wrote: post #26

Earlier quoted context omitted.

Ethics/privacy aside ... I wondered the other day what the result would be if you strapped a microphone on a baby and every utterance that both the baby and mic heard was fed through speech-to-text and went toward training the baby's personal LLM . By the time the child had grown to an adult I wonder what kind of results their LLM would produce and the degree to which it might compare to what the child (now grown) wo…

I thought about this too. People say that LLM models are only saying the most common tokens that come after the previous token. And that this makes them incomparable to human intelligence. But Humans are basically long running LLMs that are retrained in real-time. We are the product of our environment.

Post by sillysaurusx » Sat, Oct 07, 2023, 12:46 PM UTC

HoDaMoFoDor wrote: post #31

sillysaurusx wrote: post #29

Earlier quoted context omitted.

I can’t go into specifics for obvious reasons, but I can tell you they’re a smart, capable crew, with lots of resources, and time is on their side. If I had to place bets on which lab will invent agi, they’d be near the top, precisely because they’re exploring ideas that others don’t seem to be focusing on. It’s the early stages, so it’ll take a few years to get to results. But they’re laser-focused. There are a bunc…

How do people apply? They don't seem to have much of a web presence.

Post by FrustratedMonky » Sat, Oct 07, 2023, 12:54 PM UTC

4death4 wrote: post #34

volent wrote: post #28

Earlier quoted context omitted.

I thought about this too. People say that LLM models are only saying the most common tokens that come after the previous token. And that this makes them incomparable to human intelligence. But Humans are basically long running LLMs that are retrained in real-time. We are the product of our environment.

What makes you think that? What we can LLMs are a specific architecture that literally does predict the next token, one at a time. This isn’t the only way to generate text. Perhaps humans use a method that synthesizes all the text at once. Or some other, unimaginable way.

Post by mkl » Sat, Oct 07, 2023, 12:56 PM UTC

otabdeveloper4 wrote: post #23

uh_uh wrote: post #7

Earlier quoted context omitted.

I mean, an ant has signs of life yet you wouldn't call it sentient.

Why not? You're using a very bizzare conception of "sentience".