Live data from Hacker News

Why This AI Moment May Be the Real Deal

thenewatlantis.com

11–20 of 231 posts

Re: Why This AI Moment May Be the Real Deal

#11

What's a large language model doing when it's not being queried? Am I correct that they only compute information when dealing with a prompt? If so, that seems like a fundamental flaw. An actual "thinking machine" would be constantly running computations on its accumulated experience in order to improve its future output.

Hooking an LLM up to a loop would solve that.

Then you can find a way to include a described video feed and method of movement into the mix.

Re: Why This AI Moment May Be the Real Deal

#12

What's a large language model doing when it's not being queried? Am I correct that they only compute information when dealing with a prompt? If so, that seems like a fundamental flaw. An actual "thinking machine" would be constantly running computations on its accumulated experience in order to improve its future output.

Also, based on its continuous experience, it would be able to prompt you (send multiple messages in a row after not getting a response) or it should be able to wait for you to send multiple messages before responding.

Re: Why This AI Moment May Be the Real Deal

#13
post #8

This is the Real Deal, but not in away you would imagine. So far "nigerian email spam" was easy to recognize. Grammar mistakes, bad translation, very bad wording... But now every fringe group, can generate gigabytes of text and arguments that make sense! This is the end of debate, consensus and interactive communication, as we know it! Similar moment was in Africa in 1960, after they got AK45 and other cheap weapons.…

> So far "nigerian email spam" was easy to recognize. Grammar mistakes, bad translation, very bad wording... But now every fringe group, can generate gigabytes of text and arguments that make sense!

"nigerian email spam" contains grammar mistakes, bad translation, vary bad wording... by design. To weed out those unlikely to end up sending money.

I don't know how you can make an argument that makes sense about being chosen by royalty of a country to help them in some way.

Re: Why This AI Moment May Be the Real Deal

#14
post #7
post #2

> Study Deep Blue’s 1997 defeat of world chess champion Garry Kasparov, and your excitement about how quickly this technology would take over other cognitive work would wane as you learned just how much brute human force went into fine-tuning the software specifically to beat Kasparov. That was ~26 yeas ago. In the intervening 26 years humans have been curb-stomped so hard at chess that certain microwaves might be co…

When you have to manually input the scores for the various board positions, feels much less exciting.

Monumental progress is very rarely done in one giant step, but with many incremental improvements.

Re: Why This AI Moment May Be the Real Deal

#15
post #8

This is the Real Deal, but not in away you would imagine. So far "nigerian email spam" was easy to recognize. Grammar mistakes, bad translation, very bad wording... But now every fringe group, can generate gigabytes of text and arguments that make sense! This is the end of debate, consensus and interactive communication, as we know it! Similar moment was in Africa in 1960, after they got AK45 and other cheap weapons.…

> So far "nigerian email spam" was easy to recognize. Grammar mistakes, bad translation, very bad wording... But now every fringe group, can generate gigabytes of text and arguments that make sense! "nigerian email spam" contains grammar mistakes, bad translation, vary bad wording... by design. To weed out those unlikely to end up sending money. I don't know how you can make an argument that makes sense about being c…

[dead]

Re: Why This AI Moment May Be the Real Deal

#16

Earlier quoted context omitted.

> So far "nigerian email spam" was easy to recognize. Grammar mistakes, bad translation, very bad wording... But now every fringe group, can generate gigabytes of text and arguments that make sense! "nigerian email spam" contains grammar mistakes, bad translation, vary bad wording... by design. To weed out those unlikely to end up sending money. I don't know how you can make an argument that makes sense about being c…

[dead]

They've been replaced with fashion mistakes

Re: Why This AI Moment May Be the Real Deal

#17
post #9
post #6

Earlier quoted context omitted.

> Where on the S-shaped curve are we? Why do you think it's an S-shape? As you say, we're heading for a singularity!

Because exponentials will eventually break the laws of physics. For instance there is a relationship between information and energy, so a system processing an exponential amount of information will need an exponential amount of energy, which the universe will eventually run out of.

At this point we know very little and we have to leave it to the AIs to determine if physics has any limits.

Re: Why This AI Moment May Be the Real Deal

#18

What's a large language model doing when it's not being queried? Am I correct that they only compute information when dealing with a prompt? If so, that seems like a fundamental flaw. An actual "thinking machine" would be constantly running computations on its accumulated experience in order to improve its future output.

No, unfortunately it doesn't learn online. It forgets everything after each interaction. They can collect the data and retrain later, but the hard part is doing all the fine-tuning steps all over again and ensuring the new model has no regressions. GPT3.5 and 4 are years out of date, an unfortunate situation when generating code or asking about recent events.

And now they removed the search plugin, probably they got sued for copyright leaks from the search engine results into the generated text. Using copyrighted data in the prompt is not necessarily legal. So we have to deal with out-of-date AI that updates once every couple of years.

Re: Why This AI Moment May Be the Real Deal

#19
post #11

What's a large language model doing when it's not being queried? Am I correct that they only compute information when dealing with a prompt? If so, that seems like a fundamental flaw. An actual "thinking machine" would be constantly running computations on its accumulated experience in order to improve its future output.

Hooking an LLM up to a loop would solve that. Then you can find a way to include a described video feed and method of movement into the mix.

Not really, because it would hit a moment where it runs out of context. It can't really learn anything for now.

Re: Why This AI Moment May Be the Real Deal

#20

What's a large language model doing when it's not being queried? Am I correct that they only compute information when dealing with a prompt? If so, that seems like a fundamental flaw. An actual "thinking machine" would be constantly running computations on its accumulated experience in order to improve its future output.

Thank you.

This is one of the questions far too few people seem to be paying attention to.

"Thinking" in any way that we truly understand the term requires consciousness, and consciousness requires much more continuity than LLMs have. It would need continuity of input as well as continuity of learning in order to even be able to begin to approach something we might recognize as consciousness.

Post reply on HN