Live data from Hacker News

AGI is Mathematically Impossible 2: When Entropy Returns

philarchive.org

321–330 of 437 posts

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#321
post #95

Earlier quoted context omitted.

>but obviously, there seems to be more than that. I don't see how that's obvious. I'm not trying to be argumentative here, but it seems like these arguments always come down to a qualia, or the insistence that humans have some sort of 'spark' that machines don't have, therefore: AGI is not possible since machines don't have it. I also don't understand the argument that "Your nuanced, subtly ironic and self referentia…

Consciousness is an issue. If you write a program to add 2+2, you probably do not believe some entity poofs into existence, perceives itself as independently adding 2+2, and then poofs out of existence. Yet somehow, the idea of an emergent consciousness is that if you instead get it to do 100 basic operations, or perhaps 2^100 then suddenly this becomes true? The reason one might believe this is not because it's logi…

My issue is that from a scientific point of view, physicalism is all we have. Everything else is belief, or some form of faith.

Your example about relativity is good. It might have sounded insane at some point, but it turns out, it is physics, which nicely falls into the physicalism concept.

If there is a falsifiable scientific theory that there is something other than a physical mechanism behind consciousness and intelligence, I haven't seen it.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#322
post #312

Earlier quoted context omitted.

Yes, because they aren't. Against your fantasy that some might be brought into existence sometime in the future I present my own fantasy that there won't be.

I linked you an experiment with multiple autonomous agents operating continuously. It's already happened. It's really not clear what you're disagreeing with here.

No, that was a simulation, akin to Conway's cellular automata. You seem to consider being fully under someone else's control to qualify as autonomy, at least in certain casees, which to me comes across as very bizarre.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#323

Earlier quoted context omitted.

It's just a typical crackpot paper like those math enthusiasts who self-claimed to prove Goldbach's conjecture or disprove special relativity. If it's not obvious enough, see the author's comment here: https://news.ycombinator.com/item?id=44350876 This post proves an interesting theory though: even the most random thing can get traction on HN as long as it mentions AI.

A lot of people see a title that is "subject I want to discuss" and jump to the comment section without even bothering to look at the link. There has been a lot AI hype, so counter-hypists are starved from content and just jumped on the first "confirmation bias title" they could find. Thank you for the comment, "typical crackpot" feels a bit light considering how unhinged that is.

What's wrong with that? Most likely, the discussion coming from various people has more value than any single article, unless it's something truly phenomenal.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#324

Earlier quoted context omitted.

> That whole point implies that the situation is different in our brains. The situation is different in our brains, and we don't need to know how exactly human thinking works to acknowledge that...we know humans can infer meaning from language other than the statistical relationship between words.

> and we don't need to know how exactly human thinking works to acknowledge that. Until you know how thinking works in humans, you can't say something else is different. We've got the same inputs available that we can provide to AI models. Saying we don't form our thinking based on statistics on those inputs and the state of the brain is a massive claim on its own.

> Until you know how thinking works in humans, you can't say something else is different.

Yes, I very much can, because I can observe outcomes. Humans are a) alot more capable than language models, and b) humans do not rely solely on the statistical relationships of language tokens.

How can I show that? Easily in fact: Language tokens require organized language.

And our evolutionary closest relatives (big apes) don't rely on organized speech, and they are able of advanced cognition (planning, episodic memory, theory of the mind, theory of self, ...). The same is true for other living beings, even vertebrates that are not closely related with us, like Corvidae, and even some invertebrates like Cephalopods.

So unless you can show that our brains are somehow more closely related to silicon-based integrated circuits than they are to those of a Gorilla, Raven or Octopus, my point stands.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#325
post #284

Earlier quoted context omitted.

You’re flipping the logic. I’m not assuming humans are beyond Turing-computable and then using that to prove that AGI can’t be. I’m saying: here is a provable formal limit for algorithmic systems ->symbolic containment. That’s theorem-level logic. Then I look at real-world examples (Einstein is just one) where new symbols, concepts, and transformation rules appear that were not derivable within the predecessor frame.…

No, I'm not flipping the logic. > I’m not assuming humans are beyond Turing-computable and then using that to prove that AGI can’t be. I’m saying: here is a provable formal limit for algorithmic systems ->symbolic containment. That’s theorem-level logic. Any such "proof" is irrelevant unless you can prove that humans can exceed the Turing computable. If humans can't exceed the Turing computable, then any "proof" that…

You’re misreading what I’m doing, and I suspect you’re also misdefining what a “proof” in this space needs to be.

I’m not assuming humans exceed the Turing computable. I’m not using human behavior as a proof of AGI’s impossibility. I’m doing something much more modest - and much more rigorous.

Here’s the actual chain:

1. There’s a formal boundary for algorithmic systems. It’s called symbolic containment. A system defined by a finite symbol set Σ and rule set R cannot generate a successor frame (Σ′, R′) where Σ′ introduces novel symbols not contained in Σ. This is not philosophy — this is structural containment, and it is provable.

2. Then I observe: in human intellectual history, we find recurring examples of frame expansion. Not optimization, not interpolation — expansion. New primitives. New rules. Special relativity didn’t emerge from Newton through deduction. It required symbols and structures that couldn’t be formed inside the original frame.

3. That’s not “proof” that humans exceed the Turing computable. That’s empirical evidence that human cognition appears to do something algorithmic systems, as formally defined, cannot do.

4. This leads to a conclusion: if AGI is an algorithmic system (finite symbols, finite rules, formal inference)then it will not be capable of frame jumps.And it is not incapable of that, because it lacks compute. The system is structurally bounded by what it is.

So your complaint that I “haven’t proven humans exceed Turing” is misplaced. I didn’t claim to. You’re asking me to prove something that I simply don’t need to assert .

I’m saying: algorithmic systems can’t do X (provable), and humans appear to do X (observed). Therefore, if humans are purely algorithmic, something’s missing in our understanding of how those systems operate. And if AGI remains within the current algorithmic paradigm, it will not do X. That’s what I’ve shown.

You can still believe humans are Turing machines, fine for me. But if this belief is to be more than some kind of religious statement, then it is you that would need to explain how a Turing machine bounded to Σ can generate Σ′ with Σ′ \ Σ ≠ ∅. It is you that would need to show how uncomputable concepts emerge from computable substrates without violating containment (->andthat means: witout violating its own logic - as in formal systems, logic and containment end up as the same thing: Your symbol set defines your expressive space, step outside that, and you’re no longer reasoning — you’re redefining the space, the universe you’re reasoning in).

Otherwise, the limitation stands — and the claim that “AGI can do anything humans do” remains an ungrounded leap of faith.

Also: if you believe the only valid proof of AGI impossibility must rest on metaphysical redefinition of humanity as “super-Turing,” then you’ve set an artificial constraint that ensures no such proof could ever exist, no matter the logic.

That’s intellectually trading epistemic rigor for insulation.

As for your claim that I misunderstand Turing machines, please feel free to show precisely which part fails. The statement that a TM cannot emit symbols not present in its alphabet is not a misunderstanding — it’s the foundation of how TMs are defined. If you think otherwise, then I would politely suggest you review the formal modl again.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#326
post #303

Earlier quoted context omitted.

Function != Computable Function / general recursive function. That's my point - computable functions are a [vanishingly] small subset of all functions. For example (and close to our hearts!), the Halting Problem. There is a function from valid programs to halt/not-halt. This is clearly a function, as it has a well defined domain and co-domain, and produces the same output for the same input. However it is not computa…

Non-computable functions are not relevant to this discussion, though, because humans can't compute them either, and so inherently an AGI need not be able to compute them. The point remains that we know of no function that is computable to humans that is not in the Turing computable / general recursive function / lambda calculus set, and absent any indication that any such function is even possible, much less an examp…

[dead]

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#327
post #284

Earlier quoted context omitted.

No, I'm not flipping the logic. > I’m not assuming humans are beyond Turing-computable and then using that to prove that AGI can’t be. I’m saying: here is a provable formal limit for algorithmic systems ->symbolic containment. That’s theorem-level logic. Any such "proof" is irrelevant unless you can prove that humans can exceed the Turing computable. If humans can't exceed the Turing computable, then any "proof" that…

You’re misreading what I’m doing, and I suspect you’re also misdefining what a “proof” in this space needs to be. I’m not assuming humans exceed the Turing computable. I’m not using human behavior as a proof of AGI’s impossibility. I’m doing something much more modest - and much more rigorous. Here’s the actual chain: 1. There’s a formal boundary for algorithmic systems. It’s called symbolic containment. A system def…

There's nothing rigorous about this. It's pure crackpottery.

As long as you claim to disprove AGI, it inherently follows that you need to prove that humans exceed the Turing computable to succeed. Since you specifically state that you are not trying to prove that humans exceed the Turing computable, you're demonstrating a fundamental lack of understanding of the problem.

> 3. That’s not “proof” that humans exceed the Turing computable. That’s empirical evidence that human cognition appears to do something algorithmic systems, as formally defined, cannot do.

This is only true if humans execeed the Turing computable, as otherwise humans are proof that this is something that an algorithmic system can do. So despite claiming that you're not trying to prove that humans execeed the Turing computable, you are making the claim that humans can.

> I’m saying: algorithmic systems can’t do X (provable), and humans appear to do X (observed).

This is a direct statement that you claim that humans are observed to exceed the Turing computable.

> then it is you that would need to explain how a Turing machine bounded to Σ can generate Σ′ with Σ′ \ Σ ≠ ∅

This is fundamental to Turing equivalence. If there exist any Turing machine that can generate Σ′, then any Turing machine can generate Σ′.

Anything that is possible with any Turing machine, in fact, is possible with a machine with as few as 2 symbols (the smallest (2,3) Turing machine is usually 2 states and 3 symbols, but per Shannon you can always trade states for symbols, and so a (3,2) Turing machine is also possible). This is because you can always simulate an environment where a larger alphabet is encoded with multiple symbols.

> As for your claim that I misunderstand Turing machines, please feel free to show precisely which part fails. The statement that a TM cannot emit symbols not present in its alphabet is not a misunderstanding — it’s the foundation of how TMs are defined. If you think otherwise, then I would politely suggest you review the formal modl again.

This is exactly the part that fails.

Any TM can simulate any other, and that by extension, any TM can be extended to any alphabet through simulation.

If you don't understand this, then you don't understand the very basics of Turing Machines.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#328
post #303

Earlier quoted context omitted.

Non-computable functions are not relevant to this discussion, though, because humans can't compute them either, and so inherently an AGI need not be able to compute them. The point remains that we know of no function that is computable to humans that is not in the Turing computable / general recursive function / lambda calculus set, and absent any indication that any such function is even possible, much less an examp…

Humans do a lot of stuff that is hard to 'functionalise', computable or otherwise, so I'd say the burden of proof is on you. What's the function for creating a work of art? Or driving a car?

You clearly don't understand what a function means in this context, as the word function is not used in this thread in the way you appear to think it is used.

For starters, to have any hope of having a productive discussion on this subject, you need to understand what "function" mean in the context of the Church-Turing thesis (a function on the natural numbers can be calculated by an effective method if and only if it is computable by a Turing machine -- note that not just "function" has a very specific meaning there, but also "effective method" does not mean what you're likely to read into it).

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#329

Earlier quoted context omitted.

https://philpeople.org/profiles/max-m-schlereth Crackpot.

i.e., IDC - information-free_comment. Thankfully comments on HN are mostly not in this category. You may well be correct but it would interesting to see where in your reading you made this decision.

This is a very useful comment. It shows this person is supposedly a doctorate in "Social and Economic Sciences", not in mathematics, physics or engineering.

Re: AGI is Mathematically Impossible 2: When Entropy Returns

#330

If AGI is mathematically impossible, wouldn't that have a side effect of disproving materialist explanations for consciousness (i.e. the mind body problem)?

Seems like it but I’m not sure consciousness necessarily comes along for the ride with AGI.
Post reply on HN