Earlier quoted context omitted.
> GPT is far more useful a reasoning engine Hilarious to read this advice when GPT, by it's own designers, cannot reason.
It can’t reason - as in there no internal memory or intelligence in there. But you can ask it to generate a reasoning chain as part of its output. And then extract that output and do something else with that. That’s the reasoning it can perform. Look up the Sam Altman podcast with Lex. He specifically talks about reasoning engines.
I like to think of consciousness as not the substrate, but the information flowing through it. Not the H2O molecules in a river, but the current. We're like eddies and swirls in mountain streams, our thoughts are the patterns of flow, not the unmoving rocks that set them up.
In this sense, when an LLM like GPT produces output, it's like a loop that has been cut, a single pass through what would be a circular process in a human brain. It can take a fixed number of steps from a standing start, but no more. This is because there is information flowing through it, transformed step-by-step. It just doesn't recirculate, it always exits after a fixed number of steps.
Think of an unrolled for loop that always exits. It takes a few steps, which look like a loop, but can never actually iterate.