Can anybody point out what's special about this?
https://xkcd.com/676 but now much, much more efficient
Differentiable Logic Cellular Automata
41–50 of 100 posts
Re: Differentiable Logic Cellular Automata
#42There’s something compelling about these, especially w.r.t. their ability to generalize. But what is the vision here? What might these be able to do in the future? Or even philosophically speaking, what do these teach us about the world? We know a 1D cellular automata is Turing equivalent, so, at least from one perspective, NCA/these aren’t terribly suprising.
these are going to be the dominant lifeforms on earth exceeding bacteria, plants and humans in terms of energy consumption cellular automata that interact with their environment, ones that interact with low level systems and high level institutions. to some approximation we, humans are just individual cells interacting in these networks. the future of intelligence aint llms, but systems of automata with metabolic asp…
So grandiose. It's a good thing to rapture is happening when you're alive to see it. You're just that important.
Re: Differentiable Logic Cellular Automata
#43Earlier quoted context omitted.
these are going to be the dominant lifeforms on earth exceeding bacteria, plants and humans in terms of energy consumption cellular automata that interact with their environment, ones that interact with low level systems and high level institutions. to some approximation we, humans are just individual cells interacting in these networks. the future of intelligence aint llms, but systems of automata with metabolic asp…
So grandiose. It's a good thing to rapture is happening when you're alive to see it. You're just that important.
i wasn't around to see the first humans land on the moon. i feel a similar deep sense of awe and excitement to see this revolution
Re: Differentiable Logic Cellular Automata
#44> magine trying to reverse-engineer the complex, often unexpected patterns and behaviors that emerge from simple rules. This challenge has inspired researchers and enthusiasts that work with cellular automata for decades.
Can someone shed some light on what makes this a problem worth investigating for decades, if at all?
Re: Differentiable Logic Cellular Automata
#45> magine trying to reverse-engineer the complex, often unexpected patterns and behaviors that emerge from simple rules. This challenge has inspired researchers and enthusiasts that work with cellular automata for decades. Can someone shed some light on what makes this a problem worth investigating for decades, if at all?
yes, think of it this way:
why is it that bathing the Earth with 10^55 Boltzmann constants make it seemingly emit a Tesla?
can we construct a warm winter garment without having to manually pick open cotton poppies?
if we place energy in the right location, can we have slime mold do computation for us?
how do we organize matter and energy in order to watch a funny cat video?
Re: Differentiable Logic Cellular Automata
#46Loved this work! See some crazy cool implications. Ive always wondered, if CA's are a canidate for making the smallest solution to computer programming problems. Excitement: Id love to see a chatgpt running in hardware on a FPGA! that would be wild. If a method was found for training these types of models in real time would be amazing for industrial applications. Click button and it learns the problem and can take up…
You might be interested in https://www.emergent-misalignment.com/.
Possible improvement to Quixotic/Nepenthes? Also way harder to filter than word salad.
Re: Differentiable Logic Cellular Automata
#47This is exciting. Michael Levin best posited for me the question of how animal cells can act cooperatively without a hierarchy. He has some biological experiments showing, for example, eye cells in a frog embryo will move to where the eye should go even if you pull it away. The question I don't think he could really answer was 'how do the cells know when to stop?' Understanding non-hierarchical organization is key to…
> The question I don't think he could really answer was 'how do the cells know when to stop?'
I'm likely missing something obvious but I'll ask anyway out of curiosity. How is this not handled by the well understood chemical gradient mechanisms covered in introductory texts on this topic? Essentially cells orient themselves within multiple overlapping chemical gradients. Those gradients are constructed iteratively, exhibiting increasingly complex spatial behavior at each iteration.
Re: Differentiable Logic Cellular Automata
#48Self-plug here, but very related => Robustness and the Halting Problem for Multicellular Artificial Ontogeny (2011)
Cellular automata where the update rule is a perceptron coupled with a isotropic diffusion. The weights of the neural network are optimized so that the cellular automata can draw a picture, with self-healing (ie. rebuild the picture when perturbed).
Back then, auto-differentiation was not as accessible as it is now, so the weights where optimized with an Evolution Strategy. Of course, using gradient descent is likely to be way better.
Re: Differentiable Logic Cellular Automata
#49Re: Differentiable Logic Cellular Automata
#50Wouldn’t you need a custom non-von-Neuman architecture to leverage the full power of CA?