Live data from Hacker News

Differentiable Logic Cellular Automata

google-research.github.io

61–70 of 100 posts

Re: Differentiable Logic Cellular Automata

#61

This writing feels so strongly LLM flavored. It's too bad, since I've really liked Alexander Mordvintsev's other work.

Yup i independently noticed passages with phrases and word choice mimicking llms. Certainly just used for assistance though, the writing is too good overall.

Re: Differentiable Logic Cellular Automata

#62

Can anybody point out what's special about this?

The impression I got, and I'd be happy to have someone help me improve this impression, is that it's a way to craft a CA that behaves the way you want as opposed to the traditional approach to studying CA's which involves tinkering with the rules and then seeing what behaviour emerges.

Re: Differentiable Logic Cellular Automata

#64
If I understand the article correctly, this research shows that you can compress some 2d image into a circuit design, that if replicated exactly many times in a grid, it will spontaneously output the desired image.

I'm interested in a nearby, but dissimilar project, almost it's reciprocal, wherein you can generate a logic design that is NOT uniform, but where every cell is independent, to allow for general purpose computing. It seems we could take this work, and use it to evolve a design that could be put into an FPGA, and make far better utilization than existing programming methods allow, at the cost of huge amounts of compute to do the training.

Re: Differentiable Logic Cellular Automata

#65

This is exciting. Michael Levin best posited for me the question of how animal cells can act cooperatively without a hierarchy. He has some biological experiments showing, for example, eye cells in a frog embryo will move to where the eye should go even if you pull it away. The question I don't think he could really answer was 'how do the cells know when to stop?' Understanding non-hierarchical organization is key to…

What are Cognitive Light Cones? (Michael Levin Interview)

https://www.youtube.com/watch?v=YnObwxJZpZc

Re: Differentiable Logic Cellular Automata

#66

Can anybody point out what's special about this?

The impression I got, and I'd be happy to have someone help me improve this impression, is that it's a way to craft a CA that behaves the way you want as opposed to the traditional approach to studying CA's which involves tinkering with the rules and then seeing what behaviour emerges.

That's what I think it is about, reverse engineering basic rules from the end pattern.

Re: Differentiable Logic Cellular Automata

#67

This is exciting. Michael Levin best posited for me the question of how animal cells can act cooperatively without a hierarchy. He has some biological experiments showing, for example, eye cells in a frog embryo will move to where the eye should go even if you pull it away. The question I don't think he could really answer was 'how do the cells know when to stop?' Understanding non-hierarchical organization is key to…

> The question I don't think he could really answer was 'how do the cells know when to stop?' I'm likely missing something obvious but I'll ask anyway out of curiosity. How is this not handled by the well understood chemical gradient mechanisms covered in introductory texts on this topic? Essentially cells orient themselves within multiple overlapping chemical gradients. Those gradients are constructed iteratively, e…

Textbook models typically simulate normal development of an embryo, e.g. A-P and D-V (anterior-posterior and dorsal-ventral) patterning. The question Levin raises is how a perturbed embryo manages to develop normally, both "picasso tadpoles" where a scrambled face will re-organize into a normal face, and tadpoles with eyes transplanted to their tails, where an optic nerve forms across from the tail to the brain and a functional eye develops.

I haven't thoroughly read all of Levin's papers, so I'm not sure to what extent they specifically address the issue of whether textbook models of morphogen gradients can or cannot account for these experiments. I'd guess that it is difficult to say conclusively. You might have to use one of the software packages for simulating multi-cellular development, regulatory logic, and morphogen gradients/diffusion, if you wanted to argue either "the textbook model can generate this behavior" or that the textbook model cannot.

The simulations/models that I'm familiar with are quite basic, relative to actual biology, e.g. models of drosophila eve stripes are based on a few dozen genes or less. But iiuc, our understanding of larval development and patterning of C Elegans is far behind that of drosophila (the fly embryo starts as a syncytium, unlike worms and vertebrates, which makes fly segmentation easier to follow). I haven't read about Xenopus (the frogs that Levin studies), but I'd guess that we are very far from being able to simulate all the way from embryo to facial development in the normal case, let alone the abnormal picasso and "eye on tail" tadpoles.

Re: Differentiable Logic Cellular Automata

#69

I wish we were all commenting about the ideas embedded in this paper. It intrigues me, but is out of my comfort zone. Love to read more content-related insights or criticisms rather than the long thread on the shamefully smooth, engaging, and occasionally rote style.

I was reminded immediately of Wolfram’s exploration of using cellular automata to get MNIST recognition results. The underlying mechanisms they both use are super different, but the ideas seem like strong siblings — I attach them in my mind as saying computational complexity is almost shockingly expressive, and finding ways to search around the space of computation is pretty powerful.

That said, I put in like 4 minutes skimming this paper, so my opinion is worth about the average of any Internet forum opinion on this topic.

Anyway, I suggest reading Wolfram as well on this, it’s pretty provocative.

Post reply on HN