I don't believe it's a fair comparison... modern CPUs can run, by definition, a pretty basic range of operations, and every intent has to be encoded in a extremely complex sequence of commands. Given a certain CPU architecture and a certain algorithm to implement, someone might be able to properly infer the expected size of a compiled binary. But, by pushing the concept to the absurd, one day we might build a super-s…
DDwarf Fortress Defies Materialism
21–29 of 29 posts
Re: DDwarf Fortress Defies Materialism
#22Obviously the author has completely misunderstood what is meant by "parameters" in this context. The parameters here are those of a neural network and thus they are a result of, not a precondition for the learning process. Instead, he should strictly use the implementation of the neural network for comparison, whose uncompressed human-readable size is probably going to be almost small enough to fill into his size constraints.
And that is assuming there is not a sufficiently good algorithm for learning animal behaviors that is much simpler than CNNs.
Re: DDwarf Fortress Defies Materialism
#23Kind of strange that there's no mention of actual behavioral genomics research here. Aside from the quip that: > Scientists have found some genetic code that contributes to hereditary behaviors, but the bulk of it is unlikely to ever be found. Why? Because it plainly does not fit. This is plainly not true. We've found lots of evidence for the genomic basis of hereditary behaviors. See Genome-wide Complex Trait Analys…
Re: DDwarf Fortress Defies Materialism
#24Barricelli was running experiments about digital organisms back in the early 50's right before the identification of the structure of DNA. Quite literally sharing time with atomic/hydrogen bomb calculations. I find it a bit tough to press onwards when sweeping statements like the above are made as a build up to the argument.
Re: DDwarf Fortress Defies Materialism
#25> Even when behavior is mostly learned rather than hard-coded, the ability to learn itself must be hard-coded. Such code occupies hundreds of megabytes of data. Consider the first generation of software for self-driving cars. NVIDIA’s deep-learning drivers for self driving cars utilize “27 million connections and 250 thousand parameters.”5 Good programmers try to restrict their functions to no more than 6 parameters…
Re: DDwarf Fortress Defies Materialism
#26Each step of this compression is incredibly lossy and insanely tweaked towards good enough outcome.
Re: DDwarf Fortress Defies Materialism
#27What's vastly different between software instructions in dwarf fortress vs DNA is what actually computes the code. There is a negligible amount of complexity in made-made computers vs what goes on in a cell. There are layers upon layers of complexity that goes from genotype to phenotype. I am a bioinformatician with a genetics background. I've always had this abstract overview of DNA as a highly compressed dataset an…
Re: DDwarf Fortress Defies Materialism
#28Re: DDwarf Fortress Defies Materialism
#29What's vastly different between software instructions in dwarf fortress vs DNA is what actually computes the code. There is a negligible amount of complexity in made-made computers vs what goes on in a cell. There are layers upon layers of complexity that goes from genotype to phenotype. I am a bioinformatician with a genetics background. I've always had this abstract overview of DNA as a highly compressed dataset an…