Every installation of this program needs to come with a statistician to stand over your shoulder and hit you with a ruler and shout "That's data mining, not a controlled experiment! No causality for you!"
No causality for you!
11–16 of 16 posts
Every installation of this program needs to come with a statistician to stand over your shoulder and hit you with a ruler and shout "That's data mining, not a controlled experiment! No causality for you!"
No causality for you!
This is really cool. It'd be fun to throw stock price data into this.
What about the choice of symbolic forms? It'd be cool if some of the data analysis suggests other possible blocks to use in the modelling process.
Every installation of this program needs to come with a statistician to stand over your shoulder and hit you with a ruler and shout "That's data mining, not a controlled experiment! No causality for you!"
Not sure why you're being voted down, as this was the first thing I thought. Admittedly, I'm not a statistician, so perhaps someone else can explain why this kind of thing is valuable?
1- As experimentalists do experiments they often arrive at these same conjectures, but after years of trial and error. Throughout history there were probably mountains of data that were recorded but discarded after they were hypothesized to have no scientific value. Having a program like this can essentially narrow the search for you. It can let you get back to doing science and do less data processing, which for the majority of scientists is a godsend.
2- You can now take historical sets of data and see if you can recover new aspects of structure. Perhaps there were important features in the data that were overlooked that can now be statistically analyzed. This can lead to new research avenues.
How is this different from Bacon? http://mitpress.mit.edu/catalog/item/default.asp?ttype=2&...
I have only a limited understanding of the details of BACON, but from what I remember it was what is called a "production system" and somewhat akin to an evolving expert system. Something like BACON starts out with a set of rules and then tweaks them looking for patterns that can be generalized into new rules. Novel for the early 80s, but in practice these systems seemed to be limited to very specific domains. Eureqa…
IIRC, Bacon's domain was discovery of certain kinds of relationshps, not lung disease or something like that.
I agree that something that is packaged for general use is more valuable.