The related problem that I see actually more often is the "you don't have big data" problem. You know, in data science, you see people spending hours writing pandas scripts that replicate a few clicks in excel for a one of analysis. You see datasets of a few gigabytes being processed with spark when SQL would be fine. You see ML techniques being thrown at questions that could be answered simply and reliably with basi…
Talking to people is not going to help you either. You end up getting a lot of noise and making sense of what you hear is difficult. When you keep probing you will get to hear stuff thats not really critical and just often made up because you ask too many questions. Classical trap of market research.
Be good-argument-driven, not data-driven
51–60 of 168 posts
Re: Be good-argument-driven, not data-driven
#52This entire discussion makes a good case for why the general populace would benefit from being taught the basics of philosophy. In this case the topic of value is the often fraught relationship between empiricism and rationalism , and the impacts each have on the scientific process, research, education, and how we go about understanding the world. To operate with one with a complete absence of the other is to expose…
In any case, I think empirical science's defeat of rationalism ( eg Galileo Vs Church) has all sorry of ramifications. Social sciences like economics and psychology have a lot of trouble bridging the gaps.
Re: Be good-argument-driven, not data-driven
#53This entire discussion makes a good case for why the general populace would benefit from being taught the basics of philosophy. In this case the topic of value is the often fraught relationship between empiricism and rationalism , and the impacts each have on the scientific process, research, education, and how we go about understanding the world. To operate with one with a complete absence of the other is to expose…
Re: Be good-argument-driven, not data-driven
#54This is not what the data shows https://www.google.com/search?q=data+driven+companies+more+p... Any good-argument-driven based argument you attempt to make is almost always based on political motivating factors, rather on what is good for the business. Intuition driven decisions work when the market is behaving normally, however, are generally too slow in a fast changing market like we have been since the start of CO…
If this is true in the case of a specific theory, then that is not a good theory.
Re: Be good-argument-driven, not data-driven
#55To the author... I'd suggest a rewrite of what you're trying to communicate because your usage of "good-argument-driven" is a textbook example of Begging The Question: https://en.wikipedia.org/wiki/Begging_the_question For discussion's sake, let's go along with excluding data/metrics/science in pushing for arguments. In this framework, what exactly is a "good" argument based on? Gut feel? Opinion? There was a famous…
More here: https://www.lesswrong.com/posts/jcTsbaQ8hNc7qxwaQ/explanatio...
Re: Be good-argument-driven, not data-driven
#56> Are you prepared to do some very very fancy statistics? I'd extend this with "... while understanding what you're doing?" I've seen it so many times already, someone does some A/B-test and then presents a very fancy looking slide-deck with all kinds of crazy-looking math. But if you start to ask questions, it's all very obvious that they didn't really understood what they were doing and that very often it doesn't r…
IF you need 'fancy' statistics then it is not going to be a good data driven argument at all.
Re: Be good-argument-driven, not data-driven
#57He calls it good explanations.
A good explanation is something that is hard to vary while still solving the problem it purports to solve.
He is against most use of Bayesianism when used for predictions.
Great presentation here
Re: Be good-argument-driven, not data-driven
#58> A weak argument founded on poorly-interpreted data is not better than a well-reasoned argument founded on observation and theory. So a good argument is founded on...good data and good understanding of data? The article more seriously makes the mistake of begging the question: it presupposes the known classier of good and bad arguments and then goes on to say bad arguments with data is worse than good arguments. But…
More here: https://www.lesswrong.com/posts/jcTsbaQ8hNc7qxwaQ/explanatio...
Re: Be good-argument-driven, not data-driven
#59This entire discussion makes a good case for why the general populace would benefit from being taught the basics of philosophy. In this case the topic of value is the often fraught relationship between empiricism and rationalism , and the impacts each have on the scientific process, research, education, and how we go about understanding the world. To operate with one with a complete absence of the other is to expose…
The point I would add is that hardly anyone uses the empirical process directly. It is all 'this article claims this' or 'this study says that'. It's very 'meta' with little to no personal verification or testing of the claims - ie, theories based on theories or models based on models, or maps based on maps.
Very few check the terrain itself to confirm that the map applies. We trust education, experts, peer review etc. We're drowning in models, especially as these are easily represented on computers, but have no ability to check the models against reality.
PS this disassociation from reality will not improve as we move forward technologically. No doubt, in the metaverse we will be able to create ever more elaborate models, or is it that we will be ever more disassociated from our own anecdotal experiences? (Where 'anecdotal' is something to apologise about).
Re: Be good-argument-driven, not data-driven
#60This reminds me a lot of the discussion of the scientific method by Karl Popper, and David Deutsch who was very influenced by Popper. "Being data-driven" sounds very empirical . Just look at the data, and see what you find in it. But you can't just let the data "speak for itself" without an explanation or a theory that interprets the data. Popper in Conjectures and Refutations : > Observation is always selective. It…
Here is a good talk https://www.youtube.com/watch?v=EVwjofV5TgU