Live data from Hacker News

Hacker News comments I'm tired of seeing

righto.com

221–229 of 229 posts

Re: Hacker News comments I'm tired of seeing

#222
post #211

Earlier quoted context omitted.

> The whole reason people felt the need to mention "correlation is not causation" is that correlation is evidence of causation. No, without evidence that assumption is false. Correlation can only be evidence for an unexplained link, and even that is often undermined by desperate researchers' predisposition to offer any detected correlation as though it couldn't result from chance. Given A and B, absent a plausible ca…

> No, without evidence that assumption is false. Correlation can only be evidence for an unexplained link I did not say it was conclusive evidence; I said it was evidence. I'm well aware that "A is correlated to B" does not prove "A causes B" or even "A causes B or B causes A", but it is a data point in favor. Saying "We should evaluate other evidence before we decide if A causes B" is reasonable skepticism. Acting a…

> I did not say it was conclusive evidence; I said it was evidence.

But it isn't. The null hypothesis requires us to assume that there's nothing but chance at work, and let evidence force a different conclusion. The fact that A and B appear correlated is not by itself evidence of anything other than chance.

> I'm well aware that "A is correlated to B" does not prove "A causes B" or even "A causes B or B causes A", but it is a data point in favor.

No, this is false. Without testing a hypothesis, and without a careful examination of a mechanism, the correlation has precisely no meaning apart from chance.

Here's an example selected at random from a vast literature that tries to make this point:

http://boingboing.net/2010/12/20/creating-a-phony-hea.html

Title: "Creating a phony health scare with the power of statistical correlation"

Quote: "In the United Kingdom, the more mobile phone towers a county has, the more babies are born there every year. In fact, for every extra cell phone tower beyond the average number, a county will see 17.6 more babies. Is this evidence that cell phone signals have some nefarious baby-making effect on the human body? Nope. Instead, it's a simple example of why correlation and causation should never be mistaken for the same thing."

I could link to a thousand similar stories, many being mistaken for actual scientific results.

> But the realist shouldn't underrate it either.

A realist -- a scientist -- always begins by assuming the association is the result of chance (the null hypothesis), and then examines evidence that might argue for another explanation. This is why all self-respecting scientific papers include a p-value. The p-value describes the probability that the result arose from chance, not the hypothesis under test.

http://en.wikipedia.org/wiki/P-value

Quote: "In statistical significance testing the p-value is the probability of obtaining a test statistic at least as extreme as the one that was actually observed, assuming that the null hypothesis is true."

Translated into layman's language, the p-factor is the probability that the observation -- the "correlation" -- arose by chance.

A properly educated scientist always assumes the null hypothesis is true, i.e. that the observation arose from chance factors. She then tests this assumption with evidence.

Re: Hacker News comments I'm tired of seeing

#223
post #91
post #72

Earlier quoted context omitted.

This, also, is not useful to point out every time an article title ends in a question mark. I'm not advocating for articles with titles that end in question marks, only that there is no value in reflexively pointing out "this article's title ends in a question mark" every time it happens: Bettridge's law of headlines exists, the point has been made, and even to the people who haven't heard about it, it doesn't give t…

The use of that comment is to point out and perhaps penalize a form of manipulation which hurts discourse, the sensationalized headline. This is valid in the same way that it is valid to point out when a headline contains a false and self-serving claim. I don't think anybody is under the slightest illusion that having heard of Betteridge's law demonstrates any particular intelligence.

It does not penalize the article, as even before this concept was given a name it was already clear. The only people it "penalizes" are the people who have to see the comment every single time an article, no matter what the quality level of the content, happens to have such a question-marked title. Think about it this way: the article got voted to some place, and maybe is even on the front page; do you think yelling "Bettridge's law of headlines says 'no'" is changing that vote?

Do you think people reading the comments are going "ah, that is something I had yet to consider about this article; I had previously been curious to know the answer to this deep and burning question, but now that I read this comment, it is clear time that not only am I a fool, but I should down vote this article, all articles like it, and start my own crusade to scream the name of this wonderful law of headlines every time I see such an article".

The best you are getting is "oh, I didn't realize someone had assigned this a funny 'law'... that will be a great trivia item I can being up to demonstrate my epic knowledge of jargon". The result is then just another person in the article comments adding noise. It is nothing more than a way to add mild justification to the seemingly-dying practice of yelling "first": you just need to know, for each article, what bingo terms happen to apply, and then be he first to lay claim to them.

Re: Hacker News comments I'm tired of seeing

#224

On balance I disagree with most of Ken's observations, though not always or in all cases. A useful comment is one which moves the conversation forward. A non-useful comment is one which serves NO useful purpose. Correlation is not causation. This is useful where a naive correlation is shown without causal mechanism. It's not useful when a correlation is shown and there's a strong causal link known. http://www.explain…

> though not always or in all cases. Nothing I read suggested that every case was a problem. Simply that over time, most of these types of comments aren't helping anyone. > Correlation is not causation.... It's useless as a comment. Spouting that off, and then adding a sentence on how bad science reporting is is where I see this most often. Or, often, it's applies to the reporting, not to the actual study. Thus, the…

>> Dunning-Kruger effect Sadly, far too often appropriate, IMO. > Citation requested. =)

My opinion.

Informed by a few things: some 40-odd years living on this planet (and possibly others), much of it involved directly or indirectly with technology and complexity. A general observation that much of the H/N crowd is younger (20s), often with the heightened sense of self-confidence which comes from youth, (often) a privileged upbringing, and a lack of exposure to hard knocks, as well as an overdeveloped faith in technological solutions.

A recent exploration of complexity specifically (see Joseph Tainter) and its dynamics. People don't choose complexity where it's not necessary, where they do, it's because it solves problems, but in doing so it imposes a tax -- higher resource (and especially energy) requirements, as well as decreased resilience and increased brittleness.

You do nothing by replying with a statement of the logical fallacy.

I disagree. You point out to others that the writer is relying on invalid arguments and/or facts. This may be out of laziness, out of a warped worldview, or out of deliberate manipulation of data and/or opinion (something I've been noticing increasingly on H/N). I'm content to observe the fallacy and move on. Sometimes the author (or someone else) will respond, occasionally copping to the error (in which case: success, a conversation ensues and the conversation moves forward), fairly frequently not and digging themselves in deeper (success: you've uncovered someone who's generally not worth arguing with, at this point I may simply drop the thread, or reply noting that they're repeating their earlier error).

I've actually made some interesting progress in understanding a few areas I'd previously had challenges with, in particular Libertarianism and the whole von Mises school, largely by discovering through conversations (and ensuing research) that the whole concept is based on a rejection of empiricism or real-world relevance. That and a healthy dose of corporate / plutocratic psychopathy courtesy the Koch brothers and others. Which explains much. And I rarely enter into discussions with those types other than to point out their irrationality.

this "you deserve to be called on it" attitude is that of a passive aggressive vigilantly.

Again, I disagree, and on this particular point, rather strongly.

Mind, yes, people will be wrong on teh Intarnets: http://xkcd.com/386/

But: we, humans, as a species, are facing some immense challenges. Global warming, peak oil, population, food, other resource exhaustion ("peak everything"), and a whole host of others.

And our institutions are exceptionally unfit to the challenge. Politics, economics, religion, technology, philosophy, the press, educational systems, liberal democratic principles (civil and human rights, etc.), even our own physiology and psychology (risk management, dopamine response, short-term/long-term focus), and a host of other factors are utterly maladaptive to what we're going to face over the next years, decades, assuming we survive that long, few centuries.

I'm not even pretending to have a clear view of what we need to do, or even all of what we face, but calling it "tremendously disruptive" is a mass understatement -- what else would you call a 7 to 14-fold (and possibly more) reduction in human population over a few decades at best? If HBS survives, you can bet they'll be teaching this one in 500 years.

So, yeah, I kinda take this shit a little bit seriously. And calling people on bullshit is part of that.

Even if the future of civilization isn't at stake, I've seen tremendous harm and pain come from sloppy and wishful thinking. But odds are quite good the stakes are slightly higher than that.

Re: Hacker News comments I'm tired of seeing

#225
post #140

Earlier quoted context omitted.

It's a convenient and recognized request for more information. It's pretty much the equivalent of "RSVP" on an invitation -- a shorthand request that the person it's directed to take an action out of consideration. Reading it as passive-aggressive strikes me as the attitude of someone who's looking for a social slight. In my experience, that search is rarely unsuccessful.

One way to interpret it as passive aggressive is if its merely an attempt to steer the argument in the direction of the fallacy of appeal toward authority. (abortion is wrong) (citation needed?) (my bible) (I'm not Christian) (holy way begins) Another way is just a psuedo-politeness. (... and applying ohms law aka power = voltage / current ...) (citation needed?) (quick google search results in ...whoops) It does mak…

(abortion is wrong) (citation needed?) (my bible) (I'm not Christian) (holy way begins)

Perhaps for some. For me it's clear that I've encountered someone whose worldview is fundamentally transrational and further discussion isn't necessary.

My purpose isn't to change the person's mind but to understand it. And if that understanding leads me to the conclusion that they're not worth wasting time in discussion, so be it. What's frustrating is when someone drops some vaguely provocative hint of something without giving a sense of what underlies it. Knowing the source of the bullshit is helpful.

It does make perfect sense for situations where the literature is lacking.

Also for where the person posting has a specific instance or reference in mind but cannot be assed to provide it. Again, my experience is that discussions with such people tend to be pretty unproductive. I only wish H/N had the ability present on, say, Reddit, to tag people as idiots. I've similarly created "idiot", "troll", "denialist", and "libertardian" circles on G+ simply to keep tabs of who's not worth engaging with (or noting to others that their conversation will likely be unproductive).

Re: Hacker News comments I'm tired of seeing

#226
post #215

Earlier quoted context omitted.

> The top-rating issue is simply symptomatic of the lack of insight of many of the folks clicking the little arrows over their first morning cup of coffee. Totally agree and it's hard to blame them. The real problem might be that people who are over-familiar with the cliche don't bother to down vote. Reminder to all: take the time to down vote over used cliches that bother you.

But there's no way to downvote an article. So I upvote the dismissive comment instead.

You can flag them if you have enough karma.

Re: Hacker News comments I'm tired of seeing

#227

On balance I disagree with most of Ken's observations, though not always or in all cases. A useful comment is one which moves the conversation forward. A non-useful comment is one which serves NO useful purpose. Correlation is not causation. This is useful where a naive correlation is shown without causal mechanism. It's not useful when a correlation is shown and there's a strong causal link known. http://www.explain…

"If you're not paying for it, you're the product." I have to say that I disagree with this meme in general. Google does not sell me (yet, at least) to its advertisers. It sells screen real estate and placed links. Sure, the links are very targeted, and more specific than much (probably not all) advertising that preceded it. I know that this meme is trying to make a general point, i.e. "there's a hidden cost to using…

I have to say that I disagree with this meme in general.

In a broader sense, "if you're not paying for it" falls under the broader rhubric of "understand the philosophy driving the tools you use".

One of the key advantages of using Free Software is that, fundamentally, the development model aligns the interests of the developer with the user. Not perfectly and not always, but in general. Some projects make this explicit, and the Debian Project is among the best-known examples, having a Philosophy, a Constitution, and a Policy, all as explicitly stated documents, detailing what the goals, concerns, and specific actions and rules of the project are.

Contrast with the proprietary software world in which the goal generally is profit maximization, often with short-term interests, and often sacrificing user experience in the process. Some companies avoid the pitfalls of this focus to a greater extent -- Apple has long placed end-user experience above all else, and, though I'm not a particular fan of the result, I can see its appeal especially for less-technical users.

Microsoft, by contrast, has from its beginning a winner-takes-all dominance strategy and had as its key customers OEMs and large businesses. I as an individual user (or developer, or administrator) am well down the priority list. Oracle would be another company whose alignment is often at odds with mine -- and extends to its stewardship of its free software projects (the core of which has largely migrated elsewhere, somewhat predictably). And yes, other free software companies can get confounded missions -- I'd classify much of the issues I encounter with Red Hat and GNOME as being fundamental to the mission and goals of the projects.

In the Web space, there are a relative handful of successful models:

- Amateur hour: not in the sense of "unpolished and crude", but literally "a work of love". Something done by an individual (or sometimes small group) out of passion. Often surprisingly good, but intrinsically limited in both scope and technical capability absent some larger base of support or organization.

- Propaganda: Whether it's selling a specific good (as opposed to mass advertising) or a philosophy, this is _somebody with a message_. H/N falls somewhat under this category.

- Public service: Sites such as Wikipedia. Often donor or sponsor supported. One way of scaling amateur hour.

- Commerce: Directly selling some good or product. Can still lead to a significant informational / conversational role, e.g., Craigslist or Amazon forums.

- Advertising: An aggregator of eyeballs. In which case, the particulars of the user base are of interest to the site (and its advertisers). And there's also often a very conscious effort to water down content to appeal to the greatest number. Both of these can set up perverse incentives which tend to drive down the ultimate value and quality of the site. Google has historically balanced the interests of its users (e.g., the product) and its customers (the advertisers), though I'm seeing a bit of a drift lately. Among the challenges: advertising and marketing teams increase in prominence within the company, chasing out the technical and user-focused talent (e.g., Marissa Meyer). Though she's landed at a company which is much, much further down the "provide benefit to advertisers" scale.

Then there's the additional issue that state surveillance (and hacker communities) have a significant interest in such data troves.

One of the advantages to being pithy is that there's an implicitly referenced and much longer argument which takes too long to type.

So, include above by default in "If you're not paying for it, you're the product."

Re: Hacker News comments I'm tired of seeing

#228
post #50

The first 8 points are all totally valid comments and I don't think they can be rejected out-of-hand. The author seems annoyed by a perception that they're thrown into the mix in snarky, passive aggressive or ad hominem ways but that doesn't invalidate their use when they are accurately applied. Facile, poorly reasoned content is abundant on the internet. Hacker News is a firehose of content – both good and bad – and…

The inevitable comments about Bettridge's law of headlines every time a title ends in a question mark are not helpful. They don't make an argument, as the article is hardly ever arguing for the question. It is just indicating "look at me, I know of this exotic jargon term, and it happens to apply to this article title". Like, this article could have been "would hacker news improve if we stopped posting certain kinds…

Chanting "Bettridge's Law" simply because the headline is a question certainly isn't helpful but that's because it's inaccurate.

As Bettridge himself said:

> they know that story is probably bullshit, and don’t actually have the sources and facts to back it up, but still want to run it

Identifying a headline & story as an example of Bettridge's Law of Headlines should highlight that the headline is nasty link-bait phrased as a question purely to manipulate the reader and that the article provides no insight – in fact it merely serves to further highlight the insidious nature of the headline and the nasty journalistic choices of the author.

Post reply on HN