Live data from Hacker News

Twitter’s new R package for anomaly detection

r-bloggers.com

1–10 of 16 posts

Re: Twitter’s new R package for anomaly detection

#3
post #2

This is blogspam and a duplicate. The original url is here: https://blog.twitter.com/2015/introducing-practical-and-robu... And the previous discussion is here: https://news.ycombinator.com/item?id=8846205

I wouldn't call it blogspam since r-bloggers.com is an opt-in aggregator. But yes a link to the original makes more sense.

Re: Twitter’s new R package for anomaly detection

#4
This reminds me how much of a hole there is in my knowledge about statistics and such. I built myself a Twitter client that sucks users' geolocations into a DB so I can do all kinds of analyses on their movements. Makes me wish we had Statistics classes back in school. That should come right after learning the ABC.

Re: Twitter’s new R package for anomaly detection

#6
post #4

This reminds me how much of a hole there is in my knowledge about statistics and such. I built myself a Twitter client that sucks users' geolocations into a DB so I can do all kinds of analyses on their movements. Makes me wish we had Statistics classes back in school. That should come right after learning the ABC.

Time series analysis comes quite far into most statistics syllabi. I did quite a bit of statistics at school and it wasn't until my third year of Mathematics & Statistics at university that we touched time series data. (Although it could have been taken as a second year module I think).

Re: Twitter’s new R package for anomaly detection

#7
post #4

This reminds me how much of a hole there is in my knowledge about statistics and such. I built myself a Twitter client that sucks users' geolocations into a DB so I can do all kinds of analyses on their movements. Makes me wish we had Statistics classes back in school. That should come right after learning the ABC.

Even the original twitter blog seems to have gone out of its way to make this seem more complex then it is...

Decomposition of time series is done with STL (stl function in stats package) and this is the first part of what they call "Seasonal Hybrid ESD (S-H-ESD)" (sounds impressive right?) which then apparently just involves taking the max absolute difference from the detrended sample mean in terms of standard deviations, remove it and repeat until you have your collection of x outliers. If they wanted to this could be explained in a few sentences, and the underlying code is really simple [0], but for whatever reason it's been written up as advanced analytics — as if decomposing a time series is a major challenge.

[0] https://github.com/twitter/AnomalyDetection/blob/master/R/de...

Re: Twitter’s new R package for anomaly detection

#8
post #3
post #2

This is blogspam and a duplicate. The original url is here: https://blog.twitter.com/2015/introducing-practical-and-robu... And the previous discussion is here: https://news.ycombinator.com/item?id=8846205

I wouldn't call it blogspam since r-bloggers.com is an opt-in aggregator. But yes a link to the original makes more sense.

What's the point to credit middle man? Hacker news, reddit do the same (or even better), r-bloggers just rip off the content. Been there, done that.

Re: Twitter’s new R package for anomaly detection

#9
post #8
post #3

Earlier quoted context omitted.

I wouldn't call it blogspam since r-bloggers.com is an opt-in aggregator. But yes a link to the original makes more sense.

What's the point to credit middle man? Hacker news, reddit do the same (or even better), r-bloggers just rip off the content. Been there, done that.

That's not what I said, my point was that labelling it blogspam doesn't seem correct because it's opt-in and a preferred source for articles for many in the R community. And as I said the original link should have been linked to.

Re: Twitter’s new R package for anomaly detection

#10
post #4

This reminds me how much of a hole there is in my knowledge about statistics and such. I built myself a Twitter client that sucks users' geolocations into a DB so I can do all kinds of analyses on their movements. Makes me wish we had Statistics classes back in school. That should come right after learning the ABC.

I just signed up for a statistics class at my local university. I will officially be an undergrad student again on Jan 20, and I intend to learn much much more this time.

Luckily my employer encourages learning, and it helps that the class is mostly during lunch.

Keep on learning!

Post reply on HN