Live data from Hacker News

Everything is a linear model

danielroelfs.com

1–10 of 90 posts

Re: Everything is a linear model

#5

I thought nonlinearity was very important to be able to make a larger model better than a smaller one? Like so important that tom7 made a half-joke demo with it: https://yewtu.be/watch?v=Ae9EKCyI1xU

Linear models don’t need everything to be linear.

Re: Everything is a linear model

#6
post #5

I thought nonlinearity was very important to be able to make a larger model better than a smaller one? Like so important that tom7 made a half-joke demo with it: https://yewtu.be/watch?v=Ae9EKCyI1xU

Linear models don’t need everything to be linear.

I presume you are implying that linear model only mandates linear relationship between predictor and regression coefficients?

Re: Everything is a linear model

#7
post #3

I knew the linked-in-the-article https://lindeloev.github.io/tests-as-linear/ which is also great. A bit meta on the widespread use of linear models: "Transcending General Linear Reality" by Andrew Abbott, DOI:10.2307/202114

Here is the Python port of test-as-linear developed by George Ho (eigenfoo): https://github.com/minireference/tests-as-linear/blob/bugfix...

I'm linking to my fork of it because I've added some fixes and filled in some of the missing parts (e.g. Welch's t-test).

Re: Everything is a linear model

#8
post #3

I knew the linked-in-the-article https://lindeloev.github.io/tests-as-linear/ which is also great. A bit meta on the widespread use of linear models: "Transcending General Linear Reality" by Andrew Abbott, DOI:10.2307/202114

I read this article when I was in grad school 5 years ago. Absolutely love it and talk about it to this day.

It really makes me frustrated about the ways I was introduced to statistics: brute force memorization of seeming arbitrary formulas.

Re: Everything is a linear model

#10

I thought nonlinearity was very important to be able to make a larger model better than a smaller one? Like so important that tom7 made a half-joke demo with it: https://yewtu.be/watch?v=Ae9EKCyI1xU

Well, you can create a non-linear model by piece-wise combining multiple linear models.

The famous ReLU non-linearity is just that - two linear functions joined.

Post reply on HN