This is great. The author defines their own metrics, is doing their own A/B tests and publishes their interpretation plus the raw data. Imagine a world where all health blogging was like that. Personally, I have not published any results yet, but I have been doing this type of experiments for 4 years now. And collected 48874 data points so far. I built a simple system to do it in Vim: https://www.gibney.org/a_syntax_…
“Technically” here could imply “not corrected for multiple tests”. But the typical qualifier I use is “nominally significant” when I don’t apply an correction for multiple tests. Or “not using a one-way t test”. The most appropriate null hypothesis in this lovely study is “does theanine REDUCE anxiety”, not “does theanine change anxiety either up or down”. What impressed me most is the suggestion for an improved expe…
Neither of those is a hypothesis, which require a prediction not just a question.
The null hypothesis for this experiment would be "Theanine has no effect on stress".