Great analysis and spot on examples. Another issue with AI related research is that a lot of papers are new and not that many get published in “proper” places, yet being quoted right/left/center, just look at google scholar. It is hard to repro the results and check the validity of some statements, not to mention that research which was done 4 years ago used one set of models and now another set of models with differ…
I’m not a scientist or a researcher, but anything based on statistics and data interpretation is immediately subject to my skepticism.
There are practices like pre-registration, open data, etc. that can make results much more transparent and replicable.