Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#1

Post by itsmekali321 » Sat, May 17, 2025, 2:43 AM UTC

I am curious about those who are working in the machine learning or statistics domain but are focusing on traditional ML research rather than large language models (LLMs).

What specific areas or projects are you currently working on?

Thank You!

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#2

Post by helltone » Sat, May 17, 2025, 4:41 AM UTC

I'm building a tool to make ml on tabular data (forecasting, imputation, etc) easier and more accessible. The goal is to go from zero to a basic working model in minutes, even if the initial model is not perfect, and then iteratively improve the model step by step, while continuously evaluating each step with metrics and comparisons to the previous model. So it's less ml foundation research, and more trying to package it in a user friendly way with a nice workflow, but if that's interesting feel free to reach out (email in profile).

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#3

Post by epaprat » Sat, May 17, 2025, 4:45 AM UTC

There’s still a lot of active research in traditional ML areas that LLMs haven’t solved. Causal inference, robustness to distribution shifts, and adversarial resilience remain open challenges. Continual and online learning, where models adapt without forgetting, are crucial for real-world deployment. Multi-modal learning beyond text, especially fusing vision, time series, and structured data, is another tough frontier. Interpretability, especially in high-stakes domains, still requires far more than attention maps. LLMs are impressive, but they haven’t made most of classical ML research obsolete.

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#4

Post by usgroup » Sat, May 17, 2025, 6:57 AM UTC

Statistical modelling is largely unrelated to machine learning in its ideology. If you're a professional Statistician then you're most likely working as part of some function heavily utilising randomised experiment design, or less frequently, observational designs. This would include hard sciences, actuarial sciences, finance (risk), manufacturing, poll/census research.

The main commercial opensource language for serious Statisticians is R. You can Google for the sorts of jobs requiring R as a marker, if you're interested in applications of Statistics unrelated to LLMs.

To answer your own question about classical ML, you can Google for jobs requiring the specific classical ML technologies in which you are interested as a marker.

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#5

Post by jononor » Sat, May 17, 2025, 6:17 PM UTC

I work on machine learning applied to sensor data, for understanding physical phenomena. Both time-series models etc for condition monitoring of technical machinery (specifically HVAC in buildings) at https://soundsensing.no And also running ML inference directly on microcontroller-based sensors, via the open-source project emlearn - https://github.com/emlearn/emlearn

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#6

Post by mmarian » Sat, May 17, 2025, 8:04 PM UTC

Check out quant trading.

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#7

Post by wannabebarista » Sun, May 18, 2025, 4:44 AM UTC

I work on differentially private query answering and synthetic data generation for tabular data. This is an active area with some cool advances in the last few years.

Here's a nice summary of some of these ideas: https://differentialprivacy.org/synth-data-1/.

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#8

Post by izyda » Sun, May 18, 2025, 5:00 AM UTC

I work on alternative data in the hedge fund industry. We're not quants -- we don't try to predict the stock market... instead, we try to forecast how individual companies are performing using aggregated clickstream, point-of-sale, and payments data. It's a data cleaning, timeseries, and modeling problem with a lot of domain knowledge necessary.

LLMs can be helpful (Ie. for example, entity resolution for data cleaning) but the core models you have to use to actually make the predictions (this looks a lot more like "old" tabular data approaches).

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#9

Post by fermisea » Sun, May 18, 2025, 3:02 PM UTC

Yes, (ergodic.ai) working on causal inference applied to process mining and event logs. Basically: something happened, why did it happen and how can I avoid it/get more of it?

Re: Ask HN: Anyone working in traditional ML/stats research instead of LLMs?

#10

Post by itsmekali321 » Sun, May 18, 2025, 6:20 PM UTC

jononor wrote: post #5

I work on machine learning applied to sensor data, for understanding physical phenomena. Both time-series models etc for condition monitoring of technical machinery (specifically HVAC in buildings) at https://soundsensing.no And also running ML inference directly on microcontroller-based sensors, via the open-source project emlearn - https://github.com/emlearn/emlearn

This is such a cool project!