Why Large Language Models Fail at Tabular Prediction
1–10 of 42 posts
Re: Why Large Language Models Fail at Tabular Prediction
#2[flagged]
Re: Why Large Language Models Fail at Tabular Prediction
#3Unsure if it's LLMs that fail at tabular data or its just that tree boosting are spectacular at that task.
Re: Why Large Language Models Fail at Tabular Prediction
#4>We study a frontier LLM in its purest inference regime - a single generation pass over a prompt containing the full training and test data, with no tools, no agentic scaffolding, and no fine-tuning
Sigh. So this is somewhat interesting niche academic research but utterly irrelevant to real-world use cases.
Re: Why Large Language Models Fail at Tabular Prediction
#5Unsure if it's LLMs that fail at tabular data or its just that tree boosting are spectacular at that task.
[deleted]
Re: Why Large Language Models Fail at Tabular Prediction
#6The first thing I'd do if working with an LLM on tabular data is to ask what the best tool would be to work with that data and build up a proper harness to work with the data sensibly. Rawdogging LLM isn't the tool for forecasting like this, as they found.
Re: Why Large Language Models Fail at Tabular Prediction
#7Unsure if it's LLMs that fail at tabular data or its just that tree boosting are spectacular at that task.
Non-LLM transformers beat tree boosting - TabPFN, TabFM
https://research.google/blog/introducing-tabfm-a-zero-shot-f...
Re: Why Large Language Models Fail at Tabular Prediction
#8>We study a frontier LLM in its purest inference regime - a single generation pass over a prompt containing the full training and test data, with no tools, no agentic scaffolding, and no fine-tuning Sigh . So this is somewhat interesting niche academic research but utterly irrelevant to real-world use cases.
And written by an LLM, to boot.
Re: Why Large Language Models Fail at Tabular Prediction
#9>We study a frontier LLM in its purest inference regime - a single generation pass over a prompt containing the full training and test data, with no tools, no agentic scaffolding, and no fine-tuning Sigh . So this is somewhat interesting niche academic research but utterly irrelevant to real-world use cases.
[flagged]
Re: Why Large Language Models Fail at Tabular Prediction
#10Nowhere in the paper do they mention the reasoning level or budget used for the experiments?
You’ve got to be kidding me. That one variable could make a huge difference in the results. I can’t understand why they would leave that out.