TabFM: A zero-shot foundation model for tabular data
research.google
TabFM: A zero-shot foundation model for tabular data
1–10 of 16 posts
Re: TabFM: A zero-shot foundation model for tabular data
#2interesting to see this from Google after the SAP acquisition of Prior Labs.
Re: TabFM: A zero-shot foundation model for tabular data
#3On the one hand, this is impressive. TabPFN was already state of the art and is seriously shaking up Bayesian prediction for tabular data (which is almost everything).
On the other hand, perhaps it is just me, but I do not feel that this is an acceptable form of benchmark reporting in this domain. TabArena actually has multiple metrics, since ELO does not properly quantify the degree of improvement. The fact that these are not displayed here should give pause. Also the results section in the GitHub is a dumpster fire.
Re: TabFM: A zero-shot foundation model for tabular data
#4On the one hand, this is impressive. TabPFN was already state of the art and is seriously shaking up Bayesian prediction for tabular data (which is almost everything). On the other hand, perhaps it is just me, but I do not feel that this is an acceptable form of benchmark reporting in this domain. TabArena actually has multiple metrics, since ELO does not properly quantify the degree of improvement. The fact that the…
GitHub Repo: Please see the results folder
Results folder: Here's some undocumented parquet files
Definitely feels like they're hiding the ball lol.
If they had good benchmarks they'd talk about them.
Not comparing to tuned xgboost is also a warning sign.
Re: TabFM: A zero-shot foundation model for tabular data
#5150,000 rows of data, where will I store it all?!
Re: TabFM: A zero-shot foundation model for tabular data
#6150,000 rows of data, where will I store it all?!
The biggest misconception that people have when modeling using tabular data is that more data = better model.
Re: TabFM: A zero-shot foundation model for tabular data
#7In hindsight, the Prior Labs exit to SAP couldn't have been timed better.
Re: TabFM: A zero-shot foundation model for tabular data
#8On the one hand, this is impressive. TabPFN was already state of the art and is seriously shaking up Bayesian prediction for tabular data (which is almost everything). On the other hand, perhaps it is just me, but I do not feel that this is an acceptable form of benchmark reporting in this domain. TabArena actually has multiple metrics, since ELO does not properly quantify the degree of improvement. The fact that the…
GitHub Repo: Please see the results folder Results folder: Here's some undocumented parquet files Definitely feels like they're hiding the ball lol. If they had good benchmarks they'd talk about them. Not comparing to tuned xgboost is also a warning sign.
wouldn't xgboost be covered under autogluon? not perfect, but not missing either
Re: TabFM: A zero-shot foundation model for tabular data
#9150,000 rows of data, where will I store it all?!
The biggest misconception that people have when modeling using tabular data is that more data = better model.
There's a story sharing the front page right now about scaling laws, so it's not an unreasonable assumption.
Re: TabFM: A zero-shot foundation model for tabular data
#10150,000 rows of data, where will I store it all?!
Big Data is terrifying and only solvable with opaque deep learning