We seem to have cracked the art of distilling information in words and images using large machine learning models. But our ability to exploit useful information in tabular data using large models is mostly missing. The upshot is that LLMs don’t largely encode the knowledge from these tabular datasets, e.
Read in full here: