Automatic Generation of Visualizations and Infographics with LLMs
microsoft.github.io
Automatic Generation of Visualizations and Infographics with LLMs
1–10 of 56 posts
Re: Automatic Generation of Visualizations and Infographics with LLMs
#2Ironically I've found GPT to be pretty terrible with plotting libraries like plotly/dash or even matplotlib compared to just about anything else in python.
Re: Automatic Generation of Visualizations and Infographics with LLMs
#3Was playing with the library this morning, the interesting part to me was the 'goal explorer' which generates the questions to asks of the data.
Keen to see more research into this part specially making the questions more specific to the dataset in question and overlaying real-world situations.
Re: Automatic Generation of Visualizations and Infographics with LLMs
#4Excellent technical work but subject to the same major questionmarks around the morality and legality of LLM business models. From the discussion section:
> Low Resource Grammars: ... LIDA depends on the underlying LLM s having some knowledge of visualization grammars as represented in text and code in its training dataset (e.g., examples of Altair, Vega, Vega-Lite, GGPLot, Matplotlib, represented in Github, Stackoverflow, etc.). For visualization grammars not well represented in these datasets (e.g., tools like Tableau, PowerBI, etc., that have graphical user interfaces as opposed to code representations) ), the performance of LIDA may be limited without additional model fine-tuning or translation.
In other words, open source programmatic visualizations are required to feed the LLM, which then can, e.g., be licensed to corporates to accelerate various internal exploratory data analyses. A win-win for corporates and LLM providers.
Spot the loser.
Re: Automatic Generation of Visualizations and Infographics with LLMs
#5Last week I helped someone organizing and analyzing their data in Excel. As I'm using Excel only once every couple of years, I had to rewatch the wonderful "You Suck at Excel with Joel Spolsky" to be productive again. Now seeing this announcement page, I was immediately reminded of the mini-rant towards the end of the video [0]:
> On average, once every three months, there's a startup that makes a thing that they say is going to be amazing, and it's just PivotTables. They're like, "It works with Excel, and it does this amazing consolidation, and slicing and dicing of all your data, and it's amazing, and we're going to make a startup. I'm going to sell this for four hundred ninety-five dollars." And that happens at least once every three months. The trouble is, the VCs usually know about PivotTables.
Of course this product goes a little further, making suggestions what columns to analyze and chart with an LLM. But it's quite funny to me that this Microsoft Research product is reinventing the PivotTable (+PivotChart) part with Python and Pandas.
[0]: https://youtu.be/0nbkaYsR94c?si=kkfFHZ_fyGmG3Lnj&t=2988
Re: Automatic Generation of Visualizations and Infographics with LLMs
#6Super cool.
Here the viz-related prompts (generation, editing, etc), for those interested: https://github.com/microsoft/lida/tree/main/lida/components/...
I built a tool that lets you use GPT to analyze data and build interactive graphs on the browser (https://deepsheet.dylancastillo.co/). I may try to adapt it to use LIDA or a similar approach.
Re: Automatic Generation of Visualizations and Infographics with LLMs
#7They should get rid of the infographer module as it really undermines the rest of the work.
Re: Automatic Generation of Visualizations and Infographics with LLMs
#8Last week I helped someone organizing and analyzing their data in Excel. As I'm using Excel only once every couple of years, I had to rewatch the wonderful "You Suck at Excel with Joel Spolsky" to be productive again. Now seeing this announcement page, I was immediately reminded of the mini-rant towards the end of the video [0]: > On average, once every three months, there's a startup that makes a thing that they say…
To be nitpicking here: Its not reinventing if its new.
And the focus of this research was probably not to invent PivotTables but the Interface for these through LLMs
Re: Automatic Generation of Visualizations and Infographics with LLMs
#9Weird landing page - I’m expecting to see infographic examples but the images I see are of people looking at screens and smiling
Re: Automatic Generation of Visualizations and Infographics with LLMs
#10Excellent technical work but subject to the same major questionmarks around the morality and legality of LLM business models. From the discussion section: > Low Resource Grammars: ... LIDA depends on the underlying LLM s having some knowledge of visualization grammars as represented in text and code in its training dataset (e.g., examples of Altair, Vega, Vega-Lite, GGPLot, Matplotlib, represented in Github, Stackove…
And what in particular is now novel or unique to the general 'issue' you mention?
Most companies use OpenSource in one way or the other.
Nonetheless, a company like MS has probably already build visualizers purely commercially (see excel) or/and is absolutly able to write it themselfs.