Live data from Hacker News

Automatic Generation of Visualizations and Infographics with LLMs

microsoft.github.io

11–20 of 56 posts

Re: Automatic Generation of Visualizations and Infographics with LLMs

#12
post #5

Last week I helped someone organizing and analyzing their data in Excel. As I'm using Excel only once every couple of years, I had to rewatch the wonderful "You Suck at Excel with Joel Spolsky" to be productive again. Now seeing this announcement page, I was immediately reminded of the mini-rant towards the end of the video [0]: > On average, once every three months, there's a startup that makes a thing that they say…

To be nitpicking here: Its not reinventing if its new. And the focus of this research was probably not to invent PivotTables but the Interface for these through LLMs

> Interface for these through LLMs

no code pivot tables?

Re: Automatic Generation of Visualizations and Infographics with LLMs

#14
I find the quality of the code really questionable:

system_prompt = """ You are a an experienced data analyst that can annotate datasets. Your instructions are as follows: i) ALWAYS generate the name of the dataset and the dataset_description ii) ALWAYS generate a field description. iv.) ALWAYS generate a semantic_type (a single word) for each field given its values e.g. company, city, number, supplier, location, gender, longitude, latitude, url, ip address, zip code, email, etc You return an updated JSON dictionary without any preamble or explanation. """

Some spelling errors, and where is number 3?

Re: Automatic Generation of Visualizations and Infographics with LLMs

#16

Ironically I've found GPT to be pretty terrible with plotting libraries like plotly/dash or even matplotlib compared to just about anything else in python.

I wrote a simple wrapper around Matplotlib and ChatGPT-3.5-turbo. The LLM response is a Python code that is executed to get charts. It is working very nice. Here is a repo https://github.com/mljar/plotai - you will find two videos in the readme. Maybe you should work on your prompts?

Re: Automatic Generation of Visualizations and Infographics with LLMs

#18

Earlier quoted context omitted.

To be nitpicking here: Its not reinventing if its new. And the focus of this research was probably not to invent PivotTables but the Interface for these through LLMs

> Interface for these through LLMs no code pivot tables?

Pivollama

Re: Automatic Generation of Visualizations and Infographics with LLMs

#20
post #19

I took this a step further, turning charts into infographics using stable diffusion (SDXL) https://karimjedda.com/beautiful-data-visualizations-powered...

That's a really nice idea. Have you thought about making it a product?

Thank you for the kind words. I wouldn't even know where to start. There's a lot I can code and do, but making something into a product is something I have no experience with.

What's your recommended approach? Even if open-source, curious to learn.

Post reply on HN