Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Automatic Generation of Visualizations and Infographics with LLMs

microsoft.github.io

Post reply on HN
Print view View original

21–30 of 56 posts

Re: Automatic Generation of Visualizations and Infographics with LLMs

#21

Post by nologic01 »

Incolotopo wrote: post #10
nologic01 wrote: post #4

Excellent technical work but subject to the same major questionmarks around the morality and legality of LLM business models. From the discussion section: > Low Resource Grammars: ... LIDA depends on the underlying LLM s having some knowledge of visualization grammars as represented in text and code in its training dataset (e.g., examples of Altair, Vega, Vega-Lite, GGPLot, Matplotlib, represented in Github, Stackove…

And what in particular is now novel or unique to the general 'issue' you mention? Most companies use OpenSource in one way or the other. Nonetheless, a company like MS has probably already build visualizers purely commercially (see excel) or/and is absolutly able to write it themselfs.

I am not sure what you are talking about.

If I release a novel visualization library on github under some open source license I want it to be attributed to me. I don't want some specialized LLM to be lifting and offering the same visualization concepts to unnamed corporates for a hefty fee without me ever even knowing about it and these corporates pretending they don't know where that concept is coming from.

It is you choice whether you think that is a problem and how "novel" it is. Theft after all has a very long history.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#22

Post by aliyeysides »

ilovefood wrote: post #20
w-m wrote: post #19

Earlier quoted context omitted.

That's a really nice idea. Have you thought about making it a product?

Thank you for the kind words. I wouldn't even know where to start. There's a lot I can code and do, but making something into a product is something I have no experience with. What's your recommended approach? Even if open-source, curious to learn.

Continue as an open source project by building features and refining the product. Once you have enough users you can start offering premium features and support to organizations. Maybe even apply to an accelerator? Good Luck!

Re: Automatic Generation of Visualizations and Infographics with LLMs

#23

Post by thundergolfer »

ilovefood wrote: post #20
w-m wrote: post #19

Earlier quoted context omitted.

That's a really nice idea. Have you thought about making it a product?

Thank you for the kind words. I wouldn't even know where to start. There's a lot I can code and do, but making something into a product is something I have no experience with. What's your recommended approach? Even if open-source, curious to learn.

If the product got good enough you’d have a shot at selling to Canva.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#24

Post by javajosh »

No, absolutely not. How can you trust the output from such a black box system? Who is to say that the LLM won't add or remove data points to make the chart "look good"? Heaven help us if decision makers start taking this output seriously. But of course they will, because the charts will look professional and plausible, because that's what the prompt requires.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#25

Post by mdorazio »

Am I missing something here? From the video and examples this looks like it's helping you make Excel charts with less suck (slightly stylized), not really building what I would consider "infographics" in the traditional marketing sense. I guess it counts as visualizations, but not what I was expecting.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#26

Post by [deleted] »

mdorazio wrote: post #25

Am I missing something here? From the video and examples this looks like it's helping you make Excel charts with less suck (slightly stylized), not really building what I would consider "infographics" in the traditional marketing sense. I guess it counts as visualizations, but not what I was expecting.

[deleted]

Re: Automatic Generation of Visualizations and Infographics with LLMs

#27

Post by beebmam »

w-m wrote: post #5

Last week I helped someone organizing and analyzing their data in Excel. As I'm using Excel only once every couple of years, I had to rewatch the wonderful "You Suck at Excel with Joel Spolsky" to be productive again. Now seeing this announcement page, I was immediately reminded of the mini-rant towards the end of the video [0]: > On average, once every three months, there's a startup that makes a thing that they say…

It's impossible to use excel for big data, the application has soft limits due to responsiveness.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#28

Post by ukuina »

ilovefood wrote: post #20
w-m wrote: post #19

Earlier quoted context omitted.

That's a really nice idea. Have you thought about making it a product?

Thank you for the kind words. I wouldn't even know where to start. There's a lot I can code and do, but making something into a product is something I have no experience with. What's your recommended approach? Even if open-source, curious to learn.

I would pay $5 for the occasional, chart-heavy month to upload my graphs without proprietary detail and get a few images to reroll through.

Re: Automatic Generation of Visualizations and Infographics with LLMs

#29

Post by ukuina »

RH123 wrote: post #14

I find the quality of the code really questionable: system_prompt = """ You are a an experienced data analyst that can annotate datasets. Your instructions are as follows: i) ALWAYS generate the name of the dataset and the dataset_description ii) ALWAYS generate a field description. iv.) ALWAYS generate a semantic_type (a single word) for each field given its values e.g. company, city, number, supplier, location, gen…

All you need is attention?

Re: Automatic Generation of Visualizations and Infographics with LLMs

#30

Post by vimesy »

javajosh wrote: post #24

No, absolutely not. How can you trust the output from such a black box system? Who is to say that the LLM won't add or remove data points to make the chart "look good"? Heaven help us if decision makers start taking this output seriously. But of course they will, because the charts will look professional and plausible, because that's what the prompt requires.

"You are a helpful assistant highly skilled in writing PERFECT code for visualizations. Given some code template, you complete the template to generate a visualization given the dataset and the goal described. The code you write MUST FOLLOW VISUALIZATION BEST PRACTICES ie. meet the specified goal, apply the right transformation, use the right visualization type, use the right data encoding, and use the right aesthetics (e.g., ensure axis are legible). The transformations you apply MUST be correct and the fields you use MUST be correct. The visualization CODE MUST BE CORRECT and MUST NOT CONTAIN ANY SYNTAX OR LOGIC ERRORS. You MUST first generate a brief plan for how you would solve the task e.g. what transformations you would apply e.g. if you need to construct a new column, what fields you would use, what visualization type you would use, what aesthetics you would use, etc. YOU MUST ALWAYS return code using the provided code template. DO NOT add notes or explanations." (https://github.com/microsoft/lida/blob/main/lida/components/...)

They prompted that things MUST be correct in their prompts and it reports any transformations it does to your data, it might give you some insight into its logic to test yourself against the data.

Post reply on HN