Forget AI agents, this DSL is better even for humans. Cool project!
Show HN: Microsoft releases Flint, a visualization language for AI agents
11–20 of 149 posts
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#12Is there a specific explanation about how this is better or different than vega itself? https://vega.github.io/vega/docs/specification/
My understanding is that Vega was already an expressive DSL for visualizations and its probably already well spread through LLM training data.
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#13> requiring them to explicitly make visual decisions that are supposed to be handled by a good compiler Isnt graphviz there for the same reason? Edit: I see it is using JSON as the declaration language, I am OK with llms being "good at json" but a syntax also consumable by humans it is not!
In fact, Json as a common language for human in visualization has been around for a while! The benefit of declarative grammar is that users can effective manipulate specs through UI (drag and drop, clicks). Btw, Flint is intentionally designed to allow agent skip low-level params like scale, axe, zero, step size etc (which are extremely crucial for "GOOD-looking") and they are dynamically optimized by the compiler. S…
> Json as a common language for human in visualization has been around for a while
Plant, Mermaid, Graphviz are all declarative textual representations designed for human authoring, JSON is made for tools. Its not a criticism just a statement that if interop across agent and human was intended this is not the simplest option.
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#14This is pretty crazy, literally built something almost exactly like this for a project I'm working on (a local-first AI agent that does work on folders while you sleep). Basically going from JSON "Lego blocks" to full reports (including charting, though a subset of what Flint offers). And with post-generation validation and retry steps.
Functions extremely well and the result is a very clear (and consitent) human-readable "output layer." Cool idea, fun to see people converging on similar concepts in the space.
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#15This is cool to see from a research team. A few weeks ago I was exploring a similar idea with ntcharts, where a user or LLM can specify a chart in a Golang or JSON object... and then that spec would be rendered either to a Bubble TUI via NTCharts or to HTML/SVG via ECharts. That Echarts HTML could be naturally served by a Golang http service. But Flint goes much deeper with semantic layers and settings optimizations.…
This is fun! We started thinking it would just be an engineering task in the beginning, but doing a solid intermediate language turned out to be a research project (the paper will be out soon).
Also, I find NTChart very fun, maybe we should add NT chart to the list of compilation backend for Flint so it works in the library. Putting a reminder here: https://github.com/microsoft/flint-chart/issues/45
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#16Is there a specific explanation about how this is better or different than vega itself? https://vega.github.io/vega/docs/specification/ My understanding is that Vega was already an expressive DSL for visualizations and its probably already well spread through LLM training data.
Vega was a high-level language in the past for human, but now they can be a bit too low-level for AI agents! AI agents have to write a lot of low-level params just to make charts looking good, and the result is that programs are hard to write reliably for AI agents.
Flint is a higher-level abstraction, with simpler much shorter spec, and the compiler derives low-level decisions so that charts are looking good.
So: flint lets agent write short program that achieving good looking charts that had to be done with lengthy program in the past.
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#17This is pretty crazy, literally built something almost exactly like this for a project I'm working on (a local-first AI agent that does work on folders while you sleep). Basically going from JSON "Lego blocks" to full reports (including charting, though a subset of what Flint offers). And with post-generation validation and retry steps. Functions extremely well and the result is a very clear (and consitent) human-rea…
That's awesome!
I find that besides training better models, designing new language for agents is also a super viable paths to improve their performance!
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#18The charts are very nice, and I think the visualisation layer for LLMs is a very interesting problem. I’ve been building https://smalldocs.org for this exact reason. It’s an office suite for AI agents - but my main use case is giving a cli based LLM the canvas to express itself - charts, mermaid diagrams, etc. I’ve extended it a bit further to be a format for all types of work so the agent can embed slides and spread…
> mermaid diagrams I'm terrible at diagrams, so I gave GPT very generic descriptions of one of our project, to convert in to that mermaid style, then for Lucid I pasted it in there, and had a visualization of what I needed. Worked out nicely.
Yep I find them to be very useful for explaining a system.
They can do a lot of cool things! Mermaid gallery here: https://smalldocs.org/s/xZrc-lNW1kbXpoIuU3l_ky#k=-0ehGe2B-hR...
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#19Forget AI agents, this DSL is better even for humans. Cool project!
For AI agents and Humans :)
Re: Show HN: Microsoft releases Flint, a visualization language for AI agents
#20[flagged]