Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

NeuralSVG: An Implicit Representation for Text-to-Vector Generation

sagipolaczek.github.io

Post reply on HN
Print view View original

51–60 of 84 posts

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#51

Post by kadushka »

janalsncm wrote: post #40
kadushka wrote: post #32

Earlier quoted context omitted.

I’d also like to see this in music generation. Tools like Suno are cool but I would much rather have something that generates MIDIs and instrument configurations instead. Sounds like you're looking for something like https://www.aiva.ai

Honestly that site feels like they have a database of midis tagged by genre and pick them out randomly. It’s totally different from their demo song. I guess I’m hoping for something better. It’s also closed source, the web ui doesn’t have editing functionality, and the output is pretty disjointed. Maybe if I messed around with it enough the result would be decent.

Fair enough. Still, for what you’ve described, Aiva is the best tool available.

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#52

Post by esperent »

gwern wrote: post #47
vipshek wrote: post #26

This is excellent! I think the utility of generating vectors is far, far greater than all the raster generation that's been a big focus thus far (DALL-E, Midjourney, etc). Those efforts have been incredibly impressive, of course, but raster outputs are so much more difficult to work with. You're forced to "upscale" or "inpaint" the rasters using subsequent generative AI calls to actually iterate towards something use…

Have you looked at https://www.recraft.ai/ recently? The image quality of their vector outputs seems to have gotten quite good, although you obviously still wouldn't want to try to generate densely textured or photographic-like images like Midjourney excels at. (For https://gwern.net/dropcap last year or before, we had to settle for Midjourney and create a somewhat convoluted workflow through Recraft; but if I were m…

Link to their vector page, since the main page makes them look like yet another AI image generator:

https://www.recraft.ai/ai-image-vectorizer

The quality does look quite amazing at first glance. How are the vectors to work with? Can you just open them in illustrator and start editing?

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#54

Post by [deleted] »

nojvek wrote: post #49
andy_ppp wrote: post #48

I’m looking forward to seeing what this makes of Simon Willison’s LLM SVG generation test prompt: “Generate an SVG of a pelican riding a bicycle”. It’s quite amazing the progress we are seeing in AI and it will keep getting better which is somewhat terrifying.

I asked both Claude and ChatGPT o3 to "generate svg of mainland USA with black outline". Tried various models and they got it hopelessly wrong. Claude does an okay job at "Generate an SVG of a pelican riding a bicycle"

[deleted]

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#56

Post by gwern »

esperent wrote: post #52
gwern wrote: post #47

Earlier quoted context omitted.

Have you looked at https://www.recraft.ai/ recently? The image quality of their vector outputs seems to have gotten quite good, although you obviously still wouldn't want to try to generate densely textured or photographic-like images like Midjourney excels at. (For https://gwern.net/dropcap last year or before, we had to settle for Midjourney and create a somewhat convoluted workflow through Recraft; but if I were m…

Link to their vector page, since the main page makes them look like yet another AI image generator: https://www.recraft.ai/ai-image-vectorizer The quality does look quite amazing at first glance. How are the vectors to work with? Can you just open them in illustrator and start editing?

No, I actually was referring to their native vector AI image generator, not their vectorizer - although the vectorizer was better than any other we found, and that's why we were using it to convert the Midjourney PNG dropcaps into SVGs

(The editing quality of the vectorized ones were not great, but it is hard to see how they could be good given their raster-style appearance. I can't speak to the editing quality of the native-generated ones, either in the old obsolete Recraft models or the newer ones, because the old ones were too ugly to want to use, and I haven't done much with the new one yet.)

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#57

Post by intalentive »

I’ve always thought that generation of intermediate representations was the way to go. Instead of generating concrete syntax, generate AST. Instead of generating PNG, generate SVG. Instead of generating a succession of images for animation, generate wire frame or rigging plus script.

Once you have your IR, modify and render. Once you have your render, apply a final coat of AI pixie dust.

Maybe generative models will get so powerful that fine-grained control can be achieved through natural language. But until then, this method would have the advantages of controllability, interoperability with existing tools (like Intellisense, image editors), and probably smaller, cheaper models that don’t have to accommodate high dimensional pixel space.

Re: NeuralSVG: An Implicit Representation for Text-to-Vector Generation

#60

Post by IncreasePosts »

mcraiha wrote: post #59
IncreasePosts wrote: post #58

Shouldn't the girl with the pearl earring have an earring?

No, because it is not a pearl earring. https://www.theartnewspaper.com/2023/02/08/the-girl-with-a-g...

Okay, but shouldn't she at least have a glass teardrop-shaped bauble?
Post reply on HN