Live data from Hacker News

Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

aiomnigen.com

11–20 of 60 posts

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#14
post #11

With consistent representation of characters, are we now on the precipice of a Cambrian explosion of manga/graphic novels/comics?

not yet, still can't generate transparent images

Why do you need that? For manga specifically, generate in greyscale and convert luminance to alpha; then composite; then color.

Or, if you need solid regions that overlap and mask out other regions, then generate objects over a chroma-keyable flat background.

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#15
post #11

With consistent representation of characters, are we now on the precipice of a Cambrian explosion of manga/graphic novels/comics?

not yet, still can't generate transparent images

From the controlnet author:

Transparent Image Layer Diffusion using Latent Transparency

https://arxiv.org/abs/2402.17113

https://github.com/lllyasviel/sd-forge-layerdiffuse

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#16
post #5

Elegant architecture, trained from scratch, excels at image editing. This looks very interesting! From https://arxiv.org/html/2409.11340v1 > Unlike popular diffusion models, OmniGen features a very concise structure, comprising only two main components: a VAE and a transformer model, without any additional encoders. > OmniGen supports arbitrarily interleaved text and image inputs as conditions to guide image generati…

> trained from scratch

Not exactly. They mention starting from the VAE from Stable Diffusion XL and the Transformer from Phi3.

Looks like these LLMs can really be used for anything

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#17
This looks promising. I love how you can reference uploaded images with markup - this is exactly what the field needs more of. After spending the last two weeks generating thousands of album cover images using DALL-E and being generally disappointed with the results (especially with the variations feature of DALL-E 2), I'm excited to give this a try.

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#18
I am working on a API to generate avatars/profile pics based on a prompt. I tried looking for train my own model bt I think it's a titanic task and impossible to do it myself. Is my best solution use an external API and then crop the face for what was generated?

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#19
post #11

With consistent representation of characters, are we now on the precipice of a Cambrian explosion of manga/graphic novels/comics?

I sure hope so - at the very least I will use it for tabletop illustrations instead of having to describe a party's scenario result - I can give them a character-accurate image showing their success (or epic lack thereof).

Re: Show HN: AI OmniGen – AI Image Generator with Consistent Visuals

#20
post #18

I am working on a API to generate avatars/profile pics based on a prompt. I tried looking for train my own model bt I think it's a titanic task and impossible to do it myself. Is my best solution use an external API and then crop the face for what was generated?

The simplest commercial product for finetuning your own model is probably Adobe firefly, although there’s no API access support yet. But there are cheap and only slightly more involved options like Replicate or Civit.ai. Replicate has solid API support.

Check out:

https://replicate.com/blog/fine-tune-flux

Post reply on HN