Live data from Hacker News

Tuning-Free Personalized Image Generation

ai.meta.com

21–30 of 49 posts

Re: Tuning-Free Personalized Image Generation

#21
post #18
post #13

Photographic images generated by these systems tend to look like the graffiti portraits you see on fairground attractions. I've done a lot of photorealistic drawings, and the trick to make something look real, is to get the tones exactly right. Misjudge a tone a bit, and the result looks like a mediocre drawing or a painting. In other words, the gradient of skin tones is off, which is ironic, I guess. I assume that t…

It doesn’t help that RGB is very badly tuned for many skin tones.

Do these models really operate in RGB space? I would have thought that using a perceptual color space to generate images meant to be perceived by humans would be low hanging fruit.

Re: Tuning-Free Personalized Image Generation

#22

I know exactly why Facebook / Meta are researching this. Just imagine the possibilities for advertisers: Instead of telling someone how happy they would be if only they bought your expensive car, let's just spam them with AI pictures of themselves sitting in said expensive car, ideally next to some very attractive other people that match their dating preferences. Facebook has all the data they need to create very ple…

This is quite thought provoking. I can totally see ads for, say Disney World, where they put you in the picture instead of an actor. I mean, the whole goal of these ads is already to have you imagine yourself there. Putting you in the picture makes it that much easier.

Re: Tuning-Free Personalized Image Generation

#23

The future of Netflix isn't going to feature DiCaprio or Zendaya. It will be you, your wife, and your friends on the screen as hobbits adventuring to Mordor.

While this may have some appeal, I think it'll be similar to the fake Time magazine covers that made it look like someone you knew was named Time's person of the year. Good for a chuckle, but not much more.

I think applying the same idea to video games makes more sense, especially given the autonomy you have in a video game, but even then, the appeal wears off pretty quickly.

Games have had features that allow you to put your likeness in the game before, and that feature probably isn't what people we're buying the game for. Tony Hawk's Pro Skater 2 for Dreamcast allowed you to map a photograph of your face to the in game player. Odd example, but I actually just dusted off my old Dreamcast and remembered this feature the other day as the 20 year old game save had my 20 years younger face on the main character. What I recall about that experience was that for about 2 minutes it felt special, and then never thought about it again until feeling confused about why I was in the game before remembering.

Re: Tuning-Free Personalized Image Generation

#24
post #19
post #5

Earlier quoted context omitted.

This is a much bigger thing than the llama3.1 release. Llama 3.1 doesn't really help Meta's bottom line. But content creation and ads are Meta's killer app. By having a model that doesn't require finetuning, they just changed the whole game.

Where do I sign up for my personalized AI content filter bot which can reliably detect ads and remove them from my browser?

I think the future will be a web browser running inside a VM and then the final DOM including all referenced resources go through a filter before being rendered. That way, it's impossible for the website to detect if you display the ads or if you just just load all necessary resources for rendering but mask them out.

Re: Tuning-Free Personalized Image Generation

#28
post #21
post #18

Earlier quoted context omitted.

It doesn’t help that RGB is very badly tuned for many skin tones.

Do these models really operate in RGB space? I would have thought that using a perceptual color space to generate images meant to be perceived by humans would be low hanging fruit.

At the very least they ultimately output to RGB. The fleshtone part of the spectrum is quite small.

Re: Tuning-Free Personalized Image Generation

#29
post #19

Earlier quoted context omitted.

Where do I sign up for my personalized AI content filter bot which can reliably detect ads and remove them from my browser?

I think the future will be a web browser running inside a VM and then the final DOM including all referenced resources go through a filter before being rendered. That way, it's impossible for the website to detect if you display the ads or if you just just load all necessary resources for rendering but mask them out.

The future will be “AI PCs” with a powerful on-device chip that can filter out on-screen ads, but enabled only by subscription.

Re: Tuning-Free Personalized Image Generation

#30
post #21
post #18

Earlier quoted context omitted.

It doesn’t help that RGB is very badly tuned for many skin tones.

Do these models really operate in RGB space? I would have thought that using a perceptual color space to generate images meant to be perceived by humans would be low hanging fruit.

As a total cluebie on generative art, I would assume that the neural networks involved use linear weights and ReLU only. If the training data and the output are in RGB pixels, then it would be reasonable to suppose that this introduces some bias.

It may not be enough to use a perceptual color space only. The gradients in skin tones, or any other complex texture, are non-linear due to lighting and curvature.

Is there someone in the room who does know how things work, and whether this hypothesis is wrong or not?

Post reply on HN