Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

LivePortrait: A fast, controllable portrait animation model

github.com

Post reply on HN
Print view View original

1–10 of 30 posts

LivePortrait: A fast, controllable portrait animation model

#1

Post by cleardusk »

We are excited to announce the release of our video-driven portrait animation model! This model can vividly animate a single portrait, achieving a generation speed of 12.8ms on an RTX 4090 GPU with `torch.compile` from PyTorch. And, we are actively updating and improving this repo!

Related Resources: - Homepage: https://liveportrait.github.io

- Paper: https://arxiv.org/abs/2407.03168

- Code: https://github.com/KwaiVGI/LivePortrait

- Jupyter: https://github.com/camenduru/LivePortrait-jupyter

- ComfyUI: https://github.com/kijai/ComfyUI-LivePortraitKJ and https://github.com/shadowcz007/comfyui-liveportrait

We hope you give it a try and enjoy!

LivePortrait: A fast, controllable portrait animation model
github.com

Re: LivePortrait: A fast, controllable portrait animation model

#6

Post by smusamashah »

This is amazing. I can immediately see it being used by StableDiffusion and other generative image communities. It gives life to those lifeless faces and it doesn't look outstandingly odd. Not to my eyes at least.

Edit: it's definitely being used already https://www.reddit.com/r/StableDiffusion/comments/1dvepjx/li...

Re: LivePortrait: A fast, controllable portrait animation model

#10

Post by vergessenmir »

smusamashah wrote: post #6

This is amazing. I can immediately see it being used by StableDiffusion and other generative image communities. It gives life to those lifeless faces and it doesn't look outstandingly odd. Not to my eyes at least. Edit: it's definitely being used already https://www.reddit.com/r/StableDiffusion/comments/1dvepjx/li...

It will allow for more realistic emotions in current SD Model merges and fine tunes by generating frames correctly labelled with their associated emotions.

Most SD1.x/SDXL models images depict humans with the same expression so the frames generated by LivePortrait will help with training datasets.

I believe the Pixar animators in Toy Story 1 used facial expressions /emotions database called F.A.C.S to make the characters more humanly relatable.

It's not clear if the "expressions" will generalise to new faces

Post reply on HN