Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

LivePortrait: A fast, controllable portrait animation model

github.com

Post reply on HN
Print view View original

21–30 of 30 posts

Re: LivePortrait: A fast, controllable portrait animation model

#21

Post by vessenes »

This is .. remarkably fast. Fast as in a quick response to Microsoft’s announcement earlier this year, and as in low latency. I love it.

I’d love to see a database of facial expression videos that’s used for some sort of standardized test expression testing.. are you guys aware of one?

Re: LivePortrait: A fast, controllable portrait animation model

#23

Post by jokethrowaway »

- Fast! - Getting some unstable results, the head keeps moving up and down, just a few pixel, maybe it needs some stabilization - Single frame rendering are quite good, a bit cartoony though - No lip syncing - Head rotation is bad, it deforms the head completely

Re: LivePortrait: A fast, controllable portrait animation model

#25

Post by cleardusk »

throwaway0665 wrote: post #24

The videos on your homepage are encoded with HEVC which can't be viewed in Firefox. Please consider using an open codec like AV1.

Thanks for the reminder. The homepage is a GitHub page and does not support git lfs, so I have compressed the files as much as possible to reduce their size. We consider re-encode the mp4 files to x264, and provide a packed zip of the homepage.

Re: LivePortrait: A fast, controllable portrait animation model

#26

Post by cleardusk »

cleardusk wrote: post #25
throwaway0665 wrote: post #24

The videos on your homepage are encoded with HEVC which can't be viewed in Firefox. Please consider using an open codec like AV1.

Thanks for the reminder. The homepage is a GitHub page and does not support git lfs, so I have compressed the files as much as possible to reduce their size. We consider re-encode the mp4 files to x264, and provide a packed zip of the homepage.

I scanned the open codec page: https://en.wikipedia.org/wiki/List_of_open-source_codecs I'm a little confused, is H.265 not OPEN? :-(

Re: LivePortrait: A fast, controllable portrait animation model

#27

Post by npteljes »

cleardusk wrote: post #26
cleardusk wrote: post #25

Earlier quoted context omitted.

Thanks for the reminder. The homepage is a GitHub page and does not support git lfs, so I have compressed the files as much as possible to reduce their size. We consider re-encode the mp4 files to x264, and provide a packed zip of the homepage.

I scanned the open codec page: https://en.wikipedia.org/wiki/List_of_open-source_codecs I'm a little confused, is H.265 not OPEN? :-(

It's a bit of a mess. The implementation of a codec, that is, and encoder or a decoder can be open source, despite the format itself not being open. H265 does have open implementation, but the format itself is not open. The opposite can be true as well, there are proprietary encoders to open formats for example. Actual list of open video formats: https://en.wikipedia.org/wiki/List_of_open_file_formats#Vide...

What OP meant is that they would like an open format on the website, which, then, can be viewed in any modern browser. I think that caniuse is a good resource in this regard.

https://caniuse.com/av1

https://caniuse.com/hevc

WebM with VP9 video is a good general browser target I think:

https://caniuse.com/webm

But funnily enough, even though h264 is not open, it's a widely decoded video format as well:

https://caniuse.com/mpeg4

Re: LivePortrait: A fast, controllable portrait animation model

#29

Post by adzm »

npteljes wrote: post #27
cleardusk wrote: post #26

Earlier quoted context omitted.

I scanned the open codec page: https://en.wikipedia.org/wiki/List_of_open-source_codecs I'm a little confused, is H.265 not OPEN? :-(

It's a bit of a mess. The implementation of a codec, that is, and encoder or a decoder can be open source, despite the format itself not being open. H265 does have open implementation, but the format itself is not open. The opposite can be true as well, there are proprietary encoders to open formats for example. Actual list of open video formats: https://en.wikipedia.org/wiki/List_of_open_file_formats#Vide... What OP…

This is exactly why I am not convinced that VVC is going to be useful; seems to have little advantage over AV1, as well as being late to the party in the first place.

Re: LivePortrait: A fast, controllable portrait animation model

#30

Post by npteljes »

adzm wrote: post #29
npteljes wrote: post #27

Earlier quoted context omitted.

It's a bit of a mess. The implementation of a codec, that is, and encoder or a decoder can be open source, despite the format itself not being open. H265 does have open implementation, but the format itself is not open. The opposite can be true as well, there are proprietary encoders to open formats for example. Actual list of open video formats: https://en.wikipedia.org/wiki/List_of_open_file_formats#Vide... What OP…

This is exactly why I am not convinced that VVC is going to be useful; seems to have little advantage over AV1, as well as being late to the party in the first place.

Well yeah, they wanna rent, so they have to develop these things. It also depends on what business deals they make in the background. If the format is secured in some applications, that might cement it as a quasi-standard, which then they can leverage for further popularity.

I hope open standards keep winning. Overall, everyone wins with the infrastructure being openly accessible, especially the common folk.

Post reply on HN