GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
HTML-код
- Опубликовано: 3 дек 2023
- Project: shenhanqian.github.io/gaussia...
We introduce GaussianAvatars, a new method to create photorealistic head avatars that are fully controllable in terms of expression, pose, and viewpoint. The core idea is a dynamic 3D representation based on 3D Gaussian splats that are rigged to a parametric morphable face model. This combination facilitates photorealistic rendering while allowing for precise animation control via the underlying parametric model, e.g., through expression transfer from a driving sequence or by manually changing the morphable model parameters. We parameterize each splat by a local coordinate frame of a triangle and optimize for explicit displacement offset to obtain a more accurate geometric representation. During avatar reconstruction, we jointly optimize for the morphable model parameters and Gaussian splat parameters in an end-to-end fashion. We demonstrate the animation capabilities of our photorealistic avatar in several challenging scenarios. For instance, we show reenactments from a driving video, where our method outperforms existing works by a significant margin. Наука
This is incredible. Very smart to combine the different rendering pipelines to get the best of both worlds, bravo!
Amazing, can’t wait to play with this!
Ah man this won't go public anytime soon, but just another crazy mic drop from Prof. Niessner 👌🏽
dis is amazing thanks! looking forward to the source code release 😍
Wow! Quite amazing!
Wow; excellent work!
Amazing ! Game changer for avatars
The space is heating up! arxiv 2312.03029 (Gaussian Head Avatars) published at around same time, shows similar results and approach
has the gaussian head avatar code been published yet? It`s marked as public on their git but the code only consists of a readme file as of yet
Amazing project. Is there a github code to try pls?
Awwwesome mate! 🔥🔥🔥
Incredible ! !
Great job
When you guys release code ?
I'd like to try this 👍🏻
Great 👍🏻 😊
wow love it
Revolutionary.
Impressive
Great!
I literally just saw another gaussian video and I thought "couldn't you combine polygons with gaussians?" and then I saw this lol xD
When will the code be made available?
what is the software you used , control joints and expressions
I want an avatar like this of myself, how do I become part of this program?
So.. LA Noire 2? 😁
What’s happening anymore
Why do I feel an impending sense of doom for our society?
The end is just the beginning