DEEPFAKES
Swapping heads in the wild.
“We’re introducing the Head Swapper (HeSer) that enables quick head swapping in the wild with two delicately designed modules. First, the Head2Head Aligner is designed to holistically transfer posture and facial expression information from target to source head by learning multi-scale information .Secondly, to solve the problems associated with variations in skin color and mismatch of the background of the head in the replacement procedure, the Head2Scene blender is introduced, which simultaneously changes the skin color of the face and fills in inappropriate gaps in the background around the head. In particular, seamless blending is achieved using the procedure creating a semantically driven UNet color and blending reference.”
abs: https://arxiv.org/abs/2204.13100
project page: https://jmliu88.github.io/HeSer
The code is promised later:
https://github.com/jmliu88/heser