You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please download our [pre-trained model](https://drive.google.com/drive/folders/1Wd88VDoLhVzYsQ30_qDVluQr_Xm46yHT?usp=sharing) and put it in ./checkpoints.
|checkpoints/hub | Face detection models used in [face alignment](https://github.com/1adrianb/face-alignment).
99
99
100
-
#### **Generating 2D face from a single Image**
100
+
#### Generating 2D face from a single Image
101
101
102
102
```
103
103
python inference.py --driven_audio <audio.wav> --source_image <video.mp4 or picture.png> --result_dir <a file to store results>
104
104
```
105
105
106
-
#### **Generating 3D face from Audio**
106
+
#### Generating 3D face from Audio
107
107
108
108
To do ...
109
109
110
-
#### **Generating 4D free-view talking examples from audio and a single image**
110
+
#### Generating 4D free-view talking examples from audio and a single image
111
111
112
112
We use `camera_yaw`, `camera_pitch`, `camera_roll` to control camera pose. For example, `--camera_yaw -20 30 10` means the camera yaw degree changes from -20 to 30 and then changes from 30 to 10.
If you find our work useful in your research, please consider citing:
126
126
@@ -133,19 +133,19 @@ If you find our work useful in your research, please consider citing:
133
133
}
134
134
```
135
135
136
-
Acknowledgements
137
-
----------
136
+
## 💗 Acknowledgements
137
+
138
138
Facerender code borrows heavily from [zhanglonghao's reproduction of face-vid2vid](https://github.com/zhanglonghao1992/One-Shot_Free-View_Neural_Talking_Head_Synthesis) and [PIRender](https://github.com/RenYurui/PIRender). We thank the author for sharing their wonderful code. In training process, We also use the model from [Deep3DFaceReconstruction](https://github.com/microsoft/Deep3DFaceReconstruction) and [Wav2lip](https://github.com/Rudrabha/Wav2Lip). We thank for their wonderful work.
139
139
140
140
141
-
## Related Work
141
+
## 🥂 Related Works
142
142
-[StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN (ECCV 2020)](https://github.com/FeiiYin/StyleHEAT)
143
143
-[CodeTalker: Speech-Driven 3D Facial Animation with Discrete Motion Prior (CVPR 2023)](https://github.com/Doubiiu/CodeTalker)
144
144
-[VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild (SIGGRAPH Asia 2022)](https://github.com/vinthony/video-retalking)
145
145
-[DPE: Disentanglement of Pose and Expression for General Video Portrait Editing (CVPR 2023)](https://arxiv.org/abs/2301.06281)
146
146
-[3D GAN Inversion with Facial Symmetry Prior (CVPR 2023)](https://github.com/FeiiYin/SPI/)
147
147
-[T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representations (CVPR 2023)](https://github.com/Mael-zys/T2M-GPT)
148
148
149
-
## Disclaimer
149
+
## 📢 Disclaimer
150
150
151
151
This is not an official product of Tencent. This repository can only be used for personal/research/non-commercial purposes.
0 commit comments