Awesome_Audio-driven_Talking-Face-Generation
Talking face generator resource list
A curated list of resources for generating talking faces based on audio input
A curated list of resources of audio-driven talking face generation
133 stars
2 watching
11 forks
last commit: about 4 years agoLinked from 1 awesome list
audio-driven-talking-facecontrollable-generationgenerative-adversarial-networkspaperlistspeech-driven-talking-facetalking-face-generation
Awesome Audio-driven Talking Face Generation / 2D Encoder-Decoder Based | |||
| demo | StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN [F Yin 2022] [arXiv] | ||
| demo | Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation [Hang Zhou 2021] [CVPR] | ||
| project page | 167 | over 3 years ago | Speech Driven Talking Face Generation from a Single Image and an Emotion Condition [SE Eskimez 2021] [arXiv] |
| demo | HeadGAN: Video-and-Audio-Driven Talking Head Synthesis [MC Doukas 2021] [arXiv] | ||
| demo | A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild [K R Prajwal 2020] [ACMMM] | ||
| demo | Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis [KR Prajwal 2020] [CVPR] | ||
| demo | Robust One Shot Audio to Video Generation [N Kumar 2020] [CVPRW] | ||
| demo | Talking Face Generation by Adversarially Disentangled Audio-Visual Representation [Hang Zhou 2019] [AAAI] | ||
| demo | Talking face generation by conditional recurrent adversarial network [Yang Song 2019] [IJCAI] | ||
| demo | Realistic Speech-Driven Facial Animation with GANs [Konstantinos Vougioukas 2019] [IJCV] | ||
| demo | Lip Movements Generation at a Glance [Lele Chen 2018] [ECCV] | ||
| demo | X2Face: A network for controlling face generation using images, audio, and pose codes [Olivia Wiles 2018] [ECCV] | ||
| demo | Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network [HX Pham 2018] [arXiv] | ||
| demo | You said that？ [Chung 2017] [BMVC] | ||
Awesome Audio-driven Talking Face Generation / Landmark Based | |||
| demo | Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation [YUANXUN LU 2021] [SIGGRAPH] | ||
| demo | 278 | almost 5 years ago | Imitating Arbitrary Talking Style for Realistic Audio-Driven Talking Face Synthesis [H Wu 2021] [ACMMM] |
| demo | MakeItTalk: Speaker-Aware Talking-Head Animation [YANG ZHOU 2020] [SIGGRAPH] | ||
| demo | Hierarchical Cross-Modal Talking Face Generation with Dynamic Pixel-Wise Loss [Lele Chen 2019] [CVPR] | ||
| demo | Synthesizing Obama: learning lip sync from audio [SUPASORN SUWAJANAKORN 2017] [SIGGRAPH] | ||
Awesome Audio-driven Talking Face Generation / 3D Model Based | |||
| demo | Everybody’s Talkin’: Let Me Talk as You Want [Linsen Song 2022] [TIFS] | ||
| demo | One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning [Suzhen Wang 2022] [AAAI] | ||
| demo | FaceFormer: Speech-Driven 3D Facial Animation with Transformers [Y Fan 2022] [CVPR] | ||
| demo | Iterative Text-based Editing of Talking-heads Using Neural Retargeting [Xinwei Yao 2021] [ICML] | ||
| demo | AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis [Yudong Guo 2021] [ICCV] | ||
| demo | Audio-driven emotional video portraits [X Ji 2021] [CVPR] | ||
| demo | FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning [C Zhang 2021] [ICCV] | ||
| demo | Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset [Z Zhang 2021] [CVPR] | ||
| demo | Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion [Suzhen Wang 2021] [IJCAI] | ||
| demo | MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement [A Richard 2021] [ICCV] | ||
| demo | Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation [L Li 2021] [AAAI] | ||
| demo | Text2Video: Text-driven Talking-head Video Synthesis with Phonetic Dictionary [S Zhang 2021 ] [ICASSP] | ||
| demo | Neural Voice Puppetry: Audio-driven Facial Reenactment [Justus Thies 2020] [ECCV] | ||
| projectpage | 740 | almost 3 years ago | Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose [Ran Yi 2020] [arXiv] |
| demo | Talking-head Generation with Rhythmic Head Motion [Lele Chen 2020] [ECCV] | ||
| demo | Audio- and Gaze-driven Facial Animation of Codec Avatars [A Richard 2020] [arXiv] | ||
| demo | Text-based editing of talking-head video [OHAD FRIED 2019] [arXiv] | ||
| demo | Capture, Learning, and Synthesis of 3D Speaking Styles [D Cudeiro 2019] [CVPR] | ||
| demo | Visemenet: audio-driven animator-centric speech animation [YANG ZHOU 2018] [TOG] | ||
| demo | Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion [TERO KARRAS 2017] [TOG] | ||
| demo | A deep learning approach for generalized speech animation [SARAH TAYLOR 2017] [SIGGRAPH] | ||
| demo | JALI: An Animator-Centric Viseme Model for Expressive Lip Synchronization [Pif Edwards 2016] [SIGGRAPH] | ||
Awesome Audio-driven Talking Face Generation / Datasets | |||
| project page | GRID 2006 | ||
| project page | TCD-TIMIT 2015 | ||
| project page | LRW 2016 | ||
| project page | MODALITY 2017 | ||
| project page | Voxceleb1 2017 | ||
| project page | Voxceleb2 2018 | ||
| project page | LRS2-BBC 2018 | ||
| project page | LRS3-TED 2018 | ||
| project page | 349 | over 2 years ago | HDTF 2020 |
| project page | 379 | almost 4 years ago | CREMA-D 2014 |
| project page | MSP-IMPROV 2016 | ||
| project page | RAVDESS 2018 | ||
| project page | MELD 2018 | ||
| project page | MEAD 2020 | ||
| project page | 117 | almost 6 years ago | LRW-1000 2018 |
filipecalegario/awesome-generative-ai