Awesome Lists

Awesome_Audio-driven_Talking-Face-Generation

by KangweiiLiu

awesome listpushed about 4 years ago

A curated list of resources of audio-driven talking face generation

AI summary

Talking face generator resource list

A curated list of resources for generating talking faces based on audio input

stars
133
forks
11
watching
2
awesome list
1
entries
56
View on GitHub

Embed the badge

Show how many awesome lists link to your project. The count updates automatically.

Awesome Lists badge
Markdown
[![Awesome Lists Badge](https://awesome.facts.dev/shield/KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation/links.svg)](https://awesome.facts.dev/awesome/KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation)
HTML
<a href="https://awesome.facts.dev/awesome/KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation"><img src="https://awesome.facts.dev/shield/KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation/links.svg" alt="Awesome Lists Badge" /></a>
Image URL
https://awesome.facts.dev/shield/KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation/links.svg

What's in the list

56 links in 4 sections, with live GitHub stats.activeno commit in 2y

2D Encoder-Decoder Based

  • demo

    StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN [F Yin 2022] [arXiv]

  • demo

    Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation [Hang Zhou 2021] [CVPR]

  • project page

    Speech Driven Talking Face Generation from a Single Image and an Emotion Condition [SE Eskimez 2021] [arXiv]

    167over 3 years
  • demo

    HeadGAN: Video-and-Audio-Driven Talking Head Synthesis [MC Doukas 2021] [arXiv]

  • demo

    A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild [K R Prajwal 2020] [ACMMM]

  • demo

    Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis [KR Prajwal 2020] [CVPR]

  • demo

    Robust One Shot Audio to Video Generation [N Kumar 2020] [CVPRW]

  • demo

    Talking Face Generation by Adversarially Disentangled Audio-Visual Representation [Hang Zhou 2019] [AAAI]

  • demo

    Talking face generation by conditional recurrent adversarial network [Yang Song 2019] [IJCAI]

  • demo

    Realistic Speech-Driven Facial Animation with GANs [Konstantinos Vougioukas 2019] [IJCV]

  • demo

    Lip Movements Generation at a Glance [Lele Chen 2018] [ECCV]

  • demo

    X2Face: A network for controlling face generation using images, audio, and pose codes [Olivia Wiles 2018] [ECCV]

  • demo

    Generative Adversarial Talking Head: Bringing Portraits to Life with a Weakly Supervised Neural Network [HX Pham 2018] [arXiv]

  • demo

    You said that？ [Chung 2017] [BMVC]

Landmark Based

  • demo

    Live Speech Portraits: Real-Time Photorealistic Talking-Head Animation [YUANXUN LU 2021] [SIGGRAPH]

  • demo

    Imitating Arbitrary Talking Style for Realistic Audio-Driven Talking Face Synthesis [H Wu 2021] [ACMMM]

    278almost 5 years
  • demo

    MakeItTalk: Speaker-Aware Talking-Head Animation [YANG ZHOU 2020] [SIGGRAPH]

  • demo

    Hierarchical Cross-Modal Talking Face Generation with Dynamic Pixel-Wise Loss [Lele Chen 2019] [CVPR]

  • demo

    Synthesizing Obama: learning lip sync from audio [SUPASORN SUWAJANAKORN 2017] [SIGGRAPH]

3D Model Based

  • demo

    Everybody’s Talkin’: Let Me Talk as You Want [Linsen Song 2022] [TIFS]

  • demo

    One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning [Suzhen Wang 2022] [AAAI]

  • demo

    FaceFormer: Speech-Driven 3D Facial Animation with Transformers [Y Fan 2022] [CVPR]

  • demo

    Iterative Text-based Editing of Talking-heads Using Neural Retargeting [Xinwei Yao 2021] [ICML]

  • demo

    AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis [Yudong Guo 2021] [ICCV]

  • demo

    Audio-driven emotional video portraits [X Ji 2021] [CVPR]

  • demo

    FACIAL: Synthesizing Dynamic Talking Face with Implicit Attribute Learning [C Zhang 2021] [ICCV]

  • demo

    Flow-guided One-shot Talking Face Generation with a High-resolution Audio-visual Dataset [Z Zhang 2021] [CVPR]

  • demo

    Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion [Suzhen Wang 2021] [IJCAI]

  • demo

    MeshTalk: 3D Face Animation from Speech using Cross-Modality Disentanglement [A Richard 2021] [ICCV]

  • demo

    Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation [L Li 2021] [AAAI]

  • demo

    Text2Video: Text-driven Talking-head Video Synthesis with Phonetic Dictionary [S Zhang 2021 ] [ICASSP]

  • demo

    Neural Voice Puppetry: Audio-driven Facial Reenactment [Justus Thies 2020] [ECCV]

  • projectpage

    Audio-driven Talking Face Video Generation with Learning-based Personalized Head Pose [Ran Yi 2020] [arXiv]

    740almost 3 years
  • demo

    Talking-head Generation with Rhythmic Head Motion [Lele Chen 2020] [ECCV]

  • demo

    Audio- and Gaze-driven Facial Animation of Codec Avatars [A Richard 2020] [arXiv]

  • demo

    Text-based editing of talking-head video [OHAD FRIED 2019] [arXiv]

  • demo

    Capture, Learning, and Synthesis of 3D Speaking Styles [D Cudeiro 2019] [CVPR]

  • demo

    Visemenet: audio-driven animator-centric speech animation [YANG ZHOU 2018] [TOG]

  • demo

    Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion [TERO KARRAS 2017] [TOG]

  • demo

    A deep learning approach for generalized speech animation [SARAH TAYLOR 2017] [SIGGRAPH]

  • demo

    JALI: An Animator-Centric Viseme Model for Expressive Lip Synchronization [Pif Edwards 2016] [SIGGRAPH]

Datasets

Add a GitHub project

Missing a project or an awesome list? Paste its GitHub URL and we fetch it right away.