Stars
Implementation of SoundStorm, Efficient Parallel Audio Generation from Google Deepmind, in Pytorch
[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers
creates live link app blendshape data formated in csv from video, for facial motion capture
This repo equips the official CLIFF [ECCV 2022 Oral] with better detector, better tracker. Support multi-person, motion interpolation, motion smooth and SMPLify fitting.
Code and dataset for photorealistic Codec Avatars driven from audio
OpenTMA: support text-motion alignment for HumanML3D, Motion-X, and UniMoCap
Official PyTorch implementation of the paper "TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis" ICCV 2023
PantoMatrix: Generating Face and Body Animation from Speech
[CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"
DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Models (IJCAI 2023) | The DiffuseStyleGesture+ entry to the GENEA Challenge 2023 (ICMI 2023, Reproducibility A…
Code for CVPR 2024 paper: ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesis
This is the official repository for TalkSHOW: Generating Holistic 3D Human Motion from Speech [CVPR2023].
Freeform Body Motion Generation from Speech
DECA: Detailed Expression Capture and Animation (SIGGRAPH 2021)
[CVPR'24] DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
This is the codebase for SHOW in Generating Holistic 3D Human Motion from Speech [CVPR2023],
OpenXRLab Multi-view Motion Capture Toolbox and Benchmark
OpenMMLab Pose Estimation Toolbox and Benchmark.
A multi GPU audio to face animation AI model trainer for your iPhone ARKit data.
Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identity (SIGGRAPH Asia 2020)
Official Implementation of AQ-GT: a Temporally Aligned and Quantized GRU-Transformer for Co-Speech Gesture Synthesis with the extension (AQ-GT-A) from the paper Augmented Co-Speech Gesture Generati…
[ICCV 2023] PyTorch Implementation of "MotionBERT: A Unified Perspective on Learning Human Motion Representations"