Shiyan Jiang

Agora's AI digital human technology leader

Jiang Shiyan, currently the technical leader of AI Digital Human, focuses on the technology development and innovative application of 2D and 3D digital human. He has led and deeply participated in the whole process of development from algorithm design to product landing of Soundnet digital human project, and has achieved remarkable results in several technical fields. In the field of 2D digital human, through the technological breakthrough of voice-driven character image, natural and smooth mouth synchronization and dynamic expression generation have been realized, greatly enhancing the expressiveness and realism of the virtual image. In the field of 3D virtual digital human, a set of real-time mapping model from audio to expression wash has been constructed, using which the virtual Avatar can be accurately driven, providing a high-quality solution for real-time interactive scenes. In addition, in the field of 3D realistic digital human, using 3D Gaussian Splatting technology, we successfully realized multi-view angle and high fidelity virtual image generation, which further promotes the application of digital human in the fields of film and television, games and virtual reality.