Yuming Jiang 姜瑜铭
Research Scientist
Alibaba DAMO Academy
Email: yumingj80 at gmail.com
Google Scholar / GitHub / LinkedIn / Twitter

About me

I am currently a Research Scientist at Alibaba DAMO Academy, working closely with Dr. Lidong Bing and Dr. Xin Li. I obtained my Ph.D. degree from MMLab@NTU, Nanyang Technological University, supervised by Prof. Ziwei Liu and Prof. Chen Change Loy. I got my bachelor degree in computer science from Yingcai Honors College, University of Electronic Science and Technology of China (UESTC). I am awareded Google PhD Fellowship in 2022. My research interests include image generation, manipulation and restoration.

Publications

ReVersion: Diffusion-Based Relation Inversion from Images

Ziqi Huang*, Tianxing Wu*, Yuming Jiang, Kelvin C.K. Chan, Ziwei Liu

SIGGRAPH Asia (Conference Track), 2024

PDF / Project Page / Code
VideoBooth: Diffusion-based Video Generation with Image Prompts

Yuming Jiang, Tianxing Wu, Shuai Yang, Chenyang Si, Dahua Lin, Yu Qiao, Chen Change Loy, Ziwei Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

PDF / Project Page / Code / Demo
VBench: Comprehensive Benchmark Suite for Video Generative Models

Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin, Yu Qiao, Ziwei Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

PDF / Project Page / Code / Demo
FreeU: Free Lunch in Diffusion U-Net

Chenyang Si, Ziqi Huang, Yuming Jiang, Ziwei Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

PDF / Project Page / Code / Demo
Talk-to-Edit: Fine-Grained 2D and 3D Facial Editing via Dialog

Yuming Jiang, Ziqi Huang, Tianxing Wu, Xingang Pan, Chen Change Loy, Ziwei Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF / Project Page
Generative Networks

Ziwei Liu, Shuai Yang, Yuming Jiang, Ziqi Huang

Handbook of Face Recognition, Third Edition, 2023

PDF
FreeInit: Bridging Initialization Gap in Video Diffusion Models

Tianxing Wu, Chenyang Si, Yuming Jiang, Ziqi Huang, Ziwei Liu

arXiv, 2023

PDF / Project Page / Code / Demo
LaVie: High-Quality Video Generation with Cascaded Latent Diffusion Models

Yaohui Wang, Xinyuan Chen, Xin Ma, Shangchen Zhou, Ziqi Huang, Yi Wang, Ceyuan Yang, Yinan He, Jiashuo Yu, Peiqing Yang, Yuwei Guo, Tianxing Wu, Chenyang Si, Yuming Jiang, Cunjian Chen, Chen Change Loy, Bo Dai, Dahua Lin, Yu Qiao, Ziwei Liu

arXiv, 2023

PDF / Project Page / Code
ReliTalk: Relightable Talking Portrait Generation from a Single Video

Haonan Qiu, Zhaoxi Chen, Yuming Jiang, Hang Zhou, Xiangyu Fan, Lei Yang, Wayne Wu, Ziwei Liu.

International Journal of Computer Vision (IJCV), 2024

PDF / Project Page / Code / Demo
Text2Performer: Text-Driven Human Video Generation

Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu

International Conference on Computer Vision (ICCV), 2023

PDF / Project Page / Code
UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation

Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Wayne Wu, Ziwei Liu

International Conference on Computer Vision (ICCV), 2023

PDF / Project Page
Collaborative Diffusion for Multi-Modal Face Generation and Editing

Ziqi Huang, Kelvin C.K. Chan, Yuming Jiang, Ziwei Liu

IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

PDF / Project Page / Code
Reference-based Image and Video Super-Resolution via C2-Matching

Yuming Jiang, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Ziwei Liu

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

PDF / Code
Text2Human: Text-Driven Controllable Human Image Generation

Yuming Jiang, Shuai Yang, Haonan Qiu, Wayne Wu, Chen Change Loy,
Ziwei Liu

ACM Transactions on Graphics (SIGGRAPH), 2022

PDF / Project Page / Code / Dataset
StyleGAN-Human: A Data-Centric Odyssey of Human Generation

Jianglin Fu*, Shikai Li*, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy, Wayne Wu, Ziwei Liu

European Conference on Computer Vision (ECCV), 2022

PDF / Project Page / Code
StyleFaceV: Face Video Generation via Decomposing and Recomposing Pretrained StyleGAN3

Haonan Qiu, Yuming Jiang, Hang Zhou, Wayne Wu, Ziwei Liu.

arXiv, 2022

PDF / Project Page / Code
Talk-to-Edit: Fine-Grained Facial Editing via Dialog

Yuming Jiang*, Ziqi Huang*, Xingang Pan, Chen Change Loy, Ziwei Liu

International Conference on Computer Vision (ICCV), 2021

PDF / Project Page / Code / Dataset
Robust Reference-based Super-Resolution via C2-Matching

Yuming Jiang, Kelvin C.K. Chan, Xintao Wang, Chen Change Loy, Ziwei Liu
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

PDF / Project Page / Code / Dataset
JointRCNN: A Region-based Convolutional Neural Network for Optic Disc and Cup Segmentation

Yuming Jiang, Lixin Duan, Jun Cheng, Zaiwang Gu, Hu Xia, Huazhu Fu, Changsheng Li and Jiang Liu
IEEE Transactions on Biomedical Engineering (TBME), 2019

PDF
Optic Disc and Cup Segmentation with Blood Vessel Removal from Fundus Images for Glaucoma Detection

Yuming Jiang, Hu Xia, Yanwu Xu, Jun Cheng, Huazhu Fu, Lixin Duan, Zhigang Meng and Jiang Liu
International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2018

PDF

Professional Service

  • Conference Reviewer: CVPR 2024, AAAI 2024, SIGGRAPH Asia 2023, NeurIPS 2023, ICCV 2023, ICML 2023, CVPR 2023, ICLR 2023, AAAI 2023, NeurIPS 2022, ECCV 2022, AAAI 2022, ICCV 2021, CVPR 2021, AAAI 2021
  • Journal Reviewer: IJCV, TIP, TMI, Neurocomputing
  • Honors and Awards

  • ICLR Notable Reviewer, 2023
  • Google PhD Fellowship, 2022
  • NTU Research Scholarship, 2021
  • The Most Outstanding Students Award of UESTC (10 awardees per year), 2019
  • Sichuan Provincial Outstanding Graduates, 2019
  • Outstanding Undergraduate Thesis Award, 2019
  • National Scholarship, 2016, 2017, 2018
  • Tanglixin Scholarship, 2017
  • Shiqiang Scholarship, 2017
  • Meritorious Winner in the Interdisciplinary Contest in Modeling (ICM), 2017
  • Teaching

  • Teaching Assistant: CE1115 Introduction to Data Science & Artificial Intelligence, NTU, 2021 Spring
  • Teaching Assistant: CE2101 Algorithm Design & Analysis, NTU, 2022 Spring
  • Teaching Assistant: AI6126 Advanced Computer Vision, NTU, 2022 Spring
  • Teaching Assistant: CE7454 Deep Learning for Data Science, NTU, 2022 Fall
  • Teaching Assistant: AI6126 Advanced Computer Vision, NTU, 2023 Spring