Xian Liu

Ph.D. Candidate
Department of Information Engineering
The Chinese University of Hong Kong

E-mail  /  CV  /  Google Scholar  /  Github  /  Twitter

Biography

Xian Liu is a third-year Ph.D. at CUHK Multimedia Laboratory (MMLab). He is supervised by Prof. Dahua Lin and Prof. Ziwei Liu, working closely with Prof. Xihui Liu. His research interests include computer vision and generative modeling, especially the Image/Video/3D/4D generation and their large-scale foundation models. He is fortunate to have internships at serveral leading research institutions, including NVIDIA Research, Snap Research, Tencent AI Lab, SenseTime Research, and Shanghai AI Lab.

Before that, he received the Bachelor's degree at Zhejiang University in 2021, advised by Prof. Xiaowei Zhou.

I am always open to discussions and collaborations, feel free to drop me an email if you are interested in :)

I will be on job market since 2024 Fall (graduate in 2025 Summer), and am actively looking for post-doctoral scholar and full-time research scientist positions. Feel free to schedule a casual chat if our research match :)

News

  • [03/2024] Start my internship at NVIDIA Research. See you in Santa Clara!
  • [03/2024] I will intern at GenAI Team @ Meta AI Research in 2024 Fall with Licheng Yu. See you in Menlo Park!
  • [03/2024] Two papers are accepted to CVPR 2024. See you in Seattle, USA!
  • [01/2024] One paper is accepted to ICLR 2024.
  • [11/2023] I will intern at Deep Imagination Research @ NVIDIA Research in 2024 Spring with Ming-Yu Liu. See you in Santa Clara!
  • [11/2023] A high-quality 3D human generation framework HumanGaussian is released, with all the code and models available!
  • [10/2023] A hyper-realistic human generation foundation model HyperHuman collaborated with Snap Research is on arXiv!
  • [07/2023] One paper is accepted to ICCV 2023.
  • [05/2023] Start my internship at Snap Research. See you in Los Angeles!
  • [03/2023] Two papers are accepted to CVPR 2023.
  • [03/2023] One paper is accepted to TMLR 2023.
  • [09/2022] One paper is accepted to NeurIPS 2022, with ANGIE accepted as Spotlight presentation!
  • [07/2022] Three papers are accepted to ECCV 2022, with SSP-NeRF accepted as Oral presentation!
  • [03/2022] One paper is accepted to CVPR 2022.
  • [12/2021] One paper is accepted to AAAI 2022.

Preprints

TC4D: Trajectory-Conditioned Text-to-4D Generation
Sherwin Bahmani*, Xian Liu*, Yifan Wang*, Ivan Skorokhodov, Victor Rong, Ziwei Liu, Xihui Liu, Jeong Joon Park, Sergey Tulyakov, Gordon Wetzstein, Andrea Tagliasacchi, David B. Lindell.
Preprint. Under review.
BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion
Xuan Ju, Xian Liu, Xintao Wang, Yuxuan Bian, Ying Shan, Qiang Xu.
Preprint. Under review.

Selected Publications [ Full List ] (* indicates equal contribution)

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting
Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
TextCraft: Your Text Encoder Can be Image Quality Controller
Yanyu Li, Xian Liu, Anil Kag, Ju Hu, Yerlan Idelbayev, Dhritiman Sagar, Yanzhi Wang, Sergey Tulyakov, Jian Ren.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
CVPR 2024 / More to come. Stay tuned!
HyperHuman: Hyper-Realistic Human Generation with Latent Structural Diffusion
Xian Liu, Jian Ren, Aliaksandr Siarohin, Ivan Skorokhodov, Yanyu Li, Dahua Lin, Xihui Liu, Ziwei Liu, Sergey Tulyakov.
International Conference on Learning Representations (ICLR), 2024.
Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation
Xian Liu, Yinghao Xu, Qianyi Wu, Hang Zhou, Wayne Wu, Bolei Zhou.
European Conference on Computer Vision (ECCV), 2022. (Oral Presentation, Top 2.7%)
Audio-Driven Co-Speech Gesture Video Generation
Xian Liu, Qianyi Wu, Hang Zhou, Yuanqi Du, Wayne Wu, Dahua Lin, Ziwei Liu.
Advances in Neural Information Processing Systems (NeurIPS), 2022. (Spotlight Presentation)
Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation
Xian Liu, Qianyi Wu, Hang Zhou, Yinghao Xu, Rui Qian, Xinyi Lin, Xiaowei Zhou, Wayne Wu, Bo Dai, Bolei Zhou.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
Also appears at CVPR 2022 Sight and Sound Workshop. [5-min Invited Talk] (link)
Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generation
Xian Liu*, Lingting Zhu*, Xuanyu Liu, Rui Qian, Ziwei Liu, Lequan Yu.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
Visual Sound Localization in the Wild by Cross-Modal Interference Erasing
Xian Liu*, Rui Qian*, Hang Zhou*, Di Hu, Weiyao Lin, Ziwei Liu, Bolei Zhou, Xiaowei Zhou.
AAAI Conference on Artificial Intelligence (AAAI), 2022.
Object-Compositional Neural Implicit Surfaces
Qianyi Wu, Xian Liu, Yuedong Chen, Kejie Li, Chuanxia Zheng, Jianfei Cai, Jianmin Zheng.
European Conference on Computer Vision (ECCV), 2022.
ChemSpacE: Toward Steerable and Interpretable Chemical Space Exploration
Yuanqi Du, Xian Liu, Shengchao Liu, Jieyu Zhang, Bolei Zhou.
Transactions on Machine Learning Research (TMLR), 2023.
Also appears at ICLR 2022 MLDD Workshop, ELLIS 2021 MLMD Workshop. (Oral Presentation)

Experiences

Generative AI Research Intern, Deep Imagination Research, NVIDIA Research.
Mar. 2024 - Now
Topic: Image/Video Generation Foundation Model.
Supervised by: Ting-Chun Wang, Ming-Yu Liu.
Research Intern, Tencent AI Laboratory.
Sept. 2023 - Mar. 2024
Topic: Text-Driven 3D Human Generation.
Supervised by: Xiaohang Zhan, Ying Shan.
Research Intern, Creative Vision Group, Snap Research.
May. 2023 - Sept. 2023
Topic: Human Generation Foundation Model.
Research Intern, Digital Content Group, Shanghai AI Laboratory.
Jul. 2021 - Feb. 2022
Topic: Digital Human, Gesture Generation.
Supervised by: Bo Dai.
Research Intern, Intelligent Video Group, SenseTime Research.
Aug. 2020 - Jun. 2021
Topic: Digital Human, Face Animation.
Supervised by: Wayne Wu.

Invited Talks

Professional Services

  • Conference Reviewer for CVPR (2022-2024), ECCV (2022-2024), ICCV (2023), SIGGRAPH (2024), SIGGRAPH Asia (2022, 2023), NeurIPS (2022, 2023), ICML (2022-2024), ICLR (2023, 2024), AAAI (2022-2024).
  • Journal Reviewer for IJCV, TVCG.

Selected Honors & Awards

  • ICLR Travel Award.
    2024
  • National Scholarship.
    2019, 2020
  • Hong Kong Ph.D. Fellowship Scheme (HKPFS).
    2021- 2025
  • Outstanding Graduate of Zhejiang Province.
    2021
  • Outstanding Bachelor Thesis Award of Zhejiang University, Top 1%.
    2021
  • He Zhijun Scholarship.
    2020
  • SenseTime Scholarship.
    2020
  • Tang Lixin Scholarship.
    2019
  • First Class Scholarship for Academic Excellence.
    2019, 2020

Teaching Experience

  • ENGG 1120, Linear Algebra for Engineers.
    Spring 2022.
  • ENGG 2440, Discrete Mathematics for Engineers.
    Fall 2021.