Yukang (Raikkonen) Cao    操雨康

Email       LinkedIn      Github      CV      WeChat    Twitter
Semantic Scholar       Google Scholar

I am currently a Ph.D. candidate in the Department of Computer Science, The University of Hong Kong (HKU) and under the supervision of Dr. Kwan-Yee K. Wong. I also work closely with Dr. Kai Han. I had the pleasure to research at Tencent ARC Lab, under the guidance of Dr. Yan-Pei Cao.

Prior to HKU, I received my B.Eng from Zhejiang University in 2020 (Rank: 3/66). I was fortunate to had valuable academic enlightenments at The University of Texas at Austin, Tsinghua University, and Peking University.

My research interests are in computer vision and machine learning. Specifically, learning-based methods for 3D human reconstruction, neural rendering, 3D human generation, etc.

profile photo

"Generated by AI"

Please feel free to contact me via Email or WeChat if you have openings; want to discuss or try ideas in 3D human generation / editing / animation; or just say hi.

News

2023-09: HeadSculpt is accepted by NeurIPS 2023.
2023-08: Guide3D is released for transferring multi-view generated images to 3D avatars. Hope this will inspire a little bit.
2023-06: HeadSculpt is released for 3D editable head generation from text.
2023-04: DreamAvatar is released for 3D controllable avatar generation from text.
2023-03: MA-NeRF for audio-driven face synthesis is accepted by ICME 2023.
2023-02: SeSDF for 3D human reconstruction from uncalibrated image(s) is accepted by CVPR 2023.
2022-03: JIFF for 3D human reconstruction from single image is accepted by CVPR 2022.
Previous Experiences

  • Dec, 2022 - Jun, 2023: Research intern at Tecent PCG, ARC Lab working with Dr. Yan-Pei Cao.
  • July, 2019 - Nov, 2019: Research student at the University of Texas, Austin working with Dr. Chandrajit Bajaj.
  • Sep, 2019 - Dec, 2019: Research student at Peking University working with Dr. Dehua Xiong.
  • July, 2018 - Oct, 2018: Research student at Tsinghua University working with Dr. Zuoqiang Shi.
Publications
(*Equal contribution, #Corresponding author)
Guide3D: Create 3D Avatars from Text and Image Guidance.
Yukang Cao, Yan-Pei Cao, Kai Han#, Ying Shan, Kwan-Yee K. Wong
Preprint, 2023
[arxiv] [Code] [BibTeX]

HeadSculpt: Crafting 3D Head Avatars with Text
Xiao Han*, Yukang Cao*, Kai Han, Xiatian Zhu, Jiankang Deng, Yi-Zhe Song, Tao Xiang#, Kwan-Yee K. Wong#
Neural Information Processing Systems (NeurIPS) 2023,
[Project Website] [arxiv] [Code] [BibTeX]

DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Models.
Yukang Cao*, Yan-Pei Cao*, Kai Han#, Ying Shan, Kwan-Yee K. Wong
Preprint, 2023
[Project Website] [arxiv] [Code] [BibTeX]

MA-NeRF: Motion-Assisted Neural Radiance Fields for Face Synthesis from Sparse Images.
Weichen Zhang*, Xiang Zhou*, Yukang Cao, Wensen Feng, Chun Yuan
IEEE International Conference on Multimedia and Expo (ICME) 2023,
[arxiv] [Code] [BibTeX]

SeSDF: Self-evolved Signed Distance Field for Implicit 3D Clothed Human Reconstruction.
Yukang Cao, Kai Han, Kwan-Yee K. Wong
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2023,
[Project Website] [arxiv] [Code] [BibTeX]

JIFF: Jointly-aligned Implicit Face Function for High Quality Single View Clothed and Human Reconstruction.
Yukang Cao, Guanying Chen, Kai Han, Wenqi Yang, Kwan-Yee K. Wong
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2022,
Oral Presentation
[Project Website] [arxiv] [Code] [BibTeX]

Teaching Experiences

  • [2022-2023 Fall] COMP 3270 Artificial Intelligence, Teaching Assistance (HKU)
  • [2021-2022 Fall] COMP 2396 Object-Oriented Programming and Java, Teaching Assistance (HKU)
Awards

  • HKU Presidential Scholarship (HKU-PS, Highest Distinction in Hong Kong) (2020-2024)
  • M. Braun Postgraduate Prize (2023)
  • The Arthur and Louise May Memorial Fund Scholarship (2022, 2023)
  • HK China Gas Co Ltd Postgraduate Prize (2022)
  • Y S and Christabel Lung Postgraduate Scholarship (2021)
  • China Harbor second-class scholarship (2017-2018)
  • Honorable Mention in the Mathematical Contest in Modeling (2018)
  • Zhejiang University Outstanding Second Class Scholarship (2016-2018)
  • Zhejiang Provincial Government Scholarship (Top Distinction in Zhejiang Province) (2016-2017)
Professional Activities

  • Conference Reviewer:
    • IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022 -
    • Conference on International Conference on Computer Vision (ICCV), 2023 -
    • Conference on Neural Information Processing Systems (NeurIPS), 2023 -
    • ACM SIGGRAPH Asia, 2023 -
    • Pacific Graphics, 2023 -
    • Association for the Advancement of Artificial Intelligence (AAAI) 2024 -
    • International Conference on Learning Representations (ICLR) 2024 -

    • Talks

    • July, 2023 at GAP Lab CUHK‑Shenzhen: “Avatar‑X: Text Guided Controllable and Editable 3D Human Avatar Generation via Diffusion Models“
    • Aug, 2023 at 智东西: "Avatar‑X: Text Guided Controllable and Editable 3D Human Avatar Generation via Diffusion Models"
    Daily Interest

    • Iracing worldwide Top 8% sim racer.
    Collaborating Specialists and Friends

    • Kai Han, Assitant Professor at HKU
    • Guanying Chen, Research Assitant Professor at CUHK-SZ
    • Yan-Pei Cao, Principal Researcher at Tencent ARC Lab and Tencent AI Lab
    • Xiao Han, PhD student at the University of Surrey

    The website template was adapted from Guanying Chen.