Wayne (Wen-Yan) Wu

wayne_wu.jpg

Hey, thanks for stopping by! 😄

I am currently a Research Scientist at Shanghai AI Laboratory, working with Dahua Lin and Chen Qian, where I am leading the group of XR-Research. Since 2019, I have been a visiting scholar at MMLab@NTU at Nanyang Technological University, working with Chen Change Loy. Previously, I was an Associate Director of R&D at SenseTime Group Inc., working with Xiaogang Wang, where I led the research and development of XR-Lab and SmartVideo Group. I obtained my PhD in the BNRist Center, Department of Computer Science and Technology at Tsinghua University.

My research interests lie at the intersection of Computer Vision, Computer Graphics and Machine Learning, with focus on the generative model, digital human and video understanding.

** Job positions are open for researchers and interns at Shanghai AI Lab! **

** Joint programs of PhD at NTU and HKUST are open! **

News

Oct, 2022 We started OpenXDLab, a new large-scale open-source project for datasets of XR research! 🔥
Sep, 2022 We released XRNeRF, OpenXRLab’s Neural Radiance Field (NeRF) Toolbox! 🔥
Sep, 2022 1 paper got accepted by NeurIPS 2022.
Jul, 2022 5 papers got accepted by ECCV 2022.
May, 2022 2 papers got accepted by SIGGRAPH 2022.
Mar, 2022 3 papers got accepted by CVPR 2022.
Jul, 2021 6 papers got accepted by CVPR/ICCV/NeurIPS in 2021.
Aug, 2020 We are organizing DeeperForensics Challenge on Real-World Face Forgery Detection, ECCV 2020.
Aug, 2020 We are organizing Workshop on Sensing, Understanding and Synthesizing Humans, ECCV 2020.
Jul, 2020 5 papers got accepted by CVPR/ECCV/NeurIPS in 2020.
Jul, 2020 We released MMAction2, OpenMMLab’s Next Generation Action Understanding Toolbox.
Jul, 2020 We released MMEditing, OpenMMLab’s Image and Video Editing Toolbox.

Selected Publications

  1. Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis
    Wei Cheng, Su Xu, Jingtan Piao, Chen Qian,  Wayne Wu, Kwan-Yee Lin, and Hongsheng Li
    Technical report, arXiv:2204.11798, 2022
    arXiv YouTube Project Page
  2. 3DHumanGAN: Towards Photo-Realistic 3D-Aware Human Image Generation
    Zhuoqian Yang, Shikai Li,  Wayne Wu, and Bo Dai
    Technical report, arXiv:2210.06551, 2022
    arXiv YouTube Project Page
  3. StyleGAN-Human: A Data-Centric Odyssey of Human Generation
    Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy,  Wayne Wu, and Ziwei Liu
    European Conference on Computer Vision (ECCV), 2022
    arXiv YouTube Project Page
  4. CelebV-HQ: A Large-Scale Video Facial Attributes Dataset
    Hao Zhu,  Wayne Wu, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2022
    arXiv YouTube Project Page
  5. Text2Human: Text-Driven Controllable Human Image Generation
    Yuming Jiang, Shuai Yang, Haonan Qiu,  Wayne Wu, Chen Change Loy, and Ziwei Liu
    ACM Transaction on Graphics (SIGGRAPH), 2022
    arXiv YouTube Project Page
  6. TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing
    Yanbo Xu, Yueqin Yin, Liming Jiang, Qianyi Wu, Chengyao Zheng, Chen Change Loy, Bo Dai, and Wayne Wu
    Conference on Computer Vision and Pattern Recognition (CVPR), 2022
    arXiv Project Page
  7. Focal Frequency Loss for Image Reconstruction and Synthesis
    Liming Jiang, Bo Dai,  Wayne Wu, and Chen Change Loy
    International Conference on Computer Vision (ICCV), 2021
    arXiv Project Page
  8. Everything’s Talkin’: Pareidolia Face Reenactment
    Linsen Song,  Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, and Ran He
    Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    arXiv YouTube Project Page
  9. MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
    Kaisiyuan Wang, Qianyi Wu, Linsen Song, Zhuoqian Yang,  Wayne Wu, Chen Qian, Ran He, Yu Qiao, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2020
    YouTube PDF Project Page
  10. DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
    Liming Jiang, Ren Li,  Wayne Wu, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    arXiv YouTube Project Page
  11. TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting
    Zhuoqian Yang, Wentao Zhu,  Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    arXiv YouTube Project Page
  12. TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation
    Wayne Wu, Kaidi Cao, Cheng Li, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2019
    arXiv YouTube Project Page
  13. ReenactGAN: Learning to Reenact Faces via Boundary Transfer
    Wayne Wu, Yunxuan Zhang, Cheng Li, Chen Qian, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2018
    arXiv YouTube Project Page
  14. Look at Boundary: A Boundary-Aware Face Alignment Algorithm
    Wayne Wu, Chen Qian, Shuo Yang, Quan Wang, Yici Cai, and Qiang Zhou
    Conference on Computer Vision and Pattern Recognition (CVPR), 2018
    arXiv YouTube Project Page