Wayne (Wen-Yan) Wu

Associate Director of R&D @ XR-Lab & SmartVideo Group, SenseTime Group Inc.

Adjunct Research Scientist @ XR-Research Group, Shanghai AI Lab.

wayne_wu.jpg

Hey, thanks for stopping by! 😄

I am currently an Associate Director of R&D at SenseTime Group Inc., working with Chen Qian and Xiaogang Wang, where I lead the product, research and development of XR-Lab and SmartVideo Group with 50+ members. Also, I am an Adjunct Research Scientist at Shanghai AI Laboratory, where I lead the group of XR-Research.

Previously, I obtained my PhD in the BNRist Center, Department of Computer Science and Technology at Tsinghua University, under the supervision of Qiang Zhou and Yici Cai. During my PhD, I spent wonderful times as a visiting PhD student at MMLab@NTU at Nanyang Technological University in 2019, advised by Chen Change Loy. Prior to that, I had the pleasure to join SenseTime Research as an intern in 2016.

My research interests lie at the intersection of Computer Vision, Computer Graphics and XR, with focus on generative model, neural rendering and digital human.

** Job positions are open for talented researchers and interns at SenseTime and Shanghai AI Lab! **

** Joint programs of PhD and PostDoc at NTU and HKUST are open! **

News

Oct, 2022 We are starting OpenXDLab, a new large-scale open-source project for datasets of XR research! 🔥
Sep, 2022 We released XRNeRF, OpenXRLab’s Neural Radiance Field (NeRF) Toolbox! 🔥
Sep, 2022 1 paper got accepted by NeurIPS 2022.
Jul, 2022 5 papers got accepted by ECCV 2022.
May, 2022 2 papers got accepted by SIGGRAPH 2022.
Mar, 2022 3 papers got accepted by CVPR 2022.
Jul, 2021 6 papers got accepted by CVPR/ICCV/NeurIPS in 2021.
Aug, 2020 We are organizing DeeperForensics Challenge on Real-World Face Forgery Detection, ECCV 2020.
Aug, 2020 We are organizing Workshop on Sensing, Understanding and Synthesizing Humans, ECCV 2020.
Jul, 2020 5 papers got accepted by CVPR/ECCV/NeurIPS in 2020.
Jul, 2020 We released MMAction2, OpenMMLab’s Next Generation Action Understanding Toolbox.
Jul, 2020 We released MMEditing, OpenMMLab’s Image and Video Editing Toolbox.

Selected Publications

  1. Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis
    Wei Cheng, Su Xu, Jingtan Piao, Chen Qian,  Wayne Wu, Kwan-Yee Lin, and Hongsheng Li
    Technical report, arXiv:2204.11798, 2022
    arXiv YouTube Project Page
  2. HG3D: 3D-Aware Human Image Generation
    Zhuoqian Yang, Shikai Li,  Wayne Wu, and Bo Dai
    Technical report, arXiv:xxxx.xxxxx, 2022
    arXiv YouTube Project Page
  3. StyleGAN-Human: A Data-Centric Odyssey of Human Generation
    Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy,  Wayne Wu, and Ziwei Liu
    European Conference on Computer Vision (ECCV), 2022
    arXiv YouTube Project Page
  4. CelebV-HQ: A Large-Scale Video Facial Attributes Dataset
    Hao Zhu,  Wayne Wu, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2022
    arXiv YouTube Project Page
  5. Text2Human: Text-Driven Controllable Human Image Generation
    Yuming Jiang, Shuai Yang, Haonan Qiu,  Wayne Wu, Chen Change Loy, and Ziwei Liu
    ACM Transaction on Graphics (SIGGRAPH), 2022
    arXiv YouTube Project Page
  6. TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing
    Yanbo Xu, Yueqin Yin, Liming Jiang, Qianyi Wu, Chengyao Zheng, Chen Change Loy, Bo Dai, and Wayne Wu
    Conference on Computer Vision and Pattern Recognition (CVPR), 2022
    arXiv Project Page
  7. Focal Frequency Loss for Image Reconstruction and Synthesis
    Liming Jiang, Bo Dai,  Wayne Wu, and Chen Change Loy
    International Conference on Computer Vision (ICCV), 2021
    arXiv Project Page
  8. Everything’s Talkin’: Pareidolia Face Reenactment
    Linsen Song,  Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, and Ran He
    Conference on Computer Vision and Pattern Recognition (CVPR), 2021
    arXiv YouTube Project Page
  9. MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
    Kaisiyuan Wang, Qianyi Wu, Linsen Song, Zhuoqian Yang,  Wayne Wu, Chen Qian, Ran He, Yu Qiao, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2020
    YouTube PDF Project Page
  10. DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
    Liming Jiang, Ren Li,  Wayne Wu, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    arXiv YouTube Project Page
  11. TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting
    Zhuoqian Yang, Wentao Zhu,  Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
    arXiv YouTube Project Page
  12. TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation
    Wayne Wu, Kaidi Cao, Cheng Li, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2019
    arXiv YouTube Project Page
  13. ReenactGAN: Learning to Reenact Faces via Boundary Transfer
    Wayne Wu, Yunxuan Zhang, Cheng Li, Chen Qian, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2018
    arXiv YouTube Project Page
  14. Look at Boundary: A Boundary-Aware Face Alignment Algorithm
    Wayne Wu, Chen Qian, Shuo Yang, Quan Wang, Yici Cai, and Qiang Zhou
    Conference on Computer Vision and Pattern Recognition (CVPR), 2018
    arXiv YouTube Project Page