Wayne (Wen-Yan) Wu

Associate Director of R&D @ XR-Lab & SmartVideo Group, SenseTime Group Inc.

Adjunct Research Scientist @ XR-Research Group, Shanghai AI Lab.

wayne_wu.jpg

Hey, thanks for stopping by! ūüėĄ

I am currently an Associate Director of R&D at SenseTime Group Inc., working with Chen Qian and Xiaogang Wang, where I lead the product, research and development of XR-Lab and SmartVideo Group with 50+ members. Also, I am an Adjunct Research Scientist at Shanghai AI Laboratory, where I lead the group of XR-Research.

Previously, I obtained my PhD in the BNRist Center, Department of Computer Science and Technology at Tsinghua University, under the supervision of Qiang Zhou and Yici Cai. During my PhD, I spent wonderful times as a visiting PhD student at MMLab@NTU at Nanyang Technological University in 2019, advised by Chen Change Loy. Prior to that, I had the pleasure to join SenseTime Research as an intern in 2016.

My research interests lie at the intersection of Computer Vision, Computer Graphics and XR, with focus on generative model, neural rendering and digital human.

** Job positions are open for talented researchers and interns at SenseTime and Shanghai AI Lab! **

** Joint programs of PhD and PostDoc at NTU and HKUST are open! **

News

Oct, 2022 We are starting OpenXDLab, a new large-scale open-source project for datasets of XR research! ūüĒ•
Sep, 2022 We released XRNeRF, OpenXRLab‚Äôs Neural Radiance Field (NeRF) Toolbox! ūüĒ•
Sep, 2022 1 paper got accepted by NeurIPS 2022.
Jul, 2022 5 papers got accepted by ECCV 2022.
May, 2022 2 papers got accepted by SIGGRAPH 2022.
Mar, 2022 3 papers got accepted by CVPR 2022.
Jul, 2021 6 papers got accepted by CVPR/ICCV/NeurIPS in 2021.
Aug, 2020 We are organizing DeeperForensics Challenge on Real-World Face Forgery Detection, ECCV 2020.
Aug, 2020 We are organizing Workshop on Sensing, Understanding and Synthesizing Humans, ECCV 2020.
Jul, 2020 5 papers got accepted by CVPR/ECCV/NeurIPS in 2020.
Jul, 2020 We released MMAction2, OpenMMLab’s Next Generation Action Understanding Toolbox.
Jul, 2020 We released MMEditing, OpenMMLab’s Image and Video Editing Toolbox.

Selected Publications

  1. Generalizable Neural Performer: Learning Robust Radiance Fields for Human Novel View Synthesis
    Wei Cheng, Su Xu, Jingtan Piao, Chen Qian,  Wayne Wu, Kwan-Yee Lin, and Hongsheng Li
    Technical report, arXiv:2204.11798, 2022
  2. HG3D: 3D-Aware Human Image Generation
    Zhuoqian Yang, Shikai Li,  Wayne Wu, and Bo Dai
    Technical report, arXiv:xxxx.xxxxx, 2022
  3. StyleGAN-Human: A Data-Centric Odyssey of Human Generation
    Jianglin Fu, Shikai Li, Yuming Jiang, Kwan-Yee Lin, Chen Qian, Chen Change Loy,  Wayne Wu, and Ziwei Liu
    European Conference on Computer Vision (ECCV), 2022
  4. CelebV-HQ: A Large-Scale Video Facial Attributes Dataset
    Hao Zhu,  Wayne Wu, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2022
  5. Text2Human: Text-Driven Controllable Human Image Generation
    Yuming Jiang, Shuai Yang, Haonan Qiu,  Wayne Wu, Chen Change Loy, and Ziwei Liu
    ACM Transaction on Graphics (SIGGRAPH), 2022
  6. TransEditor: Transformer-Based Dual-Space GAN for Highly Controllable Facial Editing
    Yanbo Xu, Yueqin Yin, Liming Jiang, Qianyi Wu, Chengyao Zheng, Chen Change Loy, Bo Dai, and Wayne Wu
    Conference on Computer Vision and Pattern Recognition (CVPR), 2022
  7. Focal Frequency Loss for Image Reconstruction and Synthesis
    Liming Jiang, Bo Dai,  Wayne Wu, and Chen Change Loy
    International Conference on Computer Vision (ICCV), 2021
  8. Everything’s Talkin’: Pareidolia Face Reenactment
    Linsen Song,  Wayne Wu, Chaoyou Fu, Chen Qian, Chen Change Loy, and Ran He
    Conference on Computer Vision and Pattern Recognition (CVPR), 2021
  9. MEAD: A Large-Scale Audio-Visual Dataset for Emotional Talking-Face Generation
    Kaisiyuan Wang, Qianyi Wu, Linsen Song, Zhuoqian Yang,  Wayne Wu, Chen Qian, Ran He, Yu Qiao, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2020
  10. DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery Detection
    Liming Jiang, Ren Li,  Wayne Wu, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
  11. TransMoMo: Invariance-Driven Unsupervised Video Motion Retargeting
    Zhuoqian Yang, Wentao Zhu,  Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2020
  12. TransGaGa: Geometry-Aware Unsupervised Image-to-Image Translation
    Wayne Wu, Kaidi Cao, Cheng Li, Chen Qian, and Chen Change Loy
    Conference on Computer Vision and Pattern Recognition (CVPR), 2019
  13. ReenactGAN: Learning to Reenact Faces via Boundary Transfer
    Wayne Wu, Yunxuan Zhang, Cheng Li, Chen Qian, and Chen Change Loy
    European Conference on Computer Vision (ECCV), 2018
  14. Look at Boundary: A Boundary-Aware Face Alignment Algorithm
    Wayne Wu, Chen Qian, Shuo Yang, Quan Wang, Yici Cai, and Qiang Zhou
    Conference on Computer Vision and Pattern Recognition (CVPR), 2018