I am now an Associate Professor at Division of Arts and Machine Creativity (AMC) and Division of Emerging Interdisciplinary Areas (EMIA) with the Hong Kong University of Science and Technology (HKUST). Previously, I worked as an Associate Professor at Sun Yat-sen University, and an applied research scientist at Tencent, solving real-world problems using computer vision and machine learning techniques. Prior to Tencent, I worked for Amazon (A9) in Palo Alto, California, where I developed deep models for better visual search experience. Before that, I worked as a research scientist in Tencent AI Lab. The techniques I have developed/involved have been shipped to several products in Tencent such as WeChat, QQ, Tencent Video, and myapp. I received the Ph.D. degree from Imperial College London, UK, 2016, M.E. degree from Institute of Automation, Chinese Academy of Sciences, China, 2012 and B.E. degree from Huazhong University of Science and Technology, China, 2009. I have published over 80 peer-reviewed papers, most of which are published in top-tier conferences and journals, like ICML, NeurIPS, CVPR, ICCV, ECCV, AAAI, ACL, ACMMM, ICLR, TPAMI, AI, IJCV, TIP. I received the CVPR 2019 Best Paper Nominee and was awarded the 2022 ACM China Rising Star Award (Guangzhou Chapter). I have been elected among Top 2% Scientists worldwide (2023 & 2024) by Stanford/Elsevier. [CV]
Research
I conduct research on creative AI. Specifically, my current research focuses on several topics, such as image/video synthesis and enhancement.
Updates
- 2024/10: Awarded the CCF-Tencent Rhino-Bird Faculty Fund Excellence Award, see the news.
- 2024/09: Two Papers accepted by NeurIPS 2024.
- 2024/09: Elected among Stanford/Elsevier Top 2% Scientists List 2024.
- 2024/09: Paper to appear in TKDE.
- 2024/09: Paper to appear in IJCV.
- 2024/08: Paper to appear in TCSVT.
- 2024/07: Paper accepted by ACM MM 2024.
- 2024/07: Four papers accepted by ECCV 2024.
- 2024/06: Invited to serve as Senior Program Committe member (SPC) for AAAI 2025.
- 2024/05: Invited to serve as Area Chair for BMVC 2024.
- 2024/05: Paper accepted by ICML 2024.
- 2024/04: Our team win two championship awards in the two tracks of NTIRE 2024 challenges (Bracketing Image Restoration and Enhancement Challenge - Track 1 & 2) in conjunction with CVPR2024, see the award.
- 2024/04: Paper to appear in IEEE TGRS.
Publications [Full List]
(* indicates equal contribution, # indicates correspondence)
-
Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attention,
Peng Li, Yuan Liu, Xiaoxiao Long, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wenhan Luo, Ping Tan, Wenping Wang, Qifeng Liu, Yike Guo,
Neural Information Processing Systems (NeurIPS), 2024.
-
Discovering Sparsity Allocation for Layer-wise Pruning of Large Language Models,
Lujun Li, Peijie Dong, Zhenheng Tang, Xiang Liu, Qiang Wang, Wenhan Luo, Wei Xue, Qifeng Liu, Xiaowen Chu, Yike Guo,
Neural Information Processing Systems (NeurIPS), 2024.
-
DREAM: Domain-agnostic Reverse Engineering Attributes of Black-box Model,
Rongqing Li, Jiaqi Yu, Changsheng Li, Wenhan Luo, Ye Yuan, Guoren Wang,
IEEE Transactions on Knowledge and Data Engineering (TKDE), to appear.
-
APPTracker+: Displacement Uncertainty for Occlusion Handling in Low-Frame-Rate Multiple Object Tracking,
Tao Zhou, Qi Ye, Wenhan Luo, Haizhou Ran, Zhiguo Shi, Jiming Chen,
International Journal of Computer Vision (IJCV), to appear.
-
Blind Face Video Restoration with Temporal Consistent Generative Prior and Degradation-Aware Prompt,
Jingfan Tan, Hyunhee Park, Ying Zhang, Tao Wang, Kaihao Zhang, Xiangyu Kong, Pengwen Dai, Zikun Liu, Wenhan Luo#,
The 32rd ACM International Conference on Multimedia (ACM MM), 2024.
-
OMG: Occlusion-friendly Personalized Multi-concept Generation In Diffusion Models,
Zhe Kong, Yong Zhang#, Tianyu Yang, Tao Wang, Kaihao Zhang, Bizhu Wu, Guanying Chen, Wei Liu, Wenhan Luo#,
European Conference on Computer Vision (ECCV), 2024.
-
Prompting Future Driven Diffusion Model for Hand Motion Prediction,
Bowen Tang, Kaihao Zhang#, Wenhan Luo#, Wei Liu, Hongdong Li,
European Conference on Computer Vision (ECCV), 2024.
-
Auto-GAS: Automated Proxy Discovery for Training-free Generative Architecture Search,
Lujun Li, Haosen Sun, Shiwen Li, Peijie Dong, Wenhan Luo, Wei Xue, Qifeng Liu, Yike Guo,
European Conference on Computer Vision (ECCV), 2024.
-
AttnZero: Efficient Attention Discovery for Vision Transformers,
Lujun Li, Zimian Wei, Peijie Dong, Wenhan Luo, Wei Xue, Qifeng Liu, Yike Guo,
European Conference on Computer Vision (ECCV), 2024.
-
DetKDS: Knowledge Distillation Search for Object Detectors,
Lujun Li, Yufan Bao, Peijie Dong, Chuanguang Yang, Anggeng Li, Wenhan Luo, Qifeng Liu, Wei Xue, Yike Guo,
International Conference on Machine Learning (ICML), 2024.
-
GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions,
Tao Wang, Kaihao Zhang, Ziqian Shao, Wenhan Luo#, Bjorn Stenger, Tong Lu, Tae-Kyun Kim, Wei Liu, Hongdong Li,
International Journal of Computer Vision (IJCV), vol. 132, pp. 4541-4563, 2024.
-
Weakly-Supervised Emotion Transition Learning for Diverse 3D Co-speech Gesture Generation,
Xingqun Qi, Jiahao Pan, Peng Li, Ruibin Yuan, Xiaowei Chi, Mengfei Li, Wenhan Luo, Wei Xue, Shanghang Zhang, Qifeng Liu, Yike Guo,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2024.
-
Context-Aware Integration of Language and Visual References for Natural Language Tracking,
Yanyan Shao, Shuting He, Qi Ye, Yuchao Feng, Wenhan Luo, Jiming Chen,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2024.
-
Aux-NAS: Exploiting Auxiliary Labels with Negligibly Extra Inference Cost,
Yuan Gao, Weizhong Zhang, Wenhan Luo, Lin Ma, Jin-Gang Yu, Gui-Song Xia, Jiayi Ma,
International Conference on Learning Representations (ICLR), 2024.
-
Punctuation-level Attack: Single-shot and Single Punctuation Can Fool Text Models,
Wenqiang Wang, Chongyang Du, Tao Wang, Kaihao Zhang, Wenhan Luo#, Lin Ma, Wei Liu, Xiaochun Cao,
Neural Information Processing Systems (NeurIPS), 2023.
-
FnF Attack: Adversarial Attack against Multiple Object Trackers by Inducing False Negatives and False Positives,
Tao Zhou, Qi Ye#, Wenhan Luo#, Kaihao Zhang, Zhiguo Shi, Jiming Chen,
Proc. of International Conference on Computer Vision (ICCV), Paris, France, 2023.
-
PRIOR: Prototype Representation Joint Learning from Medical Images and Reports,
Pujin Cheng, Li Lin, Junyan Lyu, Yijin Huang, Wenhan Luo, Xiaoying Tang,
Proc. of International Conference on Computer Vision (ICCV), Paris, France, 2023.
-
MB-TaylorFormer: Mutil-branch Efficient Transformer Expanded by Taylor Formula for Image Dehazing,
Yuwei Qiu, Kaihao Zhang, Chenxi Wang, Wenhan Luo, Hongdong Li, Zhi Jin,
Proc. of International Conference on Computer Vision (ICCV), Paris, France, 2023.
-
Homography Guided Temporal Fusion for Road Line and Marking Segmentation,
Shan Wang, Chuong Nguyen, Jiawei Liu, Kaihao Zhang, Wenhan Luo, Yanhao Zhang, Sundaram Muthu, Fahira Afzal Maken, Hongdong Li,
Proc. of International Conference on Computer Vision (ICCV), Paris, France, 2023.
-
Robust Single Image Reflection Removal Against Adversarial Attacks,
Zhenbo Song, Zhenyuan Zhang, Kaihao Zhang, Wenhan Luo#, Zhaoxin Fan, Wenqi Ren, Jianfeng Lu,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2023.
-
Benchmarking Ultra-High-Definition Low-Light Image Enhancement and A Transformer Method,
Tao Wang, Kaihao Zhang, Tianrun Shen, Wenhan Luo#, Bjorn Stenger, Tong Lu#,
Proc. of the Association for the Advancement of Artificial Intelligence (AAAI), USA, 2023. (Oral)
-
APPTracker: Improving Tracking Multiple Objects in Low-Frame-Rate Videos,
Tao Zhou, Wenhan Luo, Zhiguo Shi, Jiming Chen, Qi Ye,
The 30th ACM International Conference on Multimedia (ACM MM), 2022.
-
EDFace-Celeb-1M: Benchmarking Face Hallucination with a Million-scale Dataset,
Kaihao Zhang, Dongxu Li, Wenhan Luo, Jingyu Liu, Jiankang Deng, Wei Liu, Stefanos Zafeiriou,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 45, pp. 3968-3978, 2023.
-
Deep Image Deblurring: A Survey,
Kaihao Zhang, Wenqi Ren, Wenhan Luo, Wei-Sheng Lai, Bjorn Stenger, Ming-Hsuan Yang, Hongdong Li,
International Journal of Computer Vision (IJCV), vol. 130, pp. 2103-2130, 2022.
-
Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior,
Kaihao Zhang, Wenhan Luo#, Yanjiang Yu, Wenqi Ren, Fang Zhao, Changsheng Li, Lin Ma, Wei Liu, Hongdong Li,
International Journal of Computer Vision (IJCV), vol. 130, pp. 1754-1769, 2022.
-
Aesthetic Text Logo Synthesis via Content-aware Layout Inferring,
Yizhi Wang, Guo Pu, Wenhan Luo, Yexin Wang, Pengfei Xiong, Hongwen Kang, Zhouhui Lian,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2022.
-
Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Framework,
Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Wei Liu,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 45, pp. 1287-1293, 2023.
-
Benchmarking Ultra-High-Definition Image Super-resolution,
Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Bjorn Stenger, Wei Liu, Hongdong Li, Ming-Hsuan Yang,
Proc. of International Conference on Computer Vision (ICCV), 2021.
-
Towards Distraction-Robust Active Visual Tracking,
Fangwei Zhong, Peng Sun, Wenhan Luo, Tingyun Yan, Yizhou Wang,
International Conference on Machine Learning (ICML), 2021.
-
Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis,
Wen Liu, Zhixin Piao, Zhi Tu, Wenhan Luo, Lin Ma, Shenghua Gao,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 44, pp. 5114-5132, 2022.
-
Multiple Object Tracking: A Literature Review,
Wenhan Luo, Junliang Xing, Anton Milan, Xiaoqin Zhang, Wei Liu, Tae-Kyun. Kim,
Artificial Intelligence, vol. 293, pp. 103448, 2021.
-
Every Moment Matters: Detail-Aware Networks to Bring a Blurry Image Alive,
Kaihao Zhang, Wenhan Luo, Bjorn Stenger, Wenqi Ren, Lin Ma, Hongdong Li,
The 28th ACM International Conference on Multimedia (ACM MM), 2020. (Oral)
-
Beyond Monocular Deraining: Stereo Image Deraining via Semantic Understanding,
Kaihao Zhang, Wenhan Luo, Wenqi Ren, Jingwen Wang, Fang Zhao, Lin Ma, Hongdong Li,
European Conference on Computer Vision (ECCV), UK, 2020.
[PDF] [Dataset (zzkd)] [Code (ehl2)] [Results (yb4y)] [Github]
-
Deblurring by Realistic Blurring,
Kaihao Zhang, Wenhan Luo, Yiran Zhong, Lin Ma, Bjorn Stenger, Wei Liu, Hongdong Li,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2020. (Oral)
-
Fine-grained Image-to-Image Transformation towards Visual Recognition,
Wei Xiong, Yutong He, Yixuan Zhang, Wenhan Luo, Lin Ma, Jiebo Luo,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2020.
-
AD-VAT+: An Asymmetric Dueling Mechanism for Learning and Understanding Visual Active Tracking,
Fangwei Zhong, Peng Sun, Wenhan Luo, Tingyun Yan, Yizhou Wang,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 43, pp. 1467-1482, 2021.
-
Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesis,
Wen Liu, Zhixin Piao, Jie Min, Wenhan Luo, Lin Ma, Shenghua Gao,
Proc. of International Conference on Computer Vision (ICCV), Korea, 2019.
-
Weakly-Supervised Spatio-Temporally Grounding Natural Sentence in Video,
Zhenfang Chen, Lin Ma#, Wenhan Luo#, Kwan-Yee K Wong,
The 57th Annual Meeting of the Association for Computational Linguistics (ACL), Italy, 2019. (Oral)
-
Face Anti-Spoofing: Model Matters, So Does Data,
Xiao Yang*, Wenhan Luo*, Linchao Bao, Yuan Gao, Dihong Gong, Shibao Zheng, Zhifeng Li, Wei Liu,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2019.
-
Learning Joint Gait Representation via Quintuplet Loss Minimization,
Kaihao Zhang, Wenhan Luo, Lin Ma, Wei Liu, Hongdong Li,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2019. (Oral)
-
Residual Regression with Semantic Prior for Crowd Counting,
Jia Wan, Wenhan Luo, Baoyuan Wu, Antoni Chan, Wei Liu,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2019.
-
Learning to Compose Dynamic Tree Structures for Visual Contexts,
Kaihua Tang, Hanwang Zhang, Baoyuan Wu, Wenhan Luo, Wei Liu,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2019. (Oral & Best Paper Nominee)
-
Bi-Real Net: Binarizing Deep Network towards Real-Network Performance,
Zechun Liu, Wenhan Luo, Baoyuan Wu, Xin Yang, Wei Liu, Kwang-Ting Cheng,
International Journal of Computer Vision (IJCV), vol. 128, pp. 202-219, 2020.
-
AD-VAT: An Asymmetric Dueling Mechanism for Learning Visual Active Tracking,
Fangwei Zhong, Peng Sun, Wenhan Luo, Tingyun Yan, Yizhou Wang,
International Conference on Learning Representations (ICLR), New Orleans, USA, 2019.
-
End-to-end Active Object Tracking and Its Real-world Deployment via Reinforcement Learning,
Wenhan Luo*, Peng Sun*, Fangwei Zhong*, Wei Liu, Tong Zhang, Yizhou Wang,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 42, pp. 1317-1332, 2020.
-
Cousin Network Guided Sketch Recognition via Latent Attribute Warehouse,
Kaihao Zhang, Wenhan Luo#, Lin Ma, Hongdong Li,
Proc. of the Association for the Advancement of Artificial Intelligence (AAAI), Hawaii, USA, 2019. (Spotlight)
-
Bi-Real Net: Enhancing the Performance of 1-bit CNNs with Improved Representational Capability and Advanced Training Algorithm,
Zechun Liu, Baoyuan Wu, Wenhan Luo, Xin Yang, Wei Liu, Kwang-Ting Cheng,
European Conference on Computer Vision (ECCV), Germany, 2018.
-
End-to-end Active Object Tracking via Reinforcement Learning,
Wenhan Luo*, Peng Sun*, Fangwei Zhong, Wei Liu, Tong Zhang, Yizhou Wang,
International Conference on Machine Learning (ICML), Sweden, 2018.
-
Learning to Generate Time-Lapse Videos Using Multi-Stage Dynamic Generative Adversarial Networks,
Wei Xiong, Wenhan Luo, Lin Ma, Wei Liu, Jiebo Luo,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2018.
-
Real-Time Neural Style Transfer for Videos,
Haozhi Huang, Hao Wang, Wenhan Luo, Lin Ma, Wenhao Jiang, Xiaolong Zhu, Zhifeng Li, Wei Liu,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), USA, 2017.
-
Automatic Topic Discovery for Multi-object Tracking,
Wenhan Luo, Bjorn Stenger, Xiaowei Zhao, Tae-Kyun Kim,
Proc. of the Association for the Advancement of Artificial Intelligence (AAAI), Austin, Texas, USA, 2015. (Oral)
-
Bi-label Propagation for Generic Multiple Object Tracking,
Wenhan Luo, Tae-Kyun Kim, Bjorn Stenger, Xiaowei Zhao, Roberto Cipolla,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, 2014.
-
Unified Face Analysis by Iterative Multi-Output Random Forests,
Xiaowei Zhao, Tae-Kyun Kim, Wenhan Luo,
Proc. of IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), Columbus, Ohio, USA, 2014.
-
Single and Multiple Object Tracking Using Log-Euclidean Riemannian Subspace and Block-Division Appearance Model,
Weiming Hu, Xi Li, Wenhan Luo, Xiaoqin Zhang, Steve Maybank, Zhongfei Zhang,
IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 34, no. 12, pp. 2420-2440, 2012.