Yibo Yang, Ph.D.

About Me

Currently, I am a Research Scientist in King Abdullah University of Science and Technology (KAUST). I obtained my Ph.D. degree at Center for Data Science, Academy for Advanced Interdisciplinary Studies, Peking University, under the supervision of Prof. Zhouchen Lin in 2021. I have also worked as a Research Scientist in JD Explore Academy.

Research Interests

• Reliable Machine Learning
• Interpretable Neural Network
• AI for Science / Healthcare
• Unified Visual Understanding

News

• [2024/03] We won the 2023 Wuwenjun AI Science & Technology Award, First Price of Natural Science, from CAAI.
• [2024/01] One paper accepted by TPAMI.
• [2024/01] One paper accepted by IJCV.
• [2023/09] Invited to serve as an Area Chair of ICLR 2024.
• [2023/08] One paper about AI4Science and neural collapse accepted by Physical Review Letters (PRL, a flagship journal in physics).
• [2023/08] One paper accepted by International Journal of Computer Vision.
• [2023/07] One paper accepted by ICCV 2023.
• [2023/07] Two papers accepted by IEEE TCSVT and Computerized Medical Imaging and Graphics, respectively.
• [2023/03] Invited to serve as an Area Chair of NeurIPS 2023.
• [2023/02] One paper accepted by CVPR 2023.
• [2023/01] Two (one first-author) papers accepted by ICLR 2023 as spotlights.
• [2023/01] I made a talk at A*STAR-CFAR Rising Star Lecture Series, see the [post] and [slides] (available upon request).
• [2023/01] One paper accepted by Neurocomputing.
• [2022/11] One paper accepted by AAAI 2023.
• [2022/11] One paper accepted by IEEE TPAMI.
• [2022/09] Two (first-author) papers accepted by NeurIPS 2022.
• [2022/09] One paper accepted by IEEE TPAMI.
• [2022/06] Four papers accepted by ECCV 2022.
• [2022/03] One paper accepted by CVPR 2022.
• [2022/02] I won the 2021 Wuwenjun-Outstanding Ph.D. Dissertation Award from CAAI.
• [2021/11] We won the First Place Winner in Video+Depth track of BMTT 2021 challenge in ICCV 2021.
• [2021/07] I obtained my Ph.D. degree from Peking University.

Selected Publications

(*: equal contributions; #: corresponding author)

[Pre-prints]

• Towards Demystifying the Generalization Behaviors When Neural Collapse Emerges
  Gao Peifeng, Qianqian Xu, Yibo Yang, Peisong Wen, Huiyang Shao, Zhiyong Yang, Bernard Ghanem, Qingming Huang
  [arXiv:2310.08358]
  Intro: We establish a theoretical explanation for generalization improvement during the occurrence of neural collapse.

• ShadowNet for Data-Centric Quantum System Learning
  Yuxuan Du, Yibo Yang, Tongliang Liu, Zhouchen Lin, Bernard Ghanem, Dacheng Tao
  [arXiv:2308.11290]
  Intro: We propose a data-centric learning paradigm for physics problems including quantum state tomography and direct fidelity estimation.

• Neural Collapse Terminus: A Unified Solution for Class Incremental Learning and Its Variants
  Yibo Yang, Haobo Yuan, Xiangtai Li, Jianlong Wu, Lefei Zhang, Zhouchen Lin, Philip Torr, Dacheng Tao, Bernard Ghanem
  [arXiv:2308.01746]
  Intro: An extended work of our ICLR’23 paper. Inspired by neural collapse, we propose a unified method for class-incremental learning, long-tail class-incremental learning, and few-shot class-incremental learning.

• PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation
  Xiangtai Li, Shilin Xu, Yibo Yang#, Haobo Yuan, Guangliang Cheng, Yunhai Tong, Zhouchen Lin, Ming-Hsuan Yang, Dacheng Tao
  [arXiv:2301.00954]
  Intro: An extended work of our ECCV’22 paper.

[Conference Papers]

• Multi-Task Learning with Knowledge Distillation for Dense Prediction
  Yangyang Xu, Yibo Yang, Lefei Zhang
  IEEE/CVF International Conference in Computer Vision, ICCV, 2023
  [PDF]

• Understanding Imbalanced Semantic Segmentation Through Neural Collapse
  Zhisheng Zhong*, Jiequan Cui*, Yibo Yang*, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia
  IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2023
  [PDF] [Code]
  Intro: Inspired by neural collapse, we propose a method that successfully improves the performance of both image and 3D semantic segmentation.

• Neural ePDOs: Spatially Adaptive Equivariant Partial Differential Operator Based Networks
  Lingshen He, Yuxuan Chen, Zhengyang Shen, Yibo Yang, Zhouchen Lin
  International Conference on Learning Representations, ICLR 2023, spotlight
  [PDF] [Code]

• Neural Collapse Inspired Feature-Classifier Alignment for Few-Shot Class-Incremental Learning
  Yibo Yang, Haobo Yuan, Xiangtai Li, Zhouchen Lin, Philip Torr, Dacheng Tao
  International Conference on Learning Representations, ICLR 2023, spotlight
  [PDF] [Code]

• DeMT: Deformable Mixer Transformer for Multi-Task Learning of Dense Prediction
  Yangyang Xu, Yibo Yang, Lefei Zhang
  AAAI Conference on Artificial Intelligence, AAAI 2023
  [PDF] [Code]

• Towards Theoretically Inspired Neural Initialization Optimization
  Yibo Yang, Hong Wang, Haobo Yuan, Zhouchen Lin
  Advances in Neural Information Processing Systems, NeurIPS 2022
  [PDF] [Code]

• Inducing Neural Collapse in Imbalanced Learning: Do We Really Need a Learnable Classifier at the End of Deep Neural Network?
  Yibo Yang, Shixiang Chen, Xiangtai Li, Liang Xie, Zhouchen Lin, Dacheng Tao,
  Advances in Neural Information Processing Systems, NeurIPS 2022
  [PDF] [Code]

• Eliminating Gradient Conflict in Reference-based Line-art Colorization
  Zekun Li, Zhengyang Geng, Zhao Kang, Wenyu Chen, Yibo Yang
  European Conference on Computer Vision, ECCV 2022
  [PDF] [Code]

• View Vertically: A Hierarchical Network for Trajectory Prediction via Fourier Spectrums
  Conghao Wong, Beihao Xia, Ziming Hong, Qinmu Peng, Wei Yuan, Qiong Cao, Yibo Yang, Xinge You
  European Conference on Computer Vision, ECCV 2022
  [PDF] [Code]

• Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation
  Xiangtai Li, Shilin Xu, Yibo Yang, Guangliang Cheng, Yunhai Tong, Dacheng Tao
  European Conference on Computer Vision, ECCV 2022
  [PDF] [Code]

• PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation
  Haobo Yuan, Xiangtai Li, Yibo Yang#, Giangliang Cheng, Jing Zhang, Yunhai Tong, Lefei Zhang, Dacheng Tao
  European Conference on Computer Vision, ECCV 2022
  [PDF] [Code]
  

  (The method in this paper also won the first place in Segmenting and Tracking Every Point and Pixel challenge in ICCV 2021)

• ART-Point: Improving Rotation Robustness of Point Cloud Classifiers via Adversarial Rotation
  Ruibin Wang, Yibo Yang#, Dacheng Tao
  IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2022
  [PDF] [Code]

• Towards Improving the Consistency, Efficiency, and Flexibility of Differentiable Neural Architecture Search
  Yibo Yang, Shan You, Hongyang Li, Fei Wang, Chen Qian, Zhouchen Lin
  IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021
  [PDF]

• ISTA-NAS: Efficient and Consistent Neural Architecture Search by Sparse Coding
  Yibo Yang, Hongyang Li, Shan You, Fei Wang, Chen Qian, Zhouchen Lin
  Advances in Neural Information Processing Systems, NeurIPS 2020
  [PDF] [Code]

• Spatial Pyramid Based Graph Reasoning for Semantic Segmentation
  Xia Li*, Yibo Yang*, Qijie Zhao, Tiancheng Shen, Zhouchen Lin, Hong Liu
  IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2020
  [PDF]

• SOGNet: Scene Overlap Graph Network for Panoptic Segmentation
  Yibo Yang, Hongyang Li, Xia Li, Qijie Zhao, Jianlong Wu, Zhouchen Lin
  AAAI Conference on Artificial Intelligence, AAAI 2020
  [PDF] [Code]
  (The method in this paper also won the Most Innovative Award in COCO 2019 challenge in ICCV 2019)

• Dynamical System Inspired Adaptive Time Stepping Controller for Residual Network Families
  Yibo Yang, Jianlong Wu, Hongyang Li, Xia Li, Tiancheng Shen, Zhouchen Lin
  AAAI Conference on Artificial Intelligence, AAAI, 2020
  [PDF]

• Expectation-Maximization Attention Networks for Semantic Segmentation
  Xia Li, Zhisheng Zhong, Jianlong Wu, Yibo Yang, Zhouchen Lin, Hong Liu
  IEEE/CVF International Conference in Computer Vision, ICCV, 2019, Oral Presentation (4.3%)
  [PDF] [Code]

• Joint Sub-bands Learning with Clique Structures for Wavelet Domain Super-resolution
  Zhisheng Zhong, Tiancheng Shen, Yibo Yang, Zhouchen Lin, Chao Zhang
  Advances in Neural Information Processing Systems, NeurIPS 2018
  [PDF]

• Optimization Algorithm Inspired Deep Neural Network Structure Design
  Huan Li*, Yibo Yang*, Dongmin Chen, Zhouchen Lin
  Asian Conference on Machine Learning, ACML 2018, Oral Presentation
  [PDF]

• Convolutional Neural Networks with Alternately Updated Clique
  Yibo Yang, Zhisheng Zhong, Tiancheng Shen, Zhouchen Lin
  IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2018, Oral Presentation (2.1%)
  [PDF] [Code]
  (This paper also won the second place of the Most Popular Poster Award in VALSE 2018)

[Journal Papers]

• Towards open vocabulary learning: A survey
  Jianzong Wu, Xiangtai Li, Shilin Xu, Haobo Yuan, Henghui Ding, Yibo Yang, Xia Li, Jiangning Zhang, Yunhai Tong, Xudong Jiang, Bernard Ghanem, Dacheng Tao
  IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI)
  [PDF]
  

• EATFormer: Improving Vision Transformer Inspired by Evolutionary Algorithm
  Jiangning Zhang, Xiangtai Li, Yabiao Wang, Chengjie Wang, Yibo Yang, Yong Liu, Dacheng Tao
  International Journal of Computer Vision (IJCV)
  [PDF]
  

• Demystify Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification
  Yuxuan Du, Yibo Yang, Dacheng Tao, Min-Hsiu Hsieh
  Physical Review Letters
  [PDF]
  Intro: Inspired by neural collapse, we find out some provable advantages and limitations of the quantum neural network over the classical one.

• SFNet: Faster, Accurate, and Domain Agnostic Semantic Segmentation via Semantic Flow
  Xiangtai Li, Jiangning Zhang, Yibo Yang, Guangliang Cheng, Kuiyuan Yang, Yunhai Tong, Dacheng Tao
  International Journal of Computer Vision
  [PDF] [Code]
  

• Deformable medical image registration with global-local transformation network and region similarity constraint
  Xinke Ma, Hengfei Cui, Shuoyan Li, Yibo Yang, Yong Xia
  Computerized Medical Imaging and Graphics
  [PDF]
  

• Multi-task learning with multi-query transformer for dense prediction
  Yangyang Xu, Xiangtai Li, Haobo Yuan, Yibo Yang, Lefei Zhang
  IEEE Trans. Circuits and Systems for Video Technology
  [PDF]
  

• Neural Collapse Inspired Attraction-Repulsion-Balanced Loss for Imbalanced Learning
  Liang Xie, Yibo Yang, Deng Cai, Xiaofei He
  Neurocomputing
  [PDF]
  

• TransVOD: End-to-end Video Object Detection with Spatial-Temporal Transformers
  Qianyu Zhou, Xiangtai Li, Lu He, Yibo Yang, Guangliang Cheng, Yunhai Tong, Lizhuang Ma, Dacheng Tao
  IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI)
  [PDF] [Code]

• Improving Video Instance Segmentation via Temporal Pyramid Routing
  Xiangtai Li, Hao He, Yibo Yang, Henghui Ding, Kuiyuan Yang, Guangliang Cheng, Yunhai Tong, Dacheng Tao
  IEEE Trans. Pattern Analysis and Machine Intelligence (TPAMI)
  [PDF] [Code]

• Newton Design: Designing CNNs with the Family of Newton’s Methods
  Zhengyang Shen, Yibo Yang, Qi She, Jiwen Ma, Zhouchen Lin
  SCIENCE CHINA Information Sciences, (WOS Q1, CCF-A)
  [PDF]

• Optimization-Inspired Manual Architecture Design and Neural Architecture Search
  Yibo Yang, Zhengyang Shen, Huan Li, Zhouchen Lin
  SCIENCE CHINA Information Sciences, (WOS Q1, CCF-A)
  [PDF]

Honors and Awards

• [2024] Wuwenjun AI Science & Technology Award in CAAI, First Price of Natural Science, 5-th contributor
• [2021] Wuwenjun Outstanding Ph.D. Dissertation Award in CAAI (Chinese Association for Artificial Intelligence)
• [2021] First Place Winner of Video+Depth track in Segmenting and Tracking Every Point and Pixel (BMTT 2021 challenge) in ICCV 2021
• [2021] Outstanding Graduates in Beijing
• [2021] Outstanding Graduates in Peking University
• [2020] Presidential Fellowship in Peking University
• [2019] Outstanding Academic Award in Peking University
• [2019] Most Innovative Award of Panoptic Segmentation in COCO 2019 Challenge in ICCV 2019
• [2018] Runner-up Winner of Panoptic Segmentation in COCO 2018 Challenge in ECCV 2018
• [2018] Second Place Winner of Most Popular Poster Award in VALSE 2018 (top2 in 145)
• [2015] Finalist Award in American Interdisciplinary Contest in Modeling
• [2014] Provincial Merit Student in Jiangsu Province
• [2014] Second Prize in Jiangsu Provincial Advanced Mathematics Contest

Services

[Reviewer for Journals]

• IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI);
• International Journal of Computer Vision (IJCV);
• IEEE Transactions on Neural Networks and Learning Systems (TNNLS);
• IEEE Transactions on Image Processing (TIP);

[Area Chair / Senior Program Committee for Conferences]

• International Conference on Artificial Neural Networks (ICANN), 2024
• International Conference on Learning Representations (ICLR), 2024
• Advances in Neural Information Processing Systems (NeurIPS), 2023
• Association for the Advancement of Artificial Intelligence (AAAI), 2022

[Reviewer for Conferences]

• Advances in Neural Information Processing Systems (NeurIPS), 2022/2021/2020/2019;
• International Conference on Machine Learning (ICML), 2024/2023/2022/2021/2020;
• International Conference on Learning Representations (ICLR), 2023/2022/2021;
• European Conference on Computer Vision (ECCV), 2024/2022;
• International Conference on Computer Vision (ICCV), 2023/2021;
• IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024/2023/2022/2021;