中国科学院 丨 所主站丨 中文
Research
Affective Computing
Audio-Visual Speech Understanding Group
Face Recognition
Media Learning and Knowledge Reasoning
Multimedia Computing and Multimodal Intelligent
Multimodal Biometric
Sign Language Recognition
Visual Modeling
Visual Scene Understanding
Face Recognition
Leader： Jie Zhang (Associate Professor) / Meina Kan (Associate Professor) / Shiguang Shan（Professor）
Email： zhangjie at ict dot ac dot cn , kanmeina at ict dot ac dot cn ，sgshan at ict dot ac dot cn
Introduction of research group

The Face Group has been working on face analysis since 1999, and has published more than 300 papers on spoofing detection, face detection, face landmark detection, face attributes prediction, facial attribute editing, and face recognition. These works have been cited for more than 25000 times (Google Scholar). Some of these works won the 2nd class of China’s National Science and Technology Progress Award in 2005, and 2nd class of China’s State Natural Science Award in 2015. Moreover, a few face recognition and analysis works have been successfully commercialized into China’s Ministry of Public Security Exit-Entry Administration, Provincial Public Security Bureau, Labour and Social Security Bureau, and the cellphone. In August 2016, Beijing Seetatech Technology Co., Ltd (Seetatech) is established especially for commercialization of face recognition techniques.


Research

The face group mainly focuses on the following two aspects:


1) Theory and Methodology: mainly study the fundamental problems of computer vision and pattern recognition, including discriminative feature learning, deep learning with defect data (e.g. small number of data, weakly supervised data, nosily labeled data), self-supervised visual learning, generative learning and adversarial attack, transfer learning.


2) Application and Methods:  mainly study the fundamental problems of face application, including face detection and tracking, facial landmark detection, face recognition, 3D face reconstruction, facial expression analysis, lip reading, facial attributes estimation.


Papers

Journal Papers

  • Jiguo Li, Xinfeng Zhang, Chuanmin Jia, Jizheng Xu, Li Zhang, Yue Wang, Siwei Ma, Wen Gao. (2020). Direct speech-to-image translation. IEEE Journal of Selected Topics in Signal Processing, 14(3), 517-529.
  • Yunpei Jia, Jie Zhang, Shiguang Shan and Xilin Chen. Unified Unsupervised and Semi-supervised Domain Adaptation Network for Cross-scenario Face Anti-spoofing. Pattern Recognition, 115: 107888, 2021.
  • Xuyang Guo, Meina Kan, Zhenliang He, Xingguang Song and Shiguang Shan. Image Style Disentangling for Instance-level Facial Attribute Transfer. Computer Vision and Image Understanding (CVIU), 207:103205, 2021.
  • Jiguo Li, Xinfeng Zhang, Jizheng Xu, Siwei Ma and Wen Gao. (2021). Learning to fool the speaker recognition. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM), 17(3s), 1-21.
  • Xin Liu, Meina Kan, Wanglong Wu, Shiguang Shan, Xilin Chen, \"VIPLFaceNet:An Open Source Deep Face Recognition SDK,\" Frontier of Computer Science, vol. 11, no. 2, pp. 208–218, 2017.
  • Wen Wang, Ruiping Wang, Shiguang Shan, Xilin Chen, \"Prototype Discriminative Learning for Image Set Classification,\" IEEE Signal Processing Letters, vol. 24, no. 9, pp. 1318-1322, 2017.
  • Zhiwu Huang, Ruiping Wang, Shiguang Shan, Luc Van Gool, Xilin Chen, \"Cross Euclidean-to-Riemannian Metric Learning with Application to Face Recognition from Video,\" IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), vol. 40, no. 12, pp. 2827-2840, Dec. 2018.
  • Xiaoke Zhu, Xiao-Yuan Jing, Xinge You, Wangmeng Zuo, Shiguang Shan, Wei-Shi Zheng, \"Image to Video Person Re-Identification by Learning Heterogeneous Dictionary Pair with Feature Projection Matrix,\" IEEE Transactions on Information Forensics and Security, vol. 13, no. 3, pp. 717-732, 2018.
  • Yan Li, Shiguang Shan, Ruiping Wang, Zhen Cui, Xilin Chen, \"Fusing magnitude and phase features with multiple face models for robust face recognition,\" Frontier of Computer Science, vol. 4, pp. 1-19, 2018.
  • Shuzhe Wu, Meina Kan, Shiguang Shan and Xilin Chen, “Hierarchical Attention for Part-Aware Face Detection,” International Journal of Computer Vision (IJCV), vo. 127, no. 6-7, pp 560–578, June 2019.
  • Mingjie He, Jie Zhang, Shiguang Shan, Meina Kan, Xilin Chen, \"Deformable Face Net for Pose Invariant Face Recognition,\" Pattern Recognition (PR), vol.100, April. 2020.
  • Zhenliang He, Wangmeng Zuo, Meina Kan, Shiguang Shan and Xilin Chen, \"AttGAN: Facial Attribute Editing by Only Changing What You Want,\" IEEE Transactions on Image Processing (TIP), vol. 28, no. 11, pp. 5464 – 5478, November 2019.
  • Nan Lai, Meina Kan, Chunrui Han, Xingguang Song, and Shiguang Shan, "Learning to Learn Adaptive Classifier-Predictor for Few Shot Learning," IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2020.
  • Mingjie He, Jie Zhang, Shiguang Shan, Xiao Liu, Zhongqin Wu and Xilin Chen. Locality-aware Channel-wise Dropout for Occluded Face Recognition. IEEE Transactions on Image Processing (TIP), 2021. (Accepted)
  • Yunpei Jia, Jie Zhang and Shiguang Shan. Dual-Branch Meta-learning Network with Distribution Alignment for Face Anti-spoofing. IEEE Transactions on Information Forensics and Security (TIFS), 2021. (Accepted)
  • Chunrui Han, Shiguang Shan, Meina Kan, Shuzhe Wu and Xilin Chen. Personalized Convolution for Face Recognition. International Journal of Computer Vision (IJCV), 2021. (Accepted)
  • Lanqing Hu, Meina Kan, Shiguang Shan and Xilin Chen. Face Frontalization with Coarse-to-fine Morphing Field Learning for Large Pose Face Recognition. Journal of Image and Graphics (CJIG). 2021. (Accepted)
  • Yan Li, Ruiping Wang, Zhen Cui, Shiguang Shan, Xilin Chen, \"Spatial Pyramid Covariance based Compact Video Code for Robust Face Retrieval in TV-Series,\" IEEE Transactions on Image Processing, vol. 25, no. 12, pp. 5905-5919, 2016.
  • Shaoxin Li, Shiguang Shan, Shuicheng Yan, Xilin Chen, \"Relative Forest for Visual Attribute Prediction,\" IEEE Transactions on Image Processing, 25(9): 3991-4003, 2016.
  • Shuzhe Wu, Mein Kan, Zhenliang He, Shiguang Shan, Xilin Chen, \"Funnel-Structured Cascade for Multi-View Face Detection with Alignment-Awareness,\" Neurocomputing, vol. 221, no. 19, pp. 138–145, 2017.

Conference Papers

  • Yuanyuan Xu, Meina Kan, Shiguang Shan and Xilin Chen. Mutual Learning of Joint and Separate Domain Alignments for Multi-Source Domain Adaptation. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2022. (Accepted)
  • Zheng Yuan, Jie Zhang, Yunpei Jia, Chuanqi Tan, Tao Xue and Shiguang Shan. Meta Gradient Adversarial Attack. IEEE/CVF International Conference on Computer Vision (ICCV), pp. 7748-7757, Montreal, Canada, Oct.11-17, 2021.
  • Liang Shi, Jie Zhang, Chenyue Liang and Shiguang Shan. Unknown Aware Feature Learning for Face Forgery Detection. International Conference on Automatic Face and Gesture Recognition (FG), 2021. (Accepted)
  • Kunyan Li, Jie Zhang and Shiguang Shan. Learning Shape-Appearance Based Attributes Representation for Facial Attribute Recognition with Limited Labeled Data. International Conference on Automatic Face and Gesture Recognition (FG), 2021. (Accepted)
  • Zheng Yuan, Jie Zhang, Shiguang Shan, Xilin Chen, "Attributes Aware Face Generation with Generative Adversarial Networks," 25th International Conference on Pattern Recognition (ICPR 2020), pp. 1657-1664, Virtual-Milano, January 10-15, 2021.
  • Changzhen Li, ​Jie Zhang, Shiguang Shan, Xilin Chen, "PAS-Net: Pose-Based and Appearance-Based Spatiotemporal Networks Fusion for Action Recognition", IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 215-221, 2020.
  • Jiguo Li, Chuanmin Jia, Xinfeng Zhang, Siwei Ma and Wen Gao. Cross Modal Compression: Towards Human-comprehensible Semantic Compression. ACM International Conference on Multimedia (ACM Multimedia), pp. 4230-4238, Chengdu, China, Oct. 20-24, 2021.
  • Zhenliang He, Meina Kan and Shiguang Shan. EigenGAN: Layer-Wise Eigen-Learning for GAN. IEEE/CVF International Conference on Computer Vision (ICCV), pp. 14408-14417, Montreal, Canada, Oct. 11-17, 2021.
  • Jiguo Li, Xinfeng Zhang, Jizheng Xu, Li Zhang, Yue Wang, Siwei Ma, Wen Gao. "Learning to Fool the Speaker Recognition," ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2020, pp. 2937-2941, doi: 10.1109/ICASSP40776.2020.9053058.
  • Zijian Zhao, Jie Zhang and Shiguang Shan, "Noise Robust Hard Example Mining for Human Detection with Efficient Depth-Thermal Fusion," IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020), pp. 809-813, 2020.
  • Mingjie He, Jie Zhang, Shiguang Shan, Meina Kan, Xilin Chen, \"Deformable Face Net: Learning Pose Invariant Feature with Pose Aware Feature Alignment for Face Recognition,\" 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), Lille, France, May 14-18, 2019. (Oral)
  • Xijun Wang, Meina Kan, Shiguang Shan, Xilin Chen, “Fully Learnable Group Convolution for Acceleration of Deep Neural Networks”, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.9049-9058, Long Beach, California, USA, June 16-20, 2019.
  • Jinghui Wang, Jie Zhang, Zijia Lu, Shiguang Shan, \"DFT-NET: Disentanglement of Face Deformation and Texture Synthesis for Expression Editing,\" IEEE International Conference on Image Processing (ICIP), pp.3881-3885, Taibei, China, Sep. 22, 2019.
  • Xiaoyan Li, Meina Kan, Shiguang Shan, Xilin Chen, \"Weakly Supervised Object Detection with Segmentation Collaboration,\" IEEE International Conference on Computer Vision (ICCV), pp. 9735-9744, Seoul, Korea, Oct. 27-Nov. 2, 2019.
  • Zhenliang He, Meina Kan, Shiguang Shan, Xilin Chen, \"S2GAN: Share Aging Factors across Ages and Share Aging Trends among Individuals,\" IEEE International Conference on Computer Vision (ICCV), pp. 9440-9449, Seoul, Korea, Oct. 27-Nov. 2, 2019.
  • Lanqing Hu, Meina Kan, Shiguang Shan, Xilin Chen, \"Unsupervised Domain Adaptation with Hierarchical Gradient Synchronization,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2020), pp. 4043-4052, 2020.
  • Yunpei Jia, Jie Zhang, Shiguang Shan, Xilin Chen, \"Single-Side Domain Generalization for Face Anti-Spoofing,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2020), pp. 8484-8493, 2020.
  • Yude Wang, Jie Zhang, Meina Kan, Shiguang Shan, Xilin Chen, \"Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2020), pp. 12275-12284, 2020.
  • Jiguo Li, Xinfeng Zhang, Chuanmin Jia, Jizheng Xu, Li Zhang, Yue Wang, Siwei Ma, Wen Gao. (2020, July). Universal adversarial perturbations generative network for speaker recognition. In 2020 IEEE International Conference on Multimedia and Expo (ICME) (pp. 1-6). IEEE.
  • Hanjie Wang, Qi Wang, Xilin Chen, “Hand Posture Recognition from Disparity Cost Map,” ACCV, Daejeon, Korea, Nov.2012.