您当前的位置:
多模态生物特征组
组 长: 韩琥 研究员
Email: hanhu [at] ict dot ac dot cn
课题组简介

    多模态生物特征识别是实现多模态感知与交互需要解决的重要问题,具有生物特征多样性、数据模态异质性、数据标签不完整性,数据分布不均衡性等特点。借鉴人在多模态与多通道信息处理中的机理,研究面向生物特征识别的多模态的互补特征表示,跨模态鲁棒关联、以及数据与模态缺失建模方法,实现复杂场景条件下对生物特征的鲁棒识别与深入透彻感知。

研究内容

1. 在问题层面,关注生物特征数据增强与处理、多模态与跨模态生物特征识别、视觉对象结构化表达、生物特征活体判别和生物特征中的生理与状态特征分析。

2. 在方法层面,1借鉴人在视觉多模态与多通道信息处理中的机理,建立生物启发的多生物特征与多数据模态的互补特征表示,多模态与跨模态识别模型以及数据与模态缺失下的建模方法,提升真实场景下机器视觉感知在生物特征识别中的鲁棒性;2)借鉴人在感知中的想象与推理能力,研究数据模态缺失条件下的跨模态生成与关联方法以及基于弱监督学习的生物特征识别建模方法;3)发挥多模态多通道信息互补作用,建立活体与非活体生物特征的鲁棒特征表达,提升非侵扰式生物特征活体判别的鲁棒性;4)由表及里,研究基于时空特征表达的生物特征生理与状态感知方法,实现非接触、非侵扰式的的生物透彻感知。

部分论文

刊物论文

  • Hu Han, Charles Otto, Xiaoming Liu, Anil K.Jain, \"Demographic Estimation from Face Images:Human vs. Machine Performance,\" IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI2015), vol. 37, no. 6, pp. 1148-1161, 2015.
  • Di Wen, Hu Han, Anil K.Jain, "Face Spoof Detection with Image Distortion Analysis," IEEE Transactions on Information Forensics and Security, vol. 10, no. 4, pp. 746-761, 2015.
  • Keyurkumar Patel, Hu Han, Anil K.Jain, \"Secure Face Unlock:Spoof Detection on Smartphones,\" IEEE Transactions on Information Forensics and Security, vol. 11, no. 10, pp. 2268-2283, 2016.
  • Hu Han, Anil K.Jain, Fang Wang, Shiguang Shan, Xilin Chen, \"Heterogeneous Face Attribute Estimation:A Deep Multi-Task Learning Approach,\" IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), vol. 40, no. 11, pp. 2597-2609, Nov. 2018.
  • Hu Han, Jie Li, Anil Jain, Shiguang Shan, Xilin Chen, \"Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning,\" IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 41, no. 10, pp. 2333-2348, Oct. 1, 2019.
  • Xuesong Niu, Hu Han, and Shiguang Shan, "Remote Photoplethysmography-based Physiological Measurement: A Survey," Journal of Image and Graphics (CIG), vol.25, no.11, pp.2321-2336, 2020.
  • Xuesong Niu, Shiguang Shan*, Hu Han, and Xilin Chen, \"RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation,\" IEEE Transactions on Image Processing (T-IP), vol. 29, pp. 2409-2423, 2020.
  • Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, \"FCSR-GAN: Joint Face Completion and Super-resolution via Multi-task Learning,\" IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 2, no. 2, pp. 109-121, April 2020.
  • Haomiao Sun, Hongyu Pan, Hu Han and Shiguang Shan. Deep Conditional Distribution Learning for Age Estimation. IEEE Transactions on Information Forensics and Security (TIFS), 16:4679-4690, 2021.
  • Guoqing Wang, Hu Han, Shiguang Shan and Xilin Chen. Unsupervised Adversarial Domain Adaptation for Cross-domain Face Presentation Attack Detection. IEEE Transactions on Information Forensics and Security (TIFS), 16:56-69, 2021.
  • Abhijit Das, Xuesong Niu, Antitza Dantcheva, S L Happy, Hu Han, Radia Zeghari, Philippe Robert, Shiguang Shan, Francois Bremond and Xilin Chen. A Spatio-temporal Approach for Apathy Classification. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2021. (Accepted)

会议论文

  • Hao Zhang, Hu Han, Jiyun Cui, Shiguang Shan, Xilin Chen. \"RGB-D Face Recognition via Deep Complementary and Common Feature Learning,\" The 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi\'an, China, May 15-19, 2018.
  • Gang Chen, Xufen Cai, Hu Han, Shiguang Shan, Xingguang Song, Xilin Chen, \"HeadNet: Pedestrian Head Detection Utilizing Body in Context,\" The 13th IEEE Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi\'an, China, 2018.
  • Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, \"Mean-Variance Loss for Deep Age Estimation from A Face,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR2018), pp. 5285-5294, Salt Lake City, USA, Jun. 18-22, 2018.
  • Yuanshun Cui, Jie Li, Hu Han, Shiguang Shan, Xilin Chen, \"TKDN: Scene Text Detection via Keypoints Detection,\" Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia
  • Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen, \"VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video,\" Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia.
  • Jiyun Cui, Hu Han, Shiguang Shan, Xilin Chen. \"RGB-D Face Recognition: A Comparative Study of Representative Fusion Schemes,\" The 13th Chinese Conference on Biometric Recognition (CCBR2018), Xinjiang, China, Aug. 11-12, 2018.
  • Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, \"Multi-label Learning from Noisy Labels with Non-linear Feature Transformation,\" Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia.
  • Xuesong Niu, Xingyuan Zhao, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen,"Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Shikang Yu, Hu Han, Shiguang Shan, Antitza Dantcheva, and Xilin Chen, "Improving Face Sketch Recognition via Adversarial Sketch-Photo Transformation," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, "FCSR-GAN: End-to-end Learning for Joint Face Completion and Super-resolution," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan, \" Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 11917-11926, Long Beach, California, USA, June 16-20, 2019.
  • Guoqing Wang, Chuanxin Lan, Hu Han, Shiguang Shan, and Xilin Chen, \"Multi-modal Face Presentation Attack Detection via Spatial and Channel Attentions,\" IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 1-6, Long Beach, CA, USA, Jun. 16-20, 2019.
  • Guoqing Wang, Hu Han, Shiguang Shan, Xilin Chen, \"Improving Cross-database Face Presentation Attack Detection via Adversarial Domain Adaptation,\" 12th IAPR International Conference on Biometrics (ICB 2019), pp. 1-8, Crete, Greece, Jun 4-7, 2019.
  • Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, “Weakly Supervised Image Classification through Noise Regularization,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR2019), pp. 11517-11525,  Long Beach, California, USA, June 16-20, 2019.
  • Xuesong Niu, Hu Han, Shiguang Shan, and Xilin Chen, \"Multi-label Co-regularization for Semi-supervised Facial Action Unit Recognition,\" The Thirty-third Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, Dec. 8-14, 2019.
  • Xiaobai Li, Hu Han, Hao Lu, Xuesong Niu, Zitong Yu, Antitza Dantcheva, Guoying Zhao, Shiguang Shan, "The 1st Challenge on Remote Physiological Signal Sensing (RePSS)," in Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp.1-8, Seattle, Washington, USA, Jun. 14-19, 2020.
  • Guoqing Wang, Hu Han, Shiguang Shan, Xilin Chen, \"Cross-domain Face Presentation Attack Detection via Multi-domain Disentangled Representation Learning,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2020), pp. 6678-6687, 2020.
  • Xuesong Niu, Zitong Yu, Hu Han, Xiaobai Li, Shiguang Shan, Guoying Zhao, "Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling," Proceedings of the 16th European Conference on Computer Vision (ECCV), Glasgow, UK / Cyberspace, August 23-28, 2020.
  • Jinsong Chen, Hu Han and Shiguang Shan. Towards High-Fidelity Face Self-occlusion Recovery via Multi-view Residual-based GAN Inversion. AAAI Conference on Artificial Intelligence (AAAI), 2022. (Accepted)
  • Abhijit Das, Hao Lu, Hu Han, Antitza Dantcheva, Shiguang Shan and Xilin Chen. BVPNet: Video-to-BVP Signal Prediction for Remote Heart Rate Estimation. International Conference on Automatic Face and Gesture Recognition (FG), 2021. (Accepted)