您当前的位置:
多模态生物特征组
组 长: 韩琥 研究员
Email: hanhu [at] ict dot ac dot cn
课题组简介

    多模态生物特征识别是实现多模态感知与交互需要解决的重要问题,具有生物特征多样性、数据模态异质性、数据标签不完整性,数据分布不均衡性等特点。借鉴人在多模态与多通道信息处理中的机理,研究面向生物特征识别的多模态的互补特征表示,跨模态鲁棒关联、以及数据与模态缺失建模方法,实现复杂场景条件下对生物特征的鲁棒识别与深入透彻感知。

研究内容

1. 在问题层面,关注生物特征数据增强与处理、多模态与跨模态生物特征识别、视觉对象结构化表达、生物特征活体判别和生物特征中的生理与状态特征分析。

2. 在方法层面,1借鉴人在视觉多模态与多通道信息处理中的机理,建立生物启发的多生物特征与多数据模态的互补特征表示,多模态与跨模态识别模型以及数据与模态缺失下的建模方法,提升真实场景下机器视觉感知在生物特征识别中的鲁棒性;2)借鉴人在感知中的想象与推理能力,研究数据模态缺失条件下的跨模态生成与关联方法以及基于弱监督学习的生物特征识别建模方法;3)发挥多模态多通道信息互补作用,建立活体与非活体生物特征的鲁棒特征表达,提升非侵扰式生物特征活体判别的鲁棒性;4)由表及里,研究基于时空特征表达的生物特征生理与状态感知方法,实现非接触、非侵扰式的的生物透彻感知。

部分论文

刊物论文

  • Tianxin Xie, Hu Han, Shiguang Shan, Xilin Chen. Natural Adversarial Mask for Face Identity Protection in Physical World. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024. (Accepted)
  • Ling Lin, Hao Liu, Jinqiao Liang, Zhendong Li, Jiao Feng, Hu Han. Consensus-agent deep reinforcement learning for face aging. IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 1795-1809, 2024.
  • Jiachen Chen, Mengyang Li, Hu Han, Zhiming Zhao, and Xilin Chen. SurgNet: Self-supervised pretraining with semantic consistency for vessel and instrument segmentation in surgical images. IEEE Transactions on Medical Imaging (TMI), Vol. 43, No. 4, pp. 1513-1525, 2024.
  • Xinye Zhou, Hu Han, Shiguang Shan, Xilin Chen. Fine-grained Open-set Deepfake Detection via Unsupervised Domain Adaptation. IEEE Transactions on Information Forensics and Security (TIFS), Vol. 19, pp. 7536-7547, 2024.
  • Shikang Yu, Hu Han, Shiguang Shan, and Xilin Chen. CMOS-GAN: Semi-supervised Generative Adversarial Model for Cross-Modality Face Image Synthesis, IEEE Transactions on Image Processing (TIP), vol. 32, pp. 144-158, 2023.
  • Abhijit Das, Xuesong Niu, Antitza Dantcheva, S L Happy, Hu Han, Radia Zeghari, Philippe Robert, Shiguang Shan, Francois Bremond and Xilin Chen. A Spatio-temporal Approach for Apathy Classification. IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 32(5): 2561-2573, May 2022.
  • Haomiao Sun, Hongyu Pan, Hu Han and Shiguang Shan. Deep Conditional Distribution Learning for Age Estimation. IEEE Transactions on Information Forensics and Security (TIFS), 16:4679-4690, 2021.
  • Guoqing Wang, Hu Han, Shiguang Shan and Xilin Chen. Unsupervised Adversarial Domain Adaptation for Cross-domain Face Presentation Attack Detection. IEEE Transactions on Information Forensics and Security (TIFS), 16:56-69, 2021.
  • Xuesong Niu, Hu Han, and Shiguang Shan, "Remote Photoplethysmography-based Physiological Measurement: A Survey," Journal of Image and Graphics (CIG), vol.25, no.11, pp.2321-2336, 2020.
  • Xuesong Niu, Shiguang Shan*, Hu Han, and Xilin Chen, "RhythmNet: End-to-end Heart Rate Estimation from Face via Spatial-temporal Representation," IEEE Transactions on Image Processing (T-IP), vol. 29, pp. 2409-2423, 2020.
  • Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, "FCSR-GAN: Joint Face Completion and Super-resolution via Multi-task Learning," IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 2, no. 2, pp. 109-121, April 2020.
  • Hu Han, Jie Li, Anil Jain, Shiguang Shan, Xilin Chen, "Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning," IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), vol. 41, no. 10, pp. 2333-2348, Oct. 1, 2019.
  • Hu Han, Anil K.Jain, Fang Wang, Shiguang Shan, Xilin Chen, "Heterogeneous Face Attribute Estimation:A Deep Multi-Task Learning Approach," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), vol. 40, no. 11, pp. 2597-2609, Nov. 2018.
  • Keyurkumar Patel, Hu Han, Anil K.Jain, "Secure Face Unlock:Spoof Detection on Smartphones," IEEE Transactions on Information Forensics and Security, vol. 11, no. 10, pp. 2268-2283, 2016.
  • Hu Han, Charles Otto, Xiaoming Liu, Anil K.Jain, "Demographic Estimation from Face Images:Human vs. Machine Performance," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI2015), vol. 37, no. 6, pp. 1148-1161, 2015.
  • Di Wen, Hu Han, Anil K.Jain, "Face Spoof Detection with Image Distortion Analysis," IEEE Transactions on Information Forensics and Security, vol. 10, no. 4, pp. 746-761, 2015.

会议论文

  • Yufei Cai, Yuxiang Wei, Zhilong Ji, Jinfeng Bai, Hu Han, Wangmeng Zuo. Decoupled Textual Embeddings for Customized Image Generation. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), pp. 909-917, Vancouver, Canada, Feb. 20–27, 2024.
  • Haozhan Wu, Hu Han, Shiguang Shan, Xilin Chen. Multi-view consistent 3D GAN inversion via bidirectional encoder. IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-10, Istanbul, Turkiye, May. 27-31, 2024.
  • Ce Wang, Xiaoyu Huang, Yaqing Kong, Qian Li, You Hao & Xiang Zhou. 3DGPS: A 3D Differentiable-Gaussian-Based Planning Strategy for Liver Tumor Cryoablation. International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 3-13, Marrakesh, Morocco, Oct. 6–10, 2024.
  • Yewei Zhao, Hu Han, Shiguang Shan, and Xilin Chen. Deep subdomain alignment for cross-domain image classification. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pp. 2808-2817, Waikoloa, Hawaii, USA, Jan. 1-8, 2024.
  • Yifan Li, Hu Han, Shiguang Shan, Zhilong Ji, Jinfeng Bai, and Xilin Chen. ReCoT: Regularized Co-training for Facial Action Unit Recognition with Noisy Labels. British Machine Vision Conference, Aberdeen, UK, Nov. 20-24, 2023.
  • Shikang Yu, Jiachen Chen, Hu Han, and Shuqiang Jiang. Data-Free Knowledge Distillation via Feature Exchange and Activation Region Constraint. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 24266-24275, Vancouver, Canada, Jun. 18-22, 2023.
  • Yifan Li, Hu Han, Shiguang Shan, and Xilin Chen. DISC: Learning from Noisy Labels via Dynamic Instance-Specific Selection and Correction. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 24070-24079, Vancouver, Canada, Jun. 18-22, 2023.
  • Haomiao Sun, Shiguang San, and Hu Han. Intrinsic Imaging Model Enhanced Contrastive Face Representation Learning. IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Hawaii, USA, Jan. 5-8, 2023.
  • Xuesong Niu, Xingyuan Zhao, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen,"Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Shikang Yu, Hu Han, Shiguang Shan, Antitza Dantcheva, and Xilin Chen, "Improving Face Sketch Recognition via Adversarial Sketch-Photo Transformation," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, "FCSR-GAN: End-to-end Learning for Joint Face Completion and Super-resolution," Proceedings of the 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG), pp. 1-8, Lille, France, May 14-18, 2019.
  • Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan, " Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 11917-11926, Long Beach, California, USA, June 16-20, 2019.
  • Guoqing Wang, Chuanxin Lan, Hu Han, Shiguang Shan, and Xilin Chen, "Multi-modal Face Presentation Attack Detection via Spatial and Channel Attentions," IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, pp. 1-6, Long Beach, CA, USA, Jun. 16-20, 2019.
  • Hao Zhang, Hu Han, Jiyun Cui, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition via Deep Complementary and Common Feature Learning," The 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, May 15-19, 2018.
  • Gang Chen, Xufen Cai, Hu Han, Shiguang Shan, Xingguang Song, Xilin Chen, "HeadNet: Pedestrian Head Detection Utilizing Body in Context," The 13th IEEE Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, 2018.
  • Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, "Mean-Variance Loss for Deep Age Estimation from A Face," IEEE Conference on Computer Vision and Pattern Recognition(CVPR2018), pp. 5285-5294, Salt Lake City, USA, Jun. 18-22, 2018.
  • Yuanshun Cui, Jie Li, Hu Han, Shiguang Shan, Xilin Chen, "TKDN: Scene Text Detection via Keypoints Detection," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia
  • Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen, "VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia.
  • Jiyun Cui, Hu Han, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition: A Comparative Study of Representative Fusion Schemes," The 13th Chinese Conference on Biometric Recognition (CCBR2018), Xinjiang, China, Aug. 11-12, 2018.
  • Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, "Multi-label Learning from Noisy Labels with Non-linear Feature Transformation," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia.