中科院计算所视觉信息处理与学习组
中科院计算所视觉信息处理与学习组


您所在的位置 / 科学研究

科学研究
多模态生物特征组

组  长:韩琥 副研究员

Email:hanhu [at] ict dot ac dot cn


多模态生物特征识别是实现多模态感知与交互需要解决的重要问题,具有生物特征多样性、数据模态异质性、数据标签不完整性,数据分布不均衡性等特点。借鉴人在多模态与多通道信息处理中的机理,研究面向生物特征识别的多模态的互补特征表示,跨模态鲁棒关联、以及数据与模态缺失建模方法,实现复杂场景条件下对生物特征的鲁棒识别与深入透彻感知。


研究内容

1. 在问题层面,关注生物特征数据增强与处理、多模态与跨模态生物特征识别、视觉对象结构化表达、生物特征活体判别和生物特征中的生理与状态特征分析。

 

2. 在方法层面,1借鉴人在视觉多模态与多通道信息处理中的机理,建立生物启发的多生物特征与多数据模态的互补特征表示,多模态与跨模态识别模型以及数据与模态缺失下的建模方法,提升真实场景下机器视觉感知在生物特征识别中的鲁棒性;2)借鉴人在感知中的想象与推理能力,研究数据模态缺失条件下的跨模态生成与关联方法以及基于弱监督学习的生物特征识别建模方法;3)发挥多模态多通道信息互补作用,建立活体与非活体生物特征的鲁棒特征表达,提升非侵扰式生物特征活体判别的鲁棒性;4)由表及里,研究基于时空特征表达的生物特征生理与状态感知方法,实现非接触、非侵扰式的的生物透彻感知。

部分论文

刊物论文

1.    Hu Han, Jie Li, Anil Jain, Shiguang Shan, Xilin Chen, "Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), Jan. 2019.(Accepted)

2.    Hu Han, Anil K.Jain, Fang Wang, Shiguang Shan, Xilin Chen, "Heterogeneous Face Attribute Estimation:A Deep Multi-Task Learning Approach," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), vol. 40, no. 11, pp. 2597-2609, Nov. 2018. 【pdf】

3.    Keyurkumar Patel, Hu Han, Anil K.Jain, "Secure Face Unlock:Spoof Detection on Smartphones," IEEE Transactions on Information Forensics and Security, vol. 11, no. 10, pp. 2268-2283, 2016. 【pdf】

4.    Di Wen, Hu Han, Anil K.Jain, "Face Spoof Detection with Image Distortion Analysis," IEEE Transactions on Information Forensics and Security, vol. 10, no. 4, pp. 746-761, 2015. 【pdf】

5.    Hu Han, Charles Otto, Xiaoming Liu, Anil K.Jain, "Demographic Estimation from Face Images:Human vs. Machine Performance," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI2015), vol. 37, no. 6, pp. 1148-1161, 2015. 【pdf】

6.    Lacey Best-Rowden, Hu Han, Charles Otto, Brendan Klare, Anil K.Jain, "Unconstrained Face Recognition:Identifying a Person of Interest from a Media Collection," IEEE Transactions on Information Forensics and Security, vol. 9, no. 12, pp. 2144-2157, 2014. 【pdf】

7.    Scott Klum, Hu Han, Brendan Klare, Anil K.Jain, "The Face Sketch ID System:Matching Facial Composites to Mugshots," IEEE Transactions on Information Forensics and Security, vol. 9, no. 12, pp. 2248-2263, 2014. 【pdf】

8.    Dongoh Kang, Hu Han, Anil K.Jain, Seong-Whan Lee, "Nighttime Face Recognition at Large Standoff:Cross-Distance and Cross-Spectral Matching," Pattern Recognition, vol. 47, no. 12, pp. 3750-3766, 2014. 【pdf】

9.    Hu Han, Brendan Klare, Kathryn Bonnen, Anil K.Jain, "Matching Composite Sketches to Face Photos:A Component Based Approach," IEEE Transactions on Information Forensics and Security, vol. 8, no. 1, pp. 191-204, 2013. 【pdf】

会议论文

1.    Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, "FCSR-GAN: End-to-end Learning for Joint Face Completion and Super-resolution,"  14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille, France, May 14-18, 2019. (Accepted)

2.    Shikang Yu, Hu Han, Shiguang Shan, Antitza Dantcheva, and Xilin Chen, "Improving Face Sketch Recognition via Adversarial Sketch-Photo Transformation,"  14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille, France, May 14-18, 2019. (Accepted)

3.    Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, “Weakly Supervised Image Classification through Noise Regularization,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR2019) , June 16-21, 2019.(Accepted)

4.    Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan, "Relationship Learning with Person-specific Regularization for Facial Action Unit Detection," IEEE Conference on Computer Vision and Pattern Recognition (CVPR2019), Long Beach, CA, United States, Jun 16-20, 2019 (Accepted)

5.    Xuesong Niu, Xingyuan Zhao, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen,"Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention," 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille,  France, May 14-18, 2019. (Accepted)

6.    Guoqing Wang, Hu Han, Shiguang Shan, Xilin Chen, "Improving Cross-database Face Presentation Attack Detection via Adversarial Domain Adaptation," 12th IAPR International Conference on Biometrics (ICB 2019), pp. 1-8, Crete, Greece, Jun 4-7, 2019. (Accepted)

7.    Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, "Multi-label Learning from Noisy Labels with Non-linear Feature Transformation," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia. 【pdf】

8.    Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen, "VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia. 【pdf】

9.    Yuanshun Cui, Jie Li, Hu Han, Shiguang Shan, Xilin Chen, "TKDN: Scene Text Detection via Keypoints Detection," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia 【pdf】

10.    Jiyun Cui, Hu Han, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition: A Comparative Study of Representative Fusion Schemes," The 13th Chinese Conference on Biometric Recognition (CCBR2018), Xinjiang, China, Aug. 11-12, 2018. 【pdf】

11.    Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, "Mean-Variance Loss for Deep Age Estimation from A Face," IEEE Conference on Computer Vision and Pattern Recognition(CVPR2018), pp. 5285-5294, Salt Lake City, USA, Jun. 18-22, 2018. 【pdf】

12.    Gang Chen, Xufen Cai, Hu Han, Shiguang Shan, Xingguang Song, Xilin Chen, "HeadNet: Pedestrian Head Detection Utilizing Body in Context," The 13th IEEE Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, 2018. 【pdf】

13.    Hao Zhang, Hu Han, Jiyun Cui, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition via Deep Complementary and Common Feature Learning," The 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, May 15-19, 2018. 【pdf】

14.    Jiyun Cui, Hao Zhang, Hu Han, Shiguang Shan, Xilin Chen, "Improving 2D Face Recognition Via Discriminative Face Depth Estimation," IAPR International Conference on Biometrics(ICB2018), pp. 1-8, Queensland, Australia, 2018. 【pdf】

15.    Xuesong Niu, Hu Han, Jiabei Zeng, Xuran Sun, Shiguang Shan, Yan Huang, Songfan Yang, Xilin Chen, "Automatic Engagement Prediction with GAP Feature," ACM International Conference on Multimodal Interaction (ICMI2018), pp. 599-603, Boulder, CO, USA, October 16–20, 2018. 【pdf】

16.    Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, "Revised Contrastive Loss for Robust Age Estimation From Face," The 24th International Conference on Pattern Recognition (ICPR2018), pp. 3586-3591, Beijing, China, Aug. 20-24, 2018. 【pdf】

17.    Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen. "SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific," The 24th International Conference on Pattern Recognition (ICPR2018), Beijing, China, Aug. 20-24, 2018. 【pdf】

18.    Yu Song, Yuanshun Cui, Hu Han, Shiguang Shan, Xilin Chen. "Scene Text Detection via Deep Semantic Feature Fusion and Attention-based Refinement," The 24th International Conference on Pattern Recognition (ICPR2018), Beijing, China, Aug. 20-24, 2018. 【pdf】

19.    Fang Wang, Hu Han, Shiguang Shan, Xilin Chen, "Deep Multi-Task Learning for Joint Prediction of Heterogeneous Face Attributes," IEEE International Conference on Face and Gesture Recognition(FG2017), 2017. 【pdf】

20.    Sixue Gong, Hu Han, Shiguang Shan, Xilin Chen, "Actions Recognition in Crowd Based on Coarse-to-Fine Multi-Object Tracking," Asian Conference on Computer Vision Workshops(ACCV2016), Nov. 20-24, 2016. 【pdf】


视觉信息处理和学习组
  • 单位地址:北京海淀区中关村科学院南路6号
  • 邮编:100190
  • 联系电话:010-62600514
  • Email:yi.cheng@vipl.ict.ac.cn
  • Valse

  • 深度学习大讲堂

版权所有 @ 中科院计算所视觉信息处理与学习组 京ICP备05002829号 京公网安备1101080060