Visual Information Processing and Learning
Visual Information Processing and Learning


Research
Multimodal Biometric

Leader:Hu Han (Associate Professor)

Email:hanhu [at] ict.ac.cn

Bio-perception oriented intelligent computing (BPOIC) is an interdisciplinary field spanning computer science, psychology, cognitive science, and medical science. BPOIC is essential for deep understanding of human by machines covering visible attributes (e.g., demographic expression) to latent characteristics (e.g., psychological and physiological). BPOIC is challenging because of data source diversity, modality heterogeneity, data or label missing, data imbalance, etc. We aim at the research and development of methods for modal image/video enhancement, visual attribute learning, intelligent healthcare, and representation learning, etc. The goal is to establish the capability of robust bio-perception under unconstrained scenarios.

Research


1. BPOIC problem: RGB-D face recognition, 3D face modeling, biometrics and soft-biometrics, visual attribute learning, presentation attack detection, emotion recognition; rPPG based physiological measurement, medial image analysis (XRay, CT, MRI, Echocardiography, etc.).
2. BPOIC methodology: Multimodal data enhancement and processing based on self-supervised learning, cross-modality correlation, and domain knowledge; multi-modality complementary feature representation learning and cross-modality correlation modeling; spatial-temporal representation learning; multi-task leaning via task correlation and heterogeneity modeling; learning with missing and noisy labels.


Papers

Journal Papers

1.    Hu Han, Jie Li, Anil Jain, Shiguang Shan, Xilin Chen, "Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), Jan. 2019.(Accepted)

2.    Hu Han, Anil K.Jain, Fang Wang, Shiguang Shan, Xilin Chen, "Heterogeneous Face Attribute Estimation:A Deep Multi-Task Learning Approach," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI), vol. 40, no. 11, pp. 2597-2609, Nov. 2018. 【pdf】

3.    Keyurkumar Patel, Hu Han, Anil K.Jain, "Secure Face Unlock:Spoof Detection on Smartphones," IEEE Transactions on Information Forensics and Security, vol. 11, no. 10, pp. 2268-2283, 2016. 【pdf】

4.    Di Wen, Hu Han, Anil K.Jain, "Face Spoof Detection with Image Distortion Analysis," IEEE Transactions on Information Forensics and Security, vol. 10, no. 4, pp. 746-761, 2015. 【pdf】

5.    Hu Han, Charles Otto, Xiaoming Liu, Anil K.Jain, "Demographic Estimation from Face Images:Human vs. Machine Performance," IEEE Transactions on Pattern Analysis and Machine Intelligence(TPAMI2015), vol. 37, no. 6, pp. 1148-1161, 2015. 【pdf】

6.    Lacey Best-Rowden, Hu Han, Charles Otto, Brendan Klare, Anil K.Jain, "Unconstrained Face Recognition:Identifying a Person of Interest from a Media Collection," IEEE Transactions on Information Forensics and Security, vol. 9, no. 12, pp. 2144-2157, 2014. 【pdf】

7.    Scott Klum, Hu Han, Brendan Klare, Anil K.Jain, "The Face Sketch ID System:Matching Facial Composites to Mugshots," IEEE Transactions on Information Forensics and Security, vol. 9, no. 12, pp. 2248-2263, 2014. 【pdf】

8.    Dongoh Kang, Hu Han, Anil K.Jain, Seong-Whan Lee, "Nighttime Face Recognition at Large Standoff:Cross-Distance and Cross-Spectral Matching," Pattern Recognition, vol. 47, no. 12, pp. 3750-3766, 2014. 【pdf】

9.    Hu Han, Brendan Klare, Kathryn Bonnen, Anil K.Jain, "Matching Composite Sketches to Face Photos:A Component Based Approach," IEEE Transactions on Information Forensics and Security, vol. 8, no. 1, pp. 191-204, 2013. 【pdf】

Conference Papers

1.    Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, “Weakly Supervised Image Classification through Noise Regularization,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR2019), pp. 11517-11525,  Long Beach, California, USA, June 16-20, 2019. 【pdf】

2.    Guoqing Wang, Hu Han, Shiguang Shan, Xilin Chen, "Improving Cross-database Face Presentation Attack Detection via Adversarial Domain Adaptation," 12th IAPR International Conference on Biometrics (ICB 2019), pp. 1-8, Crete, Greece, Jun 4-7, 2019. 【pdf】

3.    Xuesong Niu, Hu Han, Songfan Yang, Yan Huang, Shiguang Shan, " Local Relationship Learning With Person-Specific Shape Regularization for Facial Action Unit Detection," IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp. 11917-11926, Long Beach, California, USA, June 16-20, 2019. 【pdf】

4.    Jiancheng Cai, Hu Han, Shiguang Shan, and Xilin Chen, "FCSR-GAN: End-to-end Learning for Joint Face Completion and Super-resolution,"  14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille, France, May 14-18, 2019. 【pdf】

5.    Shikang Yu, Hu Han, Shiguang Shan, Antitza Dantcheva, and Xilin Chen, "Improving Face Sketch Recognition via Adversarial Sketch-Photo Transformation,"  14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille, France, May 14-18, 2019. 【pdf】

6.    Xuesong Niu, Xingyuan Zhao, Hu Han, Abhijit Das, Antitza Dantcheva, Shiguang Shan, Xilin Chen,"Robust Remote Heart Rate Estimation from Face Utilizing Spatial-temporal Attention," 14th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2019), pp. 1-8, Lille,  France, May 14-18, 2019. 【pdf】

7.    Mengying Hu, Hu Han, Shiguang Shan, Xilin Chen, "Multi-label Learning from Noisy Labels with Non-linear Feature Transformation," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia. 【pdf】

8.    Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen, "VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Video," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia. 【pdf】

9.    Yuanshun Cui, Jie Li, Hu Han, Shiguang Shan, Xilin Chen, "TKDN: Scene Text Detection via Keypoints Detection," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia 【pdf】

10.    Jiyun Cui, Hu Han, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition: A Comparative Study of Representative Fusion Schemes," The 13th Chinese Conference on Biometric Recognition (CCBR2018), Xinjiang, China, Aug. 11-12, 2018. 【pdf】

11.    Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, "Mean-Variance Loss for Deep Age Estimation from A Face," IEEE Conference on Computer Vision and Pattern Recognition(CVPR2018), pp. 5285-5294, Salt Lake City, USA, Jun. 18-22, 2018. 【pdf】

12.    Gang Chen, Xufen Cai, Hu Han, Shiguang Shan, Xingguang Song, Xilin Chen, "HeadNet: Pedestrian Head Detection Utilizing Body in Context," The 13th IEEE Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, 2018. 【pdf】

13.    Hao Zhang, Hu Han, Jiyun Cui, Shiguang Shan, Xilin Chen. "RGB-D Face Recognition via Deep Complementary and Common Feature Learning," The 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG2018), pp. 1-8, Xi'an, China, May 15-19, 2018. 【pdf】

14.    Jiyun Cui, Hao Zhang, Hu Han, Shiguang Shan, Xilin Chen, "Improving 2D Face Recognition Via Discriminative Face Depth Estimation," IAPR International Conference on Biometrics(ICB2018), pp. 1-8, Queensland, Australia, 2018. 【pdf】

15.    Xuesong Niu, Hu Han, Jiabei Zeng, Xuran Sun, Shiguang Shan, Yan Huang, Songfan Yang, Xilin Chen, "Automatic Engagement Prediction with GAP Feature," ACM International Conference on Multimodal Interaction (ICMI2018), pp. 599-603, Boulder, CO, USA, October 16–20, 2018. 【pdf】

16.    Hongyu Pan, Hu Han, Shiguang Shan, Xilin Chen, "Revised Contrastive Loss for Robust Age Estimation From Face," The 24th International Conference on Pattern Recognition (ICPR2018), pp. 3586-3591, Beijing, China, Aug. 20-24, 2018. 【pdf】

17.    Xuesong Niu, Hu Han, Shiguang Shan, Xilin Chen. "SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific," The 24th International Conference on Pattern Recognition (ICPR2018), Beijing, China, Aug. 20-24, 2018. 【pdf】

18.    Yu Song, Yuanshun Cui, Hu Han, Shiguang Shan, Xilin Chen. "Scene Text Detection via Deep Semantic Feature Fusion and Attention-based Refinement," The 24th International Conference on Pattern Recognition (ICPR2018), Beijing, China, Aug. 20-24, 2018. 【pdf】

19.    Fang Wang, Hu Han, Shiguang Shan, Xilin Chen, "Deep Multi-Task Learning for Joint Prediction of Heterogeneous Face Attributes," IEEE International Conference on Face and Gesture Recognition(FG2017), 2017. 【pdf】

20.    Sixue Gong, Hu Han, Shiguang Shan, Xilin Chen, "Actions Recognition in Crowd Based on Coarse-to-Fine Multi-Object Tracking," Asian Conference on Computer Vision Workshops(ACCV2016), Nov. 20-24, 2016. 【pdf】


Visual Information Processing and Learning
  • Address :No.6 Kexueyuan South Road
  • Zhongguancun,Haidian District
  • Beijing,China
  • Postcode :100190
  • Tel : (8610)62600514
  • Email:yi.cheng@vipl.ict.ac.cn
  • Valse

  • Big Lecture of DL

Copyright @ Visual Information Processing and Learning 京ICP备05002829号 京公网安备1101080060