中科院计算所视觉信息处理与学习组
中科院计算所视觉信息处理与学习组


您所在的位置 / 科学研究

科学研究
情感计算组

组  长:曾加贝 博士;山世光 研究员

Email:jiabei.zeng [at] vipl dot ict dot ac dot cn; sgshan [at] ict dot ac dot cn

情感计算组致力于研究采用机器学习等算法从视觉的角度感知并深刻理解人类的意图、情感和精神状态,主要包括情绪识别与分类、人脸动作单元检测、情感维度估计(如正负性valence、强度arousal)、心理状态和精神状况评估等。过去几年中,情感计算组在相关领域会议和期刊上发表多篇论文。

研究内容

该研究组的研究内容包括基于视觉的情感计算中的基本任务和应用两方面:
(1)基于视觉的情感计算基本任务

  • 离散情绪分类
  • 面部动作单元(facial action unit, AU)检测
  • 情感维度估计
  • 零样本多标签表情识别
  • 基于视觉的生理指标测量
  • 基于视觉的心理状态估计(如专注、无聊、紧张、焦虑等)

(2)基于视觉的情感计算应用

  • 金融信贷评估中的应用
  • 精神状况评估的客观化(儿童孤独症、抑郁症等)
  • 驾驶员状态评估

部分论文

刊物论文

1.    Mengyi Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, "Learning Prototypes and Similes on Grassmann Manifold for Spontaneous Expression Recognition," Computer Vision and Image Understanding, vol. 147, pp. 95-101, 2016. 【pdf】

2.    Mengyi Liu, Shiguang Shan, Ruiping Wang, Xilin Chen, "Learning Expressionlets via Universal Manifold Model for Dynamic Facial Expression Recognition," IEEE Transactions on Image Processing, vol. 25, no. 12, pp. 5920-5932, 2016. 【pdf】

3.    Mengyi Liu, Ruiping Wang, Shaoxin Li, Zhiwu Huang, Shiguang Shan, Xilin Chen, "Video Modeling and Learning on Riemannian Manifold for Emotion Recognition in the Wild," Journal on Multimodal User Interfaces, vol. 10, no. 2, pp. 113-124, 2016. 【pdf】

4.    Mengyi Liu, Shaoxin Li, Shiguang Shan, Xilin Chen, "AU-inspired Deep Networks for Facial Expression Feature Learning," Neurocomputing, vol. 159, pp. 126-136, 2015.

会议论文

1.    Yong Li, Jiabei Zeng, Shiguang Shan, Xilin Chen, "Self-supervised Representation Learning from Videos for Facial Action Unit Detection", IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.10924-10933, Long Beach, California, USA, June 16-20, 2019. 【pdf】

2.    Zijia Lu, Jiabei Zeng, Shiguang Shan, Xilin Chen, "Zero-Shot Facial Expression Recognition with Multi-Label Label Propagation," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia 【pdf】

3.    Jiabei Zeng, Shiguang Shan, Xilin Chen, "Facial Expression Recognition with Inconsistently Annotated Datasets," To appear in Proc. European Conference on Computer Vision (ECCV2018), pp. 1-16, Munich, Germany, 2018. 【pdf】

4.    Mengyi Liu, Xin Liu, Yan Li, Xilin Chen, Alexander Hauptmann, Shiguang Shan, "Exploiting Feature Hierarchies With Convolutional Neural Networks for Cultural Event Recognition," IEEE International Conference on Computer Vision(ICCV2015) Workshops, pp. 32-37, 2015. 【pdf】


视觉信息处理和学习组
  • 单位地址:北京海淀区中关村科学院南路6号
  • 邮编:100190
  • 联系电话:010-62600514
  • Email:yi.cheng@vipl.ict.ac.cn
  • Valse

  • 深度学习大讲堂

版权所有 @ 中科院计算所视觉信息处理与学习组 京ICP备05002829号 京公网安备1101080060