中科院计算所视觉信息处理与学习组
中科院计算所视觉信息处理与学习组


您所在的位置 / 科学研究

科学研究
手语组

组  长:陈熙霖 研究员

Email:xlchen [at] ict dot ac dot cn

随着计算设备的发展,日常生活中的人机交互越来越重要。下一代人机交互应该是自然的、高效的、并且是以用户为中心的。基于视觉的手势/手语识别是交互的核心技术之一。因此,本课题组的研究集中在手势分析和手语识别方面。课题组连续获得2016、2017年度ChaLearn连续手语识别竞赛第一名。
研究内容

1) 手语的时空建模,包括稀疏的、稠密的手语描述以及基于深度特征的手势/手语建模等;
2) 手语识别算法,包括非特定人手语识别、连续手语识别、多模态手语识别等;
3) 动作质量评价,包括手势/手语/竞技动作等的规范化评价及教学系统等。

部分论文

刊物论文

1.    Zhipeng Liu, Xiujuan Chai, Xilin Chen, "Deep Memory and Prediction Neural Network for Video Prediction", Neurocomputing. (Accepted)2018

2.    Hanjie Wang, Xiujuan Chai, Xiaopeng Hong, Guoying Zhao, Xilin Chen, "Isolated Sign Language Recognition with Grassmann Covariance Matrices," ACM Transactions on Accessible Computing, 2016. 【pdf】

3.    Hanjie Wang, Xiujuan Chai, Xilin Chen, "Sparse Observation(SO)Alignment for Sign Language Recognition," Neurocomputing, 2016. 【pdf】

4.    马志国,苗军,卿来云, 陈熙霖, 基于局部随机游走的超像素分割方法, 高技术通讯, no.10,pp.991-998, 2014.12. 【pdf】

5.    Hanjie Wang, Jingjing Fu, Yan Lu, Xilin Chen, Shipeng Li, “Depth Sensor Assisted Real-time Gesture Recognition for Interactive Presentation,” Journal of Visual Communication and Image Representation, Nov.2013. 【pdf】

6.    Guorong Li, Qingming Huang, Lei Qin and Shuqiang Jiang, “SSOCBT: A Robust Semi-Supervised Online CovBoost Tracker by Using Samples Differently”, IEEE Transactions on Circuits and Systems for Video Technology, Vol. 23, No. 4, 2013, 695-709.

7.    Yu Zhou, Xilin Chen, Debin Zhao, Hongyun Yao, Wen Gao, “Adaptive Sign Language Recognition With Exemplar Extraction and MAP/IVFS,” Signal Processing Letters, IEEE, vol.17, no.3, pp.297–300,Mar.2010.

8.    Qi Wang, Xilin Chen, Liang-Guo Zhang, Chunli Wang, Wen Gao, “Viewpoint invariant sign language recognition,” Computer Vision and Image Understanding, vol.108, no.1-2, pp.87-97,Oct.2007.

9.    Wen Gao, Gaolin Fang, Debin Zhao, Yiqiang Chen, “A Chinese Sign Language Recognition System Based on SOFM/HMM/SRN,” Pattern Recognition, vol.37, no.12, pp2389-2402,Dec.2004. 【pdf】

10.    Gaolin Fang, Wen Gao, Debin Zhao, “Large Vocabulary Sign Language Recognition Based on Fuzzy Decision Trees,” IEEE Transactions on System Man and Cybernetics, vol.34, no.3, pp305-314,May 2004. 【pdf】

11.    Gaolin Fang, Wen Gao, Zhaoqi Wang, “Incorporating Linguistic Structure into Maximum Entropy Language Models,” Journal of Computer Science and Technology, vol.18, no.1, pp131-136,Jan.2003.

12.    Wen Gao , Jiyong Ma, Jiangqin Wu and Chunli Wang, “Large Vocabulary Sign Language Recognition Based on HMM/ANN/DP,” IJPRAI, Vol.14, No.5, pp587-602, 2000.

13.    Xu Lin, Gao Wen, “Human-Computer Chinese Sign Language Interaction System,” International Journal of Virtual Reality, 2000.

14.    Xu Lin, Gao Wen, Yao Hongxun, Ma Jiyong, “Study on Translating Chinese into Chinese Sign Language,” Journal of Computer Science and Technology.vol.15 no.5 pp485-490, 2000.

会议论文

1.    Yongjun Li, Xiujuan Chai, Xilin Chen, “ScoringNet——Learning Key Fragment for Action Quality Assessment with Ranking Loss in Skilled Sports", Asian Conference on Computer Vision(ACCV2018), Perth, Australia, 2018.

2.    Xiujuan Chai, Zhuang Liu, Yongjun Li, Fang Yin, Xilin Chen. SignInstructor:An Effective Tool for Sign Language Vocabulary Learning. Asian Conference on Pattern Recognition, 2017. 【pdf】

3.    Zhipeng Liu, Xiujuan Chai, Zhuang Liu, Xilin Chen, "Continuous Gesture Recognition with Hand-Oriented Spatiotemporal Feature," IEEE International Conference on Computer Vision(ICCV2017)workshop, pp. 4321-4329, 2017. 【pdf】

4.    Fang Yin, Xiujuan Chai, Xilin Chen, "Iterative Reference Driven Metric Learning for Signer-Independent Isolated Sign Language Recognition," European Conference on Computer Vision(ECCV2016), Amsterdam, Netherlands, 2016. 【pdf】

5.    Xiujuan Chai, Zhipeng Liu, Fang Yin, Zhuang Liu, Xilin Chen, "Two Streams Recurrent Neural Networks for Large-Scale Continuous Gesture Recognition," International Conference on Pattern Recognition Workshop(ICPR2016), 2016. 【pdf】

6.    Xiujuan Chai, Hanjie Wang, Fang Yin, Xilin Chen, "Communication Tool for the Hard of Hearings," International Conference on Affective Computing and Intelligent Interaction(ACII2015), Xi'an, China, 2015. 【pdf】

7.    Fang Yin, Xiujuan Chai, Yu Zhou, Xilin Chen, "Weakly Supervised Metric Learning Towards Signer Adaptation for Sign Language Recognition," British Machine Vision Conference(BMVC2015), Swanse, UK, 2015. 【pdf】

8.    Hanjie Wang, Xiujuan Chai, Yu Zhou, Xilin Chen, "Fast Sign Language Recognition Benefited From Low Rank Approximation," IEEE International Conference on Automatic Face and Gesture Recognition(FG2015), Ljubljana, Slovenia, 2015. 【pdf】

9.    Fang Yin, Xiujuan Chai, Yu Zhou, Xilin Chen, "Semantics Constrained Dictionary Learning for Signer-independent Sign Language Recognition," IEEE International Conference on Image Processing(ICIP2015), Quebec City, Canada, 2015. 【pdf】

10.    Xiaowei Zhao, Shiguang Shan, Xiujuan Chai, Xilin Chen, “Cascaded Shape Space Pruning for Robust Facial Landmark Detection,” International Conference on Computer Vision(ICCV2013),pp.1033-1040, Dec.2013. 【pdf】

11.    Xiujuan Chai, Guang Li, Xilin Chen, Ming Zhou, Guobin Wu, Hanjing Li, “VisualComm: A Tool to Support Communication between Deaf and Hearing Persons with the Kinect,” In Proceedings of The 15th ACM SIGACCESS International Conference on Computers and Accessibility(ACM SIGACCESS2013), Seattle, USA, Oct.2013. 【pdf】

12.    Xiujuan Chai, Guang Li, Yushun Lin, Zhihao Xu, Yili Tang, Xilin Chen, Ming Zhou, “Sign Language Recognition and Translation with Kinect,” In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition(FG2013), Shanghai, CN, Apr.2013. 【pdf】

13.    Hanjie Wang, Qi Wang, Xilin Chen, “Hand Posture Recognition from Disparity Cost Map,” ACCV, Daejeon, Korea, Nov.2012. 【pdf】

14.    Xiujuan Chai, Zhihao Xu, Qian Li, Bingpeng Ma, Xilin Chen, “Robust Hand Tracking by Integrating Appearance, Location and Depth Cues,” ICIMCS, Wu Han, China, pp.60-65, Sept.2012. 【pdf】

15.    Qi Wang, Xilin Chen, Wen Gao, “Skin Color Weighted Disparity Competition for Hand Segmentation from Stereo Camera,” in Processing of British Machine Vision Conference, BMVC, Aberystwyth, UK, Aug.2010.

16.    Liangguo Zhang, Xilin Chen, Chunli Wang, Wen Gao, “Robust automatic tracking of skin-colored objects with level set based occlusion handling,” in Proceedings of The 8th Int'l Gesture Workshop, GW'09, Bielefeld, Germany, Feb.2009.

17.    Yu Zhou, Xilin Chen, Debin Zhao, Hongxun Yao, Wen Gao, “Mahalanobis Distance Based Polynomial Segment Model For Chinese Sign Language Recogniton,” in Proceedings of 2008 IEEE International Conference on Multimedia and Expo, ICME 2008, Hannover, German, Jun.23-26, 2008.

18.    Qi Wang, Xilin Chen, Chunli Wang, and Wen Gao, “A Verification Method for Viewpoint Invariant Sign Language Recognition,” International Conference on Pattern Recognition, ICPR 2006, Hong Kong, Aug.20-24, 2006.

19.    Qi Wang, Xilin Chen, Chunli Wang, Wen Gao, “Sign Language Recognition From Homography,” 2006 IEEE International Conference on Multimedia and Expo, ICME 2006, Toronto, Ontario, Canada, pp429-432, Jul.09-12, 2006.

20.    Chunli Wang, Xilin Chen, Wen Gao, “Expanding Training Set for Chinese Sign Language Recognition,” 7th International Conference on Automatic Face and Gesture Recognition (FG06), Southampton, UK, pp323-328, Apr.10-12, 2006.


视觉信息处理和学习组
  • 单位地址:北京海淀区中关村科学院南路6号
  • 邮编:100190
  • 联系电话:010-62600514
  • Email:yi.cheng@vipl.ict.ac.cn
  • Valse

  • 深度学习大讲堂

版权所有 @ 中科院计算所视觉信息处理与学习组 京ICP备05002829号 京公网安备1101080060