您当前的位置:
手语组
组 长: 陈熙霖 研究员
Email: xlchen [at] ict dot ac dot cn
课题组简介

    随着计算设备的发展,日常生活中的人机交互越来越重要。下一代人机交互应该是自然的、高效的、并且是以用户为中心的。基于视觉的手势/手语识别是交互的核心技术之一。因此,本课题组的研究集中在手势分析和手语识别方面。课题组连续获得2016、2017年度ChaLearn连续手语识别竞赛第一名。

研究内容

1) 手语的时空建模,包括稀疏的、稠密的手语描述以及基于深度特征的手势/手语建模等;
2) 手语识别算法,包括非特定人手语识别、连续手语识别、多模态手语识别等;
3) 动作质量评价,包括手势/手语/竞技动作等的规范化评价及教学系统等。

部分论文

刊物论文

  • Gaolin Fang, Wen Gao, Debin Zhao, “Large Vocabulary Sign Language Recognition Based on Fuzzy Decision Trees,” IEEE Transactions on System Man and Cybernetics, vol.34, no.3, pp305-314,May 2004.
  • Gaolin Fang, Wen Gao, Zhaoqi Wang, “Incorporating Linguistic Structure into Maximum Entropy Language Models,” Journal of Computer Science and Technology, vol.18, no.1, pp131-136,Jan.2003.
  • Wen Gao, Gaolin Fang, Debin Zhao, Yiqiang Chen, “A Chinese Sign Language Recognition System Based on SOFM/HMM/SRN,” Pattern Recognition, vol.37, no.12, pp2389-2402,Dec.2004.
  • Qi Wang, Xilin Chen, Liang-Guo Zhang, Chunli Wang, Wen Gao, “Viewpoint invariant sign language recognition,” Computer Vision and Image Understanding, vol.108, no.1-2, pp.87-97,Oct.2007.
  • Yu Zhou, Xilin Chen, Debin Zhao, Hongyun Yao, Wen Gao, “Adaptive Sign Language Recognition With Exemplar Extraction and MAP/IVFS,” Signal Processing Letters, IEEE, vol.17, no.3, pp.297–300,Mar.2010.
  • Hanjie Wang, Jingjing Fu, Yan Lu, Xilin Chen, Shipeng Li, “Depth Sensor Assisted Real-time Gesture Recognition for Interactive Presentation,” Journal of Visual Communication and Image Representation, Nov.2013.
  • 马志国,苗军,卿来云, 陈熙霖, 基于局部随机游走的超像素分割方法, 高技术通讯, no.10,pp.991-998, 2014.12.
  • Hanjie Wang, Xiujuan Chai, Xilin Chen, \"Sparse Observation(SO)Alignment for Sign Language Recognition,\" Neurocomputing, 2016.
  • Hanjie Wang, Xiujuan Chai, Xiaopeng Hong, Guoying Zhao, Xilin Chen, \"Isolated Sign Language Recognition with Grassmann Covariance Matrices,\" ACM Transactions on Accessible Computing, 2016.
  • Zhipeng Liu, Xiujuan Chai, Xilin Chen, \"Deep Memory and Prediction Neural Network for Video Prediction\", Neurocomputing, Vol. 331, pp.235-241, Feb. 28, 2019.

会议论文

  • Dalu Feng, Shuang Yang, Shiguang Shan, Xilin Chen, "Audio-Driven Deformation Flow for Effective Lip Reading," International Conference on Pattern Recognition (ICPR), 2022. (Accepted)
  • Xiujuan Chai, Zhihao Xu, Qian Li, Bingpeng Ma, Xilin Chen, “Robust Hand Tracking by Integrating Appearance, Location and Depth Cues,” ICIMCS, Wu Han, China, pp.60-65, Sept.2012.
  • Hanjie Wang, Qi Wang, Xilin Chen, “Hand Posture Recognition from Disparity Cost Map,” ACCV, Daejeon, Korea, Nov.2012.
  • Xiujuan Chai, Guang Li, Xilin Chen, Ming Zhou, Guobin Wu, Hanjing Li, “VisualComm: A Tool to Support Communication between Deaf and Hearing Persons with the Kinect,” In Proceedings of The 15th ACM SIGACCESS International Conference on Computers and Accessibility(ACM SIGACCESS2013), Seattle, USA, Oct.2013.
  • Xiaowei Zhao, Shiguang Shan, Xiujuan Chai, Xilin Chen, “Cascaded Shape Space Pruning for Robust Facial Landmark Detection,” International Conference on Computer Vision(ICCV2013),pp.1033-1040, Dec.2013.
  • Qi Wang, Xilin Chen, Wen Gao, “Skin Color Weighted Disparity Competition for Hand Segmentation from Stereo Camera,” in Processing of British Machine Vision Conference, BMVC, Aberystwyth, UK, Aug.2010.
  • Xiujuan Chai, Guang Li, Yushun Lin, Zhihao Xu, Yili Tang, Xilin Chen, Ming Zhou, “Sign Language Recognition and Translation with Kinect,” In Proceedings of IEEE International Conference on Automatic Face and Gesture Recognition(FG2013), Shanghai, CN, Apr.2013.
  • Fang Yin, Xiujuan Chai, Yu Zhou, Xilin Chen, \"Semantics Constrained Dictionary Learning for Signer-independent Sign Language Recognition,\" IEEE International Conference on Image Processing(ICIP2015), Quebec City, Canada, 2015.
  • Hanjie Wang, Xiujuan Chai, Yu Zhou, Xilin Chen, \"Fast Sign Language Recognition Benefited From Low Rank Approximation,\" IEEE International Conference on Automatic Face and Gesture Recognition(FG2015), Ljubljana, Slovenia, 2015.
  • Fang Yin, Xiujuan Chai, Yu Zhou, Xilin Chen, \"Weakly Supervised Metric Learning Towards Signer Adaptation for Sign Language Recognition,\" British Machine Vision Conference(BMVC2015), Swanse, UK, 2015.
  • Xiujuan Chai, Hanjie Wang, Fang Yin, Xilin Chen, \"Communication Tool for the Hard of Hearings,\" International Conference on Affective Computing and Intelligent Interaction(ACII2015), Xi\'an, China, 2015.
  • Xiujuan Chai, Zhipeng Liu, Fang Yin, Zhuang Liu, Xilin Chen, \"Two Streams Recurrent Neural Networks for Large-Scale Continuous Gesture Recognition,\" International Conference on Pattern Recognition Workshop(ICPR2016), 2016.
  • Fang Yin, Xiujuan Chai, Xilin Chen, \"Iterative Reference Driven Metric Learning for Signer-Independent Isolated Sign Language Recognition,\" European Conference on Computer Vision(ECCV2016), Amsterdam, Netherlands, 2016.
  • Zhipeng Liu, Xiujuan Chai, Zhuang Liu, Xilin Chen, \"Continuous Gesture Recognition with Hand-Oriented Spatiotemporal Feature,\" IEEE International Conference on Computer Vision(ICCV2017)workshop, pp. 4321-4329, 2017.
  • Xiujuan Chai, Zhuang Liu, Yongjun Li, Fang Yin, Xilin Chen, \"SignInstructor:An Effective Tool for Sign Language Vocabulary Learning,\" Asian Conference on Pattern Recognition, 2017.
  • Yongjun Li, Xiujuan Chai, Xilin Chen, “ScoringNet——Learning Key Fragment for Action Quality Assessment with Ranking Loss in Skilled Sports\", Asian Conference on Computer Vision(ACCV2018), Perth, Australia, 2018.
  • Yuecong Min, Xiujuan Chai, Lei Zhao, Xilin Chen, \"FlickerNet: Adaptive 3D Gesture Recognition from Sparse Point Clouds,\" Proceedings of the 30th British Machine Vision Conference (BMVC), pp. 1-13, Cardiff, UK, September, 9-12, 2019.
  • Kewen Wang, Xilin Chen, "PMD-Net: Privileged Modality Distillation Network for 3D Hand Pose Estimation from a Single RGB Image", British Machine Vision Conference (BMVC), 2020.
  • Yuecong Min, Yanxiao Zhang, Xiujuan Chai, Xilin Chen, \"An Efficient PointLSTM Network for Point Clouds based Gesture Recognition,\" IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2020), pp. 5761-5770, 2020.
  • Aiming Hao, Yuecong Min and Xilin Chen. Self-Mutual Distillation Learning for Continuous Sign Language Recognition. IEEE/CVF International Conference on Computer Vision (ICCV), pp. 11303-11312, Montreal, Canada, Oct. 11-17, 2021.