中科院计算所视觉信息处理与学习组
中科院计算所视觉信息处理与学习组


您所在的位置 / 科学研究

科学研究
视觉场景理解组

组  长:王瑞平 研究员

Email:ruiping.wang [at] vipl dot ict dot ac dot cn

在国家自然科学基金重大项目、科技部973项目等支持下,课题组立足于视觉模态信息的智能感知与认知理论方法的研究,实现对真实开放环境下自然场景的智能感知与理解。围绕图像视频分析与理解这一主题,针对图像视频检索、物体检测/识别、场景理解、场景关系建模、语义描述与问答等前沿核心问题进行布局,构建具有自主学习、动态更新机制的视觉概念库平台系统,致力于实现视觉智能从感知任务到认知任务的迈进。
研究内容

图像视频检索、物体检测/识别、视觉属性分析、场景理解、场景关系建模、语义描述与问答等。


  

部分论文

刊物论文

1.    Haomiao Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, “What is Tabby? Interpretable Model Decisions by Learning Attribute-based Classification Criteria,” IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Nov. 2019. (Accepted)

2.    Haomiao Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, “Learning Multifunctional Binary Codes for Personalized Image Retrieval,” International Journal of Computer Vision, Feb. 2020. (Accepted)

3.    Difei Gao, Ruiping Wang, Shiguang Shan, and Xilin Chen, "Learning to Recognize Visual Concepts for Visual Question Answering with Structural Label Space," IEEE Journal of Selected Topics in Signal Processing, 2020.(Accepted)

4.    Shishi Qiao, Ruiping Wang, Shiguang Shan, Xilin Chen, “Deep Heterogeneous Hashing for Face Video Retrieval,” IEEE Transactions on Image Processing, vol. 29, no. 1, pp. 1299-1312, Dec. 2020. 【pdf】

5.    Haomiao Liu, Ruiping Wang, Shiguang Shan and Xilin Chen, “Deep Supervised Hashing for Fast Image Retrieval,” International Journal of Computer Vision, vol. 127, no. 9, pp. 1217–1234, Sep. 2019. 【pdf】

6.    Wen Wang, Ruiping Wang, Zhiwu Huang, Shiguang Shan, Xilin Chen, “Discriminant Analysis on Riemannian Manifold of Gaussian Distributions for Face Recognition with Image Sets,” IEEE Transactions on Image Processing (TIP), vol. 27, no. 1, pp. 151-163, Jan. 2018. 【pdf】

7.    Zhiwu Huang, Ruiping Wang, Xianqiu Li, Wenxian Liu, Shiguang Shan, Luc Van Gool, Xilin Chen, "Geometry-aware Similarity Learning on SPD Manifolds for Visual Recognition," IEEE Transactions on circuits and systems for video technology, 28(10), Page(s):2513 – 2523. 2018.10. 【pdf】

8.    Huajie Jiang, Ruiping Wang, Shiguang Shan, Yan Li, Haomiao Liu, Xilin Chen, “Attribute Annotation on Large Scale Image Database by Active Knowledge Transfer,” Image and Vision Computing, vol. 78, pp. 1-13, Oct. 2018. 【pdf】

会议论文

1.    Wenbin Wang, Ruiping Wang, Shiguang Shan, Xilin Chen, "Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generation," European Conference on Computer Vision, Aug. 23-28, 2020. 【pdf】

2.    Difei Gao, Ke li, Ruiping Wang, Shiguang Shan, Xilin Chen, "Multi-Modal Graph Neural Network for Joint Reasoning on Vision and Scene Text," IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2020), pp. 12746–12756, 2020. 【pdf】

3.    Ruikui Wang, Shishi Qiao, Ruiping Wang, Shiguang Shan, Xilin Chen, "Hybrid Video and Image Hashing for Robust Face Retrieval," IEEE International Conference on Automatic Face and Gesture Recognition (FG 2020) , pp. 186-193, 2020. 【pdf】

4.    Ruikui Wang, Ruiping Wang, Shishi Qiao, Shiguang Shan, Xilin Chen, “Deep Position-Aware Hashing for Semantic Continuous Image Retrieval,” IEEE Winter Conference of Applications on Computer Vision (WACV 2020), pp. 2493–2502, Aspen, CO, Mar. 2-5, 2020. 【pdf】

5.    Sijin Wang, Ruiping Wang, Ziwei Yao, Shiguang Shan, Xilin Chen, “Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrieval,” IEEE Winter Conference of Applications on Computer Vision (WACV 2020), pp. 1508–1517, Aspen, CO, Mar. 2-5, 2020. 【pdf】

6.    Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen, “Transferable Contrastive Network for Generalized Zero-Shot Learning,” 17th IEEE International Conference on Computer Vision (ICCV 2019), pp. 9764-9773, Seoul, Korea, Oct. 27-Nov. 2, 2019. 【pdf】

7.    Wenbin Wang, Ruiping Wang, Shiguang Shan, Xilin Chen, “Exploring Context and Visual Pattern of Relationship for Scene Graph Generation,” IEEE Conference on Computer Vision and Pattern Recognition(CVPR), pp.8180–8189, Long Beach, California, USA, June 16-20, 2019. 【pdf】

8.    Yirong Mao, Ruiping Wang, Shiguang Shan, Xilin Chen, "COSONet: Compact Second-Order Network for Video Face Recognition," Asian Conference on Computer Vision 2018(ACCV2018), 2-6 Dec. 2018, Perth Western Australia. 【pdf】

9.    Chen He, Ruiping Wang, Shiguang Shan, Xilin Chen, “Exemplar-Supported Generative Reproduction for Class Incremental Learning,”29th British Machine Vision Conference (BMVC2018), Newcastle upon Tyne, UK, Sep. 3-6, 2018. 【pdf】

10.    Yong Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, “Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships,” IEEE Conference on Computer Vision and Pattern Recognition (CVPR2018), pp. 6985-6994, Salt Lake City, UT, June 18-22, 2018. 【pdf】

11.    Huajie Jiang, Ruiping Wang, Shiguang Shan, Xilin Chen, “Learning Class Prototypes via Structure Alignment for Zero-Shot Recognition,”15th European Conference on Computer Vision (ECCV2018), Munich, Germany, Sep. 8-14, 2018. 【pdf】

12.    Difei Gao, Ruiping Wang, Shiguang Shan, Xilin Chen, "Visual Textbook Network:Watch Carefully before Answering Visual Questions," British Machine Vision ConferenceConference(BMVC2017), 2017. 【pdf】

13.    Haomiao Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, "Learning Multifunctional Binary Codes for Both Category and Attribute Oriented Retrieval Tasks," IEEE Conference on Computer Vision and Pattern Recognition(CVPR2017), 2017. 【pdf】

14.    Huajie Jiang, Ruiping Wang, Shiguang Shan, Yi Yang, Xilin Chen, "Learning Discriminative Latent Attributes for Zero-Shot Classification," IEEE International Conference on Computer Vision(ICCV2017), Venice, Italy, 2017. 【pdf】

15.    Shishi Qiao, Ruiping Wang, Shiguang Shan, Xilin Chen, "Deep Video Code for Efficient Face Video Retrieval," Asian Conference on Computer Vision(ACCV2016), 2016. 【pdf】

16.    Yuheng Lu, Ruiping Wang, Shiguang Shan, Xilin Chen, "Multiple-shot Person Re-identification via Riemannian Discriminative Learning," Asian Conference on Computer Vision Workshops(ACCV2016), 2016. 【pdf】

17.    Haomiao Liu, Ruiping Wang, Shiguang Shan, Xilin Chen, "Deep Supervised Hashing for Fast Image Retrieval," IEEE Conference on Computer Vision and Pattern Recognition(CVPR2016), 2016. 【pdf】

18.    Yan Li, Ruiping Wang, Haomiao Liu, Huajie Jiang, Shiguang Shan, Xilin Chen, "Two Birds,One Stone:Jointly Learning Binary Code for Large-Scale Face Image Retrieval and Attributes Prediction," IEEE International Conference on Computer Vision(ICCV2015), 2015. 【pdf】

19.    Mengyi Liu, Shaoxin Li, Shiguang Shan, Ruiping Wang, Xilin Chen, “Deeply Learning Deformable Facial Action Parts Model for Dynamic Expression Analysis,” in Proceedings of Asian Conference on Computer Vision(ACCV2014), Singapore, Nov.2014. 【pdf】

20.    Mengyi Liu, Ruiping Wang, Shaoxin Li, Shiguang Shan, Zhiwu Huang, Xilin Chen, “Combining Multiple Kernel Methods on Riemannian Manifold for Emotion Recognition in the Wild,” in Proceedings of ACM International Conference on Multimodal Interaction(ICMI2014), Istanbul, Turkey, Nov.2014. 【pdf】


视觉信息处理和学习组
  • 单位地址:北京海淀区中关村科学院南路6号
  • 邮编:100190
  • 联系电话:010-62600514
  • Email:yi.cheng@vipl.ict.ac.cn
  • Valse

  • 深度学习大讲堂

版权所有 @ 中科院计算所视觉信息处理与学习组 京ICP备05002829号 京公网安备1101080060