中国科学院 丨 所主站丨 中文
Research
Affective Computing
Audio-Visual Speech Understanding Group
Face Recognition
Media Learning and Knowledge Reasoning
Multimedia Computing and Multimodal Intelligent
Multimodal Biometric
Sign Language Recognition
Visual Modeling
Visual Scene Understanding
AI Safety and Trustworthiness Group
Multimedia Computing and Multimodal Intelligent
Leader： Shuqiang Jiang (Professor)
Email： sqjiang [at] ict.ac.cn
Introduction of research group
Papers

Journal Papers

  • Qizheng Wang, Meiyi Yao, Xinhang Song, Yandong Liu, Xiaoying Xing, Yongye Chen, Fangbo Zhao, Ke Liu, Xiaoguang Cheng, Shuqiang Jiang, Ning Lang. Automated Segmentation and Classification of Knee Synovitis Based on MRI Using Deep Learning. Academic Radiology, Vol. 31, No. 4, pp. 1518-1527, 2024.
  • Tianyu Zhang, Weiqing Min, Tao Liu, Shuqiang Jiang, Yong Rui. Toward Egocentric Compositional Action Anticipation with Adaptive Semantic Debiasing. ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), Vol. 20, No. 5, pp. 1-21, 2024.
  • Yancun Yang, Weiqing Min, Jingru Song, Guorui Sheng, Lili Wang, Shuqiang Jiang. Lightweight Food Recognition via Aggregation Block and Feature Encoding. ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), Vol. 20, No. 10, pp. 1-25, 2024.
  • Xinhang Song, Bohan Wang, Liye Dong, Gongwei Chen, Xinyun Hu, Shuqiang Jiang. Object-to-Manipulation Graph for Affordance Navigation. CAAI Artificial Intelligence Research, 3: 9150032, 2024.
  • Tingjing Zhang, Mingyu Huang, Liangkai Chen, Yang Xia, Weiqing Min, Shuqiang Jiang. Machine learning and statistical models to predict all-cause mortality in type 2 diabetes: Results from the UK Biobank study. Diabetes & Metabolic Syndrome: Clinical Research & Reviews, 18(9): 103135, 2024.
  • Guorui Sheng, Weiqing Min, Tao Yao, Jingru Song, Yancun Yang, Lili Wang, Shuqiang Jiang. Lightweight Food Image Recognition with Global Shuffle Convolution. IEEE Transactions on AgriFood Electronics (TAFE), Vol. 2, No. 2, pp. 392-402, 2024.
  • Pengfei Zhou, Weiqing Min, Jiajun Song, Yang Zhang, Shuqiang Jiang. Synthesizing knowledge-enhanced features for real-world zero-shot food detection. IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 1285-1298, 2024.
  • Yuxin Liu, Weiqing Min, Shuqiang Jiang, Yong Rui. Convolution-Enhanced Bi-Branch Adaptive Transformer with Cross-Task Interaction for Food Category and Ingredient Recognition. IEEE Transactions on Image Processing (TIP), Vol. 33, pp. 2572-2586, 2024.
  • Qizheng Wang, Meiyi Yao, Xinhang Song, et al.. Automated Segmentation and Classification of Knee Synovitis Based on MRI Using Deep Learning. Academic Radiology, 2023.
  • Weiqing Min, Zhiling Wang, Yuxin Liu, Mengjiang Luo, Liping Kang, Xiaoming Wei, Xiaolin Wei, Shuqiang Jiang*. Large Scale Visual Food Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol. 45, No. 8, pp. 9932 - 9949, Aug. 2023.
  • Yongqing Zhu, Xiangyang Li, Mao Zheng, Jiahao Yang, Zihan Wang, Xiaoqian Guo, Zifeng Chai, Yuchen Yuan, Shuqiang Jiang. Focus and Align: Learning Tube Tokens for Video-Language Pre-training. IEEE Transactions on Multimedia (TMM), Vol. 25, pp. 8036 - 8050, 2023.
  • Xiaoqian Guo, Xiangyang Li, Yaowei Wang, Shuqiang Jiang. TransWeaver: Weave Image Pairs for Class Agnostic Common Object Detection. IEEE Transactions on Image Processing (TIP), vol. 32, pp. 2947-2959, 2023.
  • Weiqing Min, Chunlin Liu, Leyi Xu and Shuqiang Jiang. Applications of knowledge graphs for the food science and industry. Patterns (Cell Press), 3(5): 100484 (2022)
  • 闵巍庆, 刘林虎, 刘宇昕, 罗梦江, 蒋树强. 食品图像识别方法综述. 计算机学报, 45(3): 542-566, 2022.
  • 刘宇昕，闵巍庆，蒋树强，芮勇. 多尺度拼图重构网络的食品图像识别. 软件学报, 33(11): 1-17, 2022.
  • Haitao Zeng, Xinhang Song, Gongwei Chen, Shuqiang Jiang. Amorphous Region Context Modeling for Scene Recognition. IEEE Transactions on Multimedia, 24: 141-151, 2022.
  • Zhiling Wang, Weiqing Min, Zhuo Li, Liping Kang, Xiaoming Wei, Xiaolin Wei, Shuqiang Jiang. Ingredient-Guided Region Discovery and Relationship Modeling for Food Category-Ingredient Prediction. IEEE Transactions on Image Processing （TIP）, 31: 5214-5226, 2022.
  • Yaohui Zhu, Weiqing Min and Shuqiang Jiang. Attribute-Guided Feature Learning for Few-Shot Image Recognition. IEEE Transactions on Multimedia (TMM), 23: 1200-1209, 2021.
  • Shuqiang Jiang, Weiqing Min, Linhu Liu, Zhengdong Luo, \"Multi-Scale Multi-View Deep Feature Aggregation for Food Recognition,\" IEEE Trans. on Image Processing, 29(1): 265-276, 2020.
  • Xinhang Song, Shuqiang Jiang, Bohan Wang, Chengpeng Chen, Gongwei Chen, "Image Representations with Spatial Object-to-Object Relations for RGB-D Scene Recognition," IEEE Transactions on Image Processing (TIP), vol.29, pp.525-537, 2020.

Conference Papers

  • Zihan Wang, Xiangyang Li, Jiahao Yang, Yeqi Liu, Shuqiang Jiang. Sim-to-Real Transfer via 3D Feature Fields for Vision-and-Language Navigation. Conference on Robot Learning (CRL), Munich, Germany, Nov. 6-9, 2024.
  • Xiaohan Wang, Yuehu Liu, Xinhang Song, Yuyi Liu, Sixian Zhang, Shuqiang Jiang. An Interactive Navigation Method with Effect-oriented Affordance. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 16446-16456, Seattle WA, USA, Jun. 17-21, 2024.
  • Zihan Wang, Xiangyang Li, Jiahao Yang, Yeqi Liu, Junjie Hu, Ming Jiang, Shuqiang Jiang. Lookahead Exploration with Neural Radiance Representation for Continuous Vision-Language Navigation. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 13753-13762, Seattle WA, USA, Jun. 17-21, 2024.
  • Sixian Zhang, Xinyao Yu, Xinhang Song, Xiaohan Wang, Shuqiang Jiang. Imagine Before Go: Self-Supervised Generative Map for Object Goal Navigation. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 16414-16425, Seattle WA, USA, Jun. 17-21, 2024.
  • Yuyi Liu, Xinhang Song, Weijie Li, Xiaohan Wang, Shuqiang Jiang. A Category Agnostic Model for Visual Rearrangement. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 16457-16466, Seattle WA, USA, Jun. 17-21, 2024.
  • Xinyao Yu, Sixian Zhang, Xinhang Song, Xiaorong Qin, Shuqiang Jiang. Trajectory Diffusion for ObjectGoal Navigation. Annual Conference on Neural Information Processing Systems (NeurIPS), Vancouver, Canada, Dec. 10-15, 2024.
  • Xiaohan Wang, Yuehu Liu, Xinhang Song, Beibei Wang, Shuqiang Jiang. CaMP: Causal Multi-policy Planning for Interactive Navigation in Multi-room Scenes. Annual Conference on Neural Information Processing Systems (NeurIPS), New Orleans, LA, Dec. 10-16, 2023.
  • Jiajun Song, Zhuo Li, Weiqing Min, Shuqiang Jiang. Towards Food Image Retrieval via Generalization-oriented Sampling and Loss Function Design, ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 20, No. 1, pp. 1-19, 2023.
  • Sujuan Hou, Jiacheng Li, Weiqing Min, Qiang Hou, Yanna Zhao, Yuanjie Zheng, Shuqiang Jiang. Deep Learning for Logo Detection: A Survey, ACM Transactions on Multimedia Computing, Communications and Applications, Vol. 20, No. 3, pp. 1-23, 2023.
  • Tianyu Zhang, Weiqing Min, Xinyang Han, Shuqiang Jiang. A Survey on Future Action Anticipation in Videos. CHINESE JOURNAL OF COMPUTERS, Vol. 46, No. 6, pp: 1315-1338, 2023.
  • Weiqing Min, Zhiling Wang, Jiahao Yang, Chunlin Liu, Shuqiang Jiang. Vision-based fruit recognition via multi-scale attention CNN. Computers and Electronics in Agriculture, Vol. 210, 2023.
  • Wenjing Shao, Weiqing Min, Sujuan Hou, Mengjiang Luo, Tianhao Li and Yuanjie Zheng and Shuqiang Jiang. Vision-based Food Nutrition Estimation via RGB-D Fusion Network. Food Chemistry, Vol. 424, 2023.
  • Tianhao Li, Wensong Wei, Weiqing Min, Shujuan Xing, Chunjiang Zhang, Shuqiang Jiang. Deep Learning-based Near-infrared Hyperspedtral Imaging for Food Nutrition Estimation. Foods, Vol. 12, No 17, pp. 3145, 2023.
  • Xinhang Song, Chenlong Liu, Haitao Zeng, Yaohui Zhu, Gongwei Chen, Xiaorong Qin, Shuqiang Jiang: Composite Object Relation Modeling for Few-Shot Scene Recognition. IEEE Transactions on Image Processing (TIP), Vol. 32, pp. 5678-5691, 2023.
  • Mengjiang Luo, Weiqing Min, Zhiling Wang, Jiajun Song, Shuqiang Jiang. Ingredient Prediction via Context Learning Network with Class-Adaptive Asymmetric Loss. IEEE Transaction on Image Processing, Vol. 32, pp. 5509-5523, 2023.
  • Jiahao Yang, Xiangyang Li, Mao Zheng, Zihan Wang, Yongqing Zhu, Xiaoqian Guo, Yuchen Yuan, Zifeng Chai, Shuqiang Jiang. MemBridge: Video-Language Pre-training with Memory-Augmented Inter-Modality Bridge. IEEE Transactions on Image Processing (TIP), vol. 32, pp. 4073-4087, 2023.
  • Haitao Zeng, Xinhang Song, Shuqiang Jiang: Multi-Object Navigation Using Potential Target Position Policy Function. IEEE Transactions on Image Processing (TIP), Vol. 32, pp. 2608-2619, 2023.
  • Xiaohan Wang, Yuehu Liu, Xinhang Song, Beibei Wang, Shuqiang Jiang. Generating Explanations for Embodied Action Decision from Visual Observation. Proceedings of the 31st ACM International Conference on Multimedia, pp. 2838-2846, Ottawa, Canada, 2023.
  • Xiaorong Qin, Xinhang Song, Shuqiang Jiang. Bi-level Meta-learning for Few-shot Domain Generalization. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 15900-15910, Vancouver, Canada, Jun. 18-22, 2023.
  • Sixian Zhang, Xinhang Song, Weijie Li, Yubing Bai, Xinyao Yu, Shuqiang Jiang. Layout-Based Causal Inference for Object Navigation. IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10792-10802, Vancouver, Canada, Jun. 18-22, 2023.