您当前的位置:
张杰
张杰 研究员
电子邮箱: zhangjie@ict.ac.cn
通讯地址: 北京海淀区中关村科学院南路6号
研究方向: 计算机视觉与模式识别,多模态大模型,自主智能体及其安全
个人简介

张杰,中国科学院计算技术研究所研究员、博士生导师,国家基金委青年科学基金项目B类(原优青)获得者、中国图像图形学会青工委副秘书长。研究方向:计算机视觉与模式识别、多模态大模型、自主智能体及其安全,在知名期刊会议TPAMI/IJCV/TIP/CVPR/ICCV等上发表论文50余篇,承担科技部重点研发课题、中国科学院先导B课题、国家信息安全计划、科技部青年科学家课题、基金委面上、青基等项目10余项,研究成果在华为手机、智能高铁、工业质检、大模型安全测评等场景得到规模化应用,授权发明专利21项。曾获CSIG青年科学家奖,CCF科技进步奖二等奖(序1)、CSIG自然科学奖一等奖(序5)、中国铁道学会科技奖二等奖(序4)。先后入选北京市科技新星、姑苏领军人才计划、中科院青促会和微软青年学者铸星计划。担任ICML、NeurIPS、AAAI、ACL等CCF-A类会议领域主席,IEEE TIP、Pattern Recognition期刊编委、智能安全期刊青年编委。


指导学生情况:

2019年至今指导/联合指导博士生和硕士生20余名,其中2人获所长特别奖(计算所最高奖学金),4人获国家奖学金,3人获三好学生标兵,2人获北京市优秀毕业生,2人晋升计算所副研究员,多人获得知名企业的Special Offer(腾讯青云计划、京东管培生、美团北斗计划、华为SSP等),指导的国科大本科生2人获校优秀毕业论文,本人获易方达科技奖教金。


近五年承担参与项目的情况:

[1] 国家自然科学基金青年科学基金B类【原国家优秀青年科学基金项目】,名称:复杂场景视觉表示学习;经费:200万;执行期:2027.01-2029.12;项目负责人 

[2] 科技部重点研发计划课题,名称:数据污染与后门检测;经费:200万;执行期:2026.02-2027.01;课题负责人

[3] 中国科学院先导B课题,名称:算法滥用检测与评估;经费:1258.63万;执行期:2023.12-2028.11;课题负责人

[4] 科技部重点研发计划-青年科学家项目课题,名称:基于DNA的生物物证来源人脸部表征遗传推测技术研究;经费:180万元;执行期:2021.11-2024.12;课题负责人

[5] 国家信息安全计划,名称:面向多模态信息的智能推荐安全风险评价关键技术研究;经费:135万元;执行期:2023.12-2024.12;项目负责人

[6] 科技部重点研发计划项目子课题,名称:多模态大模型评估体系;经费:80万;执行期:2024.12-2027.11;子课题负责人

[7] 北京市科技新星项目,名称:安全可靠的视觉感知研究;经费:40万元;执行期:2023.10-2026.10;项目负责人

[8] NSFC面上项目,名称:面向图像分割的弱监督方法与技术研究;经费:57万元;执行期:2022.01-2025.12;项目负责人


研究生招生:

通常每年秋季招收计算所学籍1名博士生+1名硕士生,国科大交叉学院2名博士生,欢迎有计算机视觉、多模态推理、自主智能体及安全基础的同学前来客座!

For more information, please refer to https://jiezhang010.github.io/

经历

教育经历

2007.09-2011.07 中国地质大学(武汉) 软件工程 学士

2011.09-2017.07 中科院计算所 计算机应用技术 博士

学术经历

2026.10至今 中国科学院计算技术研究所,研究员

2019.09-2026.09 中国科学院计算技术研究所,副研究员

2017.07-2019.09 中国科学院计算技术研究所,助理研究员


学术服务

刊物服务

担任国际期刊IEEE TIP、Pattern Recognition的编委

长期担任TPAMI,IJCV,TIP,TMM,TNNLS,TCSVT,PR,TITS, Neural Networks, Information Sciences, Information Fusion, Computers & Security, Expert Systems With Applications, Knowledge-Based Systems, Neurocomputing等期刊审稿人

会议服务

担任国际会议ICML、NeurIPS、AAAI、ACL领域主席

长期担任CVPR,ICCV,ECCV,NeurIPS,ICLR等会议审稿人

研究内容

1.    对抗攻击与防御、后门攻击与检测

2.    智能体长程推理与自进化

3.   智能体自主性安全评估与增强

4.    算法公平性、隐私泄露评估与加固

5.    价值观偏离度量与对齐

6.    伪造人脸检测与溯源、活体检测

邀请报告与论著

论文

[TPAMI 2026] Yingjie Liu, Zonghui Guo, Ximeng Li, Jie Zhang, Haiyong Zheng, Shiguang Shan. Delving Deep Into Unraveling Spatio-Temporal Forgery Cues for Face Forgery Video Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Sibo Wang, Xiangkui Cao, Jie Zhang*, Zheng Yuan, Shiguang Shan, Xilin Chen, Wen Gao. Vlbiasbench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-language Model. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Zonghui Guo, Yingjie Liu, Jie Zhang, Haiyong Zheng, Shiguang Shan. Revisiting Face Forgery Detection: From Facial Representation to Forgery Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Jie Zhang, Shuai Dong, Shiguang Shan*, Xilin Chen. Towards Transferable Defense Against Malicious Image Edits. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[IJCV 2026] Zhiyuan Chen, Yuecong Min, Jie Zhang*, Bei Yan, Jiahao Wang, Xiaozhen Wang, Shiguang Shan. A Survey of Multimodal Hallucination Evaluation and Detection. International Journal of Computer Vision (IJCV), 2026.

[IJCV 2026] Liang Shi, Jie Zhang*, Shiguang Shan. Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation. International Journal of Computer Vision (IJCV), 2026.

[ICML 2026] Sen Nie, Jie Zhang*, Zhuo Wang, Shiguang Shan, Xilin Chen. Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIP. International Conference on Machine Learning (ICML), 2026.

[CVPR 2026] Sen Nie, Jie Zhang*, Jianxin Yan, Shiguang Shan, Xilin Chen. V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026.

[ACL 2026] Junqi Yang, Yuecong Min, Jie Zhang*, Shiguang Shan, Xilin Chen. INFACT: A Diagnostic Benchmark for Induced Faithfulness and Factuality Hallucinations in Video-LLMs. The Annual Meeting of the Association for Computational Linguistics (ACL) 2026.

[ECCV 2026] Xiangkui Cao, Jie Zhang*, Meina Kan, Shiguang Shan, Xilin Chen. Neural Gate: Mitigating Privacy Risks in LVLMs via Neuron-Level Gradient Gating. European Conference on Computer Vision (ECCV), 2026.

[TPAMI 2025] Zhongqi Wang, Jie Zhang*, Shiguang Shan, Xilin Chen. Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Models. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.

[TPAMI 2025] Xingming Long, Jie Zhang*, Shiguang Shan. Generalized Face Liveness Detection via De-fake Face Generator. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.

[TIP 2025] Zheng Yuan, Jie Zhang*, Shiguang Shan, Xilin Chen. FullLoRA: Efficiently Boosting the Robustness of Pretrained Vision Transformers. IEEE Transactions on Image Processing (TIP), 2025.

[TIFS 2025] Xingming Long, Jie Zhang*, Shiguang Shan. Confidence aware learning for reliable face anti-spoofing. IEEE Transactions on Information Forensics and Security (TIFS), 2025

[CVPR 2025] Zonghui Guo, Yingjie Liu, Jie Zhang, Haiyong Zheng, Shiguang Shan. Face Forgery Video Detection via Temporal Forgery Cue Unraveling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.

[MM 2025] Bei Yan, Zhiyuan Chen, Yuecong Min, Jie Zhang*, Jiahao Wang, Xiaozhen Wang, Shiguang Shan. SHALE: A Scalable Benchmark for Fine-grained Hallucination Evaluation in LVLMs. ACM International Conference on Multimedia (ACM MM), 2025.

[ICLR 2025] Jie Zhang, Zhongqi Wang, Mengqi Lei, Zheng Yuan, Bei Yan, Shiguang Shan, Xilin Chen. Dysca: A Dynamic and Scalable Benchmark for Evaluating Perception Ability of LVLMs. International Conference on Learning Representations (ICLR), 2025.

[TPAMI 2024] Zheng Yuan, Jie Zhang*, Zhaoyan Jiang, Liangliang Li, Shiguang Shan. Adaptive Perturbation for Adversarial Attack. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.

[IJCV 2024] Zheng Yuan, Jie Zhang*, Yude Wang, Shiguang Shan, Xilin Chen. Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinement. International Journal of Computer Vision (IJCV), 2024.

[TIP 2024]Mingjie He, Jie Zhang, Shiguang Shan*, Xilin Chen. Enhancing Face Recognition with Detachable Self-Supervised Bypass Networks. IEEE Transactions on Image Processing (TIP), vol. 33, pp. 1588 – 1599, 2024.

[CVPR 2024] SiboWang, Jie Zhang, Zheng Yuan, Shiguang Shan. Pre-trained Model Guided Fine-Tuning for Zero-Shot Adversarial Robustness. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[CVPR 2024] Zonghui Guo, Xinyu Han, Jie Zhang, Shiguang Shan, Haiyong Zheng. Video Harmonization with Triplet Spatio-Temporal Variation Patterns. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[ECCV 2024] Zhongqi Wang, Jie Zhang*, Shiguang Shan, Xilin Chen. T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models. European Conference on Computer Vision (ECCV), 2024.

[CVIU 2024] Changzhen Li, Jie Zhang*, Shuzhe Wu, Xin Jin, Shiguang Shan. Hierarchical Compositional Representations for Few-shot Action Recognition. Computer Vision and Image Understanding (CVIU), vol. 240, pp. 103911, 2024.

[TIP 2023] Yude Wang, Jie Zhang*, Meina Kan, Shiguang Shan, Xilin Chen. BLPSeg: Balance the Label Preference in Scribble-Supervised Semantic Segmentation. IEEE Transactions on Image Processing (TIP), vol. 32, pp. 4921-4934, 2023.

[TIFS 2023] Xingming Long, Jie Zhang, Shuzhe Wu, Xin Jin, Shiguang Shan*. Dual Sampling Based Causal Intervention for Face Anti-Spoofing with Identity Debiasing. IEEE Transactions on Information Forensics and Security (TIFS), vol. 19, pp. 851-862, 2023.

[MM 2023] Qiankun Li, Xiaolong Huang, Zhifan Wan, Lanqing Hu, Shuzhe Wu, Jie Zhang, Shiguang Shan, Zengfu Wang. Data-efficient Masked Video Modeling for Self-supervised Action Recognition. ACM International Conference on Multimedia (ACM MM), pp. 2723-2733, 2023. 

[CVPR 2022] Mingjie He, Jie Zhang, Shiguang Shan, Xilin Chen. Enhancing Face Recognition With Self-Supervised 3D Reconstruction. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4062-4071, 2022.

[PR 2022]Yude Wang, Jie Zhang*, Meina Kan, Shiguang Shan. Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation. Pattern Recognition (PR), vol. 132, pp. 108925, 2022.

[ECCV 2022] Zheng Yuan, Jie Zhang*, Shiguang Shan. Adaptive Image Transformations for Transfer-Based Adversarial Attack. European Conference on Computer Vision (ECCV), pp. 1-17, 2022.

[TIP 2021] Mingjie He, Jie Zhang, Shiguang Shan*, Xiao Liu, Zhongqin Wu, Xilin Chen. Locality-aware Channel-wise Dropout for Occluded Face Recognition. IEEE Transactions on Image Processing (TIP), vol. 31, pp. 788-798, 2021.

[TIFS 2021] Yunpei Jia, Jie Zhang*, Shiguang Shan. Dual-branch Meta-learning Network with Distribution Alignment for Face Anti-spoofing. IEEE Transactions on Information Forensics and Security (TIFS), vol. 17, pp. 138-151, 2021.

[ICCV 2021] Zheng Yuan, Jie Zhang, Yunpei Jia, Chuanqi Tan, Tao Xue, Shiguang Shan. Meta Gradient Adversarial Attack. IEEE/CVF International Conference on Computer Vision (ICCV), pp. 7748-7757, 2021.

[PR 2021] Yunpei Jia, Jie Zhang, Shiguang Shan*, Xilin Chen. Unified Unsupervised and Semi-supervised Domain Adaptation Network for Cross-scenario Face Anti-spoofing. Pattern Recognition (PR), vol.115, pp. 107888, 2021.

[CVPR 2020] Yude Wang, Jie Zhang, Meina Kan, Shiguang Shan, Xilin Chen. Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12272-12281, 2020.

[CVPR 2020] Yunpei Jia, Jie Zhang, Shiguang Shan, Xilin Chen. Single-side Domain Generalization for Face Anti-spoofing. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8484-8493, 2020.

[PR 2018] Mingjie He, Jie Zhang, Shiguang Shan*, Meina Kan, Xilin Chen. Deformable Face Net for Pose Invariant Face Recognition. Pattern Recognition (PR), vol.100, pp. 107113, 2018.

[CVPR 2016] Jie Zhang, Meina Kan, Shiguang Shan, and Xilin Chen. Occlusion-free Face Alignment: Deep Regression Networks Coupled with De-corrupt AutoEncoders. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3428-3437, 2016.

[ICCV 2015] Jie Zhang, Meina Kan, Shiguang Shan, and Xilin Chen. Leveraging Datasets With Varying Annotations for Face Alignment via Deep Regression Network. IEEE International Conference on Computer Vision (ICCV), pp. 3801-3809, 2015.

[ECCV 2014] Jie Zhang, Shiguang Shan, Meina Kan, and Xilin Chen. Coarse-to-Fine Auto-encoder Networks (CFAN) for Real-time Face Alignment. European Conference on Computer Vision (ECCV), pp. 1-16, 2014.