Location:
Jie Zhang
Jie Zhang Professor
Email: zhangjie@ict.ac.cn
Research area: Computer Vision and Pattern Recognition, Multimodal Large Models, and Autonomous Agents and Their Security

Jie Zhang received his Ph.D. degree in computer science from the Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS), Beijing, China, in 2017. Now he is a professor at Institute of Computing Technology, Chinese Academy of Sciences. His research interests cover computer vision, pattern recognition, machine learning, particularly include adversarial attacks and defenses, domain generalization, AI safety and trustworthiness. He has published more than 50 papers in refereed journals and proceedings in the areas of computer vision and pattern recognition, such as TPAMI, IJCV, TIP, CVPR, ICCV and ECCV. He has also won several awards, namely, Championship Award in IEEE SaTML Backdoor Defense Challenge 2026, Championship Award in ACM MM Kinship Recognition Challenge 2017, Runner-up Award in IEEE CVPR Landmark Detection Challenge 2017, etc. He was successively selected for the Beijing Science and Technology Nova Program, the Youth Innovation Promotion Association of the Chinese Academy of Sciences, and the MSRA "Casting Star Project". He serves as an Area Chair for CCF-A conferences such as ICML, NeurIPS, AAAI, and ACL, and as Associate Editors for the journals IEEE TIP and Pattern Recognition.

Experience

Educational experience

2007.9-2011.7 China University of Geosciences, Wuhan, B.S.

2011.9-2017.6 the Institute of Computing Technology (ICT), Chinese Academy of Sciences (CAS), Beijing, Ph.D.


Academic service

Associate Editor

Pattern Recognition (PR)

IEEE Transactions on Image Processing (TIP)

IEEE Open Journal of Signal Processing (OJSP)


Area Chair

International Conference on Machine Learning (ICML), 2027

Annual Meeting of the Association for Computational Linguistics (ACL), 2027

AAAI Conference on Artificial Intelligence (AAAI), 2027

Annual Conference on Neural Information Processing Systems (NeurIPS), 2025

Annual Meeting of the Association for Computational Linguistics (ACL), 2025


Research content

1.   Adversarial Attacks and Defenses, Backdoor Attacks and Detection

2.   Long-Horizon Reasoning and Self-Evolution of Agents

3.   Safety Evaluation and Enhancement of Agent

4.   Fairness, Privacy Leakage Assessment

5.   Value Measurement and Alignment

6.   Deepfake Face Detection and Traceability, Liveness Detection


Research project
Invited Talks and Papers

Papers

[TPAMI 2026] Yingjie Liu, Zonghui Guo, Ximeng Li, Jie Zhang, Haiyong Zheng, Shiguang Shan. Delving Deep Into Unraveling Spatio-Temporal Forgery Cues for Face Forgery Video Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Sibo Wang, Xiangkui Cao, Jie Zhang*, Zheng Yuan, Shiguang Shan, Xilin Chen, Wen Gao. Vlbiasbench: A Comprehensive Benchmark for Evaluating Bias in Large Vision-language Model. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Zonghui Guo, Yingjie Liu, Jie Zhang, Haiyong Zheng, Shiguang Shan. Revisiting Face Forgery Detection: From Facial Representation to Forgery Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[TPAMI 2026] Jie Zhang, Shuai Dong, Shiguang Shan*, Xilin Chen. Towards Transferable Defense Against Malicious Image Edits. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026.

[IJCV 2026] Zhiyuan Chen, Yuecong Min, Jie Zhang*, Bei Yan, Jiahao Wang, Xiaozhen Wang, Shiguang Shan. A Survey of Multimodal Hallucination Evaluation and Detection. International Journal of Computer Vision (IJCV), 2026.

[IJCV 2026] Liang Shi, Jie Zhang*, Shiguang Shan. Anonymization Prompt Learning for Facial Privacy-Preserving Text-to-Image Generation. International Journal of Computer Vision (IJCV), 2026.

[ICML 2026] Sen Nie, Jie Zhang*, Zhuo Wang, Shiguang Shan, Xilin Chen. Contrastive Spectral Rectification: Test-Time Defense towards Zero-shot Adversarial Robustness of CLIP. International Conference on Machine Learning (ICML), 2026.

[CVPR 2026] Sen Nie, Jie Zhang*, Jianxin Yan, Shiguang Shan, Xilin Chen. V-Attack: Targeting Disentangled Value Features for Controllable Adversarial Attacks on LVLMs. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2026.

[ACL 2026] Junqi Yang, Yuecong Min, Jie Zhang*, Shiguang Shan, Xilin Chen. INFACT: A Diagnostic Benchmark for Induced Faithfulness and Factuality Hallucinations in Video-LLMs. The Annual Meeting of the Association for Computational Linguistics (ACL) 2026.

[ECCV 2026] Xiangkui Cao, Jie Zhang*, Meina Kan, Shiguang Shan, Xilin Chen. Neural Gate: Mitigating Privacy Risks in LVLMs via Neuron-Level Gradient Gating. European Conference on Computer Vision (ECCV), 2026.

[TPAMI 2025] Zhongqi Wang, Jie Zhang*, Shiguang Shan, Xilin Chen. Dynamic Attention Analysis for Backdoor Detection in Text-to-Image Diffusion Models. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.

[TPAMI 2025] Xingming Long, Jie Zhang*, Shiguang Shan. Generalized Face Liveness Detection via De-fake Face Generator. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.

[TIP 2025] Zheng Yuan, Jie Zhang*, Shiguang Shan, Xilin Chen. FullLoRA: Efficiently Boosting the Robustness of Pretrained Vision Transformers. IEEE Transactions on Image Processing (TIP), 2025.

[TIFS 2025] Xingming Long, Jie Zhang*, Shiguang Shan. Confidence aware learning for reliable face anti-spoofing. IEEE Transactions on Information Forensics and Security (TIFS), 2025

[CVPR 2025] Zonghui Guo, Yingjie Liu, Jie Zhang, Haiyong Zheng, Shiguang Shan. Face Forgery Video Detection via Temporal Forgery Cue Unraveling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025.

[MM 2025] Bei Yan, Zhiyuan Chen, Yuecong Min, Jie Zhang*, Jiahao Wang, Xiaozhen Wang, Shiguang Shan. SHALE: A Scalable Benchmark for Fine-grained Hallucination Evaluation in LVLMs. ACM International Conference on Multimedia (ACM MM), 2025.

[ICLR 2025] Jie Zhang, Zhongqi Wang, Mengqi Lei, Zheng Yuan, Bei Yan, Shiguang Shan, Xilin Chen. Dysca: A Dynamic and Scalable Benchmark for Evaluating Perception Ability of LVLMs. International Conference on Learning Representations (ICLR), 2025.

[TPAMI 2024] Zheng Yuan, Jie Zhang*, Zhaoyan Jiang, Liangliang Li, Shiguang Shan. Adaptive Perturbation for Adversarial Attack. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024.

[IJCV 2024] Zheng Yuan, Jie Zhang*, Yude Wang, Shiguang Shan, Xilin Chen. Towards Robust Semantic Segmentation against Patch-based Attack via Attention Refinement. International Journal of Computer Vision (IJCV), 2024.

[TIP 2024]Mingjie He, Jie Zhang, Shiguang Shan*, Xilin Chen. Enhancing Face Recognition with Detachable Self-Supervised Bypass Networks. IEEE Transactions on Image Processing (TIP), vol. 33, pp. 1588 – 1599, 2024.

[CVPR 2024] SiboWang, Jie Zhang, Zheng Yuan, Shiguang Shan. Pre-trained Model Guided Fine-Tuning for Zero-Shot Adversarial Robustness. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[CVPR 2024] Zonghui Guo, Xinyu Han, Jie Zhang, Shiguang Shan, Haiyong Zheng. Video Harmonization with Triplet Spatio-Temporal Variation Patterns. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024.

[ECCV 2024] Zhongqi Wang, Jie Zhang*, Shiguang Shan, Xilin Chen. T2IShield: Defending Against Backdoors on Text-to-Image Diffusion Models. European Conference on Computer Vision (ECCV), 2024.

[CVIU 2024] Changzhen Li, Jie Zhang*, Shuzhe Wu, Xin Jin, Shiguang Shan. Hierarchical Compositional Representations for Few-shot Action Recognition. Computer Vision and Image Understanding (CVIU), vol. 240, pp. 103911, 2024.

[TIP 2023] Yude Wang, Jie Zhang*, Meina Kan, Shiguang Shan, Xilin Chen. BLPSeg: Balance the Label Preference in Scribble-Supervised Semantic Segmentation. IEEE Transactions on Image Processing (TIP), vol. 32, pp. 4921-4934, 2023.

[TIFS 2023] Xingming Long, Jie Zhang, Shuzhe Wu, Xin Jin, Shiguang Shan*. Dual Sampling Based Causal Intervention for Face Anti-Spoofing with Identity Debiasing. IEEE Transactions on Information Forensics and Security (TIFS), vol. 19, pp. 851-862, 2023.

[MM 2023] Qiankun Li, Xiaolong Huang, Zhifan Wan, Lanqing Hu, Shuzhe Wu, Jie Zhang, Shiguang Shan, Zengfu Wang. Data-efficient Masked Video Modeling for Self-supervised Action Recognition. ACM International Conference on Multimedia (ACM MM), pp. 2723-2733, 2023. 

[CVPR 2022] Mingjie He, Jie Zhang, Shiguang Shan, Xilin Chen. Enhancing Face Recognition With Self-Supervised 3D Reconstruction. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4062-4071, 2022.

[PR 2022]Yude Wang, Jie Zhang*, Meina Kan, Shiguang Shan. Learning Pseudo Labels for Semi-and-weakly Supervised Semantic Segmentation. Pattern Recognition (PR), vol. 132, pp. 108925, 2022.

[ECCV 2022] Zheng Yuan, Jie Zhang*, Shiguang Shan. Adaptive Image Transformations for Transfer-Based Adversarial Attack. European Conference on Computer Vision (ECCV), pp. 1-17, 2022.

[TIP 2021] Mingjie He, Jie Zhang, Shiguang Shan*, Xiao Liu, Zhongqin Wu, Xilin Chen. Locality-aware Channel-wise Dropout for Occluded Face Recognition. IEEE Transactions on Image Processing (TIP), vol. 31, pp. 788-798, 2021.

[TIFS 2021] Yunpei Jia, Jie Zhang*, Shiguang Shan. Dual-branch Meta-learning Network with Distribution Alignment for Face Anti-spoofing. IEEE Transactions on Information Forensics and Security (TIFS), vol. 17, pp. 138-151, 2021.

[ICCV 2021] Zheng Yuan, Jie Zhang, Yunpei Jia, Chuanqi Tan, Tao Xue, Shiguang Shan. Meta Gradient Adversarial Attack. IEEE/CVF International Conference on Computer Vision (ICCV), pp. 7748-7757, 2021.

[PR 2021] Yunpei Jia, Jie Zhang, Shiguang Shan*, Xilin Chen. Unified Unsupervised and Semi-supervised Domain Adaptation Network for Cross-scenario Face Anti-spoofing. Pattern Recognition (PR), vol.115, pp. 107888, 2021.

[CVPR 2020] Yude Wang, Jie Zhang, Meina Kan, Shiguang Shan, Xilin Chen. Self-Supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 12272-12281, 2020.

[CVPR 2020] Yunpei Jia, Jie Zhang, Shiguang Shan, Xilin Chen. Single-side Domain Generalization for Face Anti-spoofing. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 8484-8493, 2020.

[PR 2018] Mingjie He, Jie Zhang, Shiguang Shan*, Meina Kan, Xilin Chen. Deformable Face Net for Pose Invariant Face Recognition. Pattern Recognition (PR), vol.100, pp. 107113, 2018.

[CVPR 2016] Jie Zhang, Meina Kan, Shiguang Shan, and Xilin Chen. Occlusion-free Face Alignment: Deep Regression Networks Coupled with De-corrupt AutoEncoders. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3428-3437, 2016.

[ICCV 2015] Jie Zhang, Meina Kan, Shiguang Shan, and Xilin Chen. Leveraging Datasets With Varying Annotations for Face Alignment via Deep Regression Network. IEEE International Conference on Computer Vision (ICCV), pp. 3801-3809, 2015.

[ECCV 2014] Jie Zhang, Shiguang Shan, Meina Kan, and Xilin Chen. Coarse-to-Fine Auto-encoder Networks (CFAN) for Real-time Face Alignment. European Conference on Computer Vision (ECCV), pp. 1-16, 2014.