I’m a research scientist at the Shanghai AI Lab. Prior to that, I obtained my Ph.D. from the Key Laboratory of Autonomous Intelligent Unmanned Systems (AIUS) at Harbin Institute of Technology, with joint supervision from the Center for Collaborative & Conversational Intelligence (C3I) at Tsinghua University under the supervision of Bowen Zhou and Ligang Wu.

My research has contributed to over 30 papers at top-tier conferences and journals, including NeurIPS, CVPR, ACL, EMNLP, NAACL, TPAMI, TNNLS, TCSVT, and others.

Additionally, I’ve played a pivotal role in more than ten significant projects, including two under the Ministry of Science and Technology’s 2030 Key Special Project, two major R&D initiatives, and several key projects funded by the National Natural Science Foundations.

My research interests include: 1) trustworthy and continual learning theory, 2) knowledge-compositional foundation models（Specialized Generalist）, and 3) multimodal human-AI collaboration systems.

If you are seeking any form of academic collaborations with Shanghai AI Lab or AIUS, SCIR Lab at HIT and Tsinghua C3I Lab, please feel free to email me at qibiqing7@gmail.com or qibiqing@pjlab.org.cn

🔥 News

• 2024.10: 🎉 Four papers are accepted by NeurIPS 2024（One Dataset Track）
• 2024.09: 🎉 Two papers are accepted by EMNLP 2024 (One Findings)
• 2024.07: 🎉 Two papers are accepted by COLM 2024 and ACM MM 2024
• 2024.05: 🎉 Two papers are accepted by ACL 2024 (One Findings)
• 2024.02: 🎉 Two papers are accepted by CVPR 2024 and SPL 2024
• 2023.10: 🎉 Two papers are accepted by NAACL 2024 (Oral)
• 2023.08: 🎉 Two papers are accepted by NeurIPS 2023 and TNNLS 2023

📝 Publications

• Notes:（*）indicates the equal contributions and（^）indicates the corresponding author.

👁 Survey and Position Papers

上海人工智能实验室主任周伯文: 通专融合是实现AGI的战略路径之一

• Arxiv Towards Building Specialized Generalist AI with System 1 and System 2 Fusion, Kaiyan Zhang*, Biqing Qi*, Bowen Zhou.

🎙 Trustworthy Machine Learning theory

• NeurIPS 2024 Exploring Adversarial Robustness of Deep State Space Models, Biqing Qi, Yiang Luo, Junqi Gao, Pengfei Li, Kai Tian, Zhiyuan Ma, Bowen Zhou
• SPL 2024 Enhancing Adversarial Transferability via Information Bottleneck Constraints, Biqing Qi, Junqi Gao, Jianxing Liu, Ligang Wu, Bowen Zhou Code
• NAACL 2024 On Large Language Models’ Hallucination with Regard to Known Facts, Che jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou
• NeurIPS 2023 Perturbation towards easy samples improves targeted adversarial transferability Junqi Gao*, Biqing Qi*, Yao Li, Zhichang Guo, Da Li, Yuming Xing, Dazhi Zhang
• TNNLS 2023 Improving robustness of intent detection under adversarial attacks: A geometric constraint perspective Biqing Qi, Bowen Zhou, Weinan Zhang, Jianxing Liu, Ligang Wu

🌱 Specialized Generalist

世界人工智能大会报道: Interactive Continual Learning框架是实现通专融合的路径之一

Interactive Continual Learning

CVPR 2024 Interactive continual learning: Fast and slow thinking, Biqing Qi, Xinquan Chen, Junqi Gao, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou,

• This work was the first to propose the concept of interactive continual learning.
• Instantiated through the Cognitive Complementarity Theory (System1 and System2).
• An advanced continual learning framework with the novel structured key-value pairs memory unit.
• A potential framework to develop Specialized Generalist AI.

Contrastive Augmented Graph2Graph Memory Interaction

Arxiv Contrastive Augmented Graph2Graph Memory Interaction for Few Shot Continual Learning, Biqing Qi, Junqi Gao, Xingquan Chen, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou

CoGenesis

ACL 2024 CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following, Kaiyan Zhang, Jianyu Wang, Ermo Hua, Biqing Qi, Ning Ding, Bowen Zhou

PaD

NAACL 2024 PaD: Program-aided Distillation Can Teach Small Models Reasoning Better than Chain-of-thought Fine-tuning, Xuekai Zhu, Biqing Qi, Kaiyan Zhang, Xinwei Long, Zhouhan Lin, Bowen Zhou

• Arxiv Efficient Adversarial High-Density Data Replay for Continual Learning, Junqi Gao, Biqing Qi^, Kai Tian, Dong Li, Pengfei Li
• Arxiv SR-CIS: Self-Reflective Incremental System with Decoupled Memory and Reasoning, Biqing Qi, Junqi Gao, Xinquan Chen, Dong Li, Weinan Zhang, Bowen Zhou
• Arxiv Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding, Kaiyan Zhang, Jianyu Wang, Ning Ding, Biqing Qi, Eermo Hua, Xingtai Lv, Bowen Zhou
• Arxiv Fast and Slow Gradient Approximation for Binary Neural Network Optimization, Xinquan Chen, Junqi Gao, Biqing Qi^, Dong Li, Yiang Luo, Fangyuan Li, Pengfei Li
• EMNLP 2023 CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model, Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xingwei Long, Bowen Zhou
• Arxiv Intuitive Fine-Tuning: Towards Unifying SFT and RLHF into a Single Process, Eermo Hua, Biqing Qi, Kaiyan Zhang, Yue Yu, Ning Ding, Xintai Lv, Kai Tian, Bowen Zhou
• NeurIPS 2024 Neural Residual Diffusion Models for Deep Scalable Vision Generation，Zhiyuan Ma, Liangliang Zhao, Biqing Qi, Bowen Zhou

Online DPO

Arxiv Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing, Biqing Qi, Pengfei Li, Fangyuan Li, Junqi Gao, Kaiyan Zhang, Bowen Zhou

• ACL 2024 (Findings) SMR: State Memory Replay for Long Sequence Modeling, Biqing Qi, Junqi Gao, Kaiyan Zhang, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou
• Arxiv S4++: Elevating Long Sequence Modeling with State Memory Reply, Biqing Qi, Junqi Gao, Dong Li, Kaiyan Zhang, Jianxing Liu, Ligang Wu, Bowen Zhou
• EMNLP 2024 (Findings) On the token distance modeling ability of higher RoPE attention dimension, Xiangyu Hong, Che Jiang, Biqing Qi, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou

📚 Human-AI Collaboration Systems

Embodied Agents

• EMNLP 2024 MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making, Dayuan Fu*, Biqing Qi^, Yihuai Gao, Che Jiang, Guanting Dong, Bowen Zhou

Deep Watermarking

• Arxiv Investigating Deep Watermark Security: An Adversarial Transferability Perspective, Biqing Qi, Junqi Gao, Yiang Luo, Jianxing Liu, Ligang Wu, Bowen Zhou
• ACM MM 2024 Safe-SD: Safe and Traceable Stable Diffusion with Text Prompt Trigger for Invisible Generative Watermarking, Zhiyuan Ma, Guoli Jia, Biqing Qi, Bowen Zhou

Hypothesis Proposers

• COLM 2024 Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation, Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, Zhang-Ren Chen, Sihang Zeng, Ermo Hua, Hu Jinfang, Bowen Zhou
• Instruct Following@NeurIPS 2023 Large Language Models are Zero Shot Hypothesis Proposers, Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, Jin-Fang Hu, Bowen Zhou
• NeurIPS 2024 D&B Track (Spotlight) UltraMedical: Building Specialized Generalists in Biomedicine, Kaiyan Zhang, Sihang Zeng, Eermo Hua, Ning Ding, Zhang-Ren Chen, Zhiyuan Ma, Hhaoxiang Li, Ganqu Cui, Biqing Qi, Xuekai Zhu, Bowen Zhou,

⚔ Teams

Shanghai AI Lab Interns

Specialized Generalist

• Shuang Cheng, (2024.11-, 3rd Master’s, Institute of Automation), CIKM’24, etc.
• Dawei Liu, (2024.11-, 1st Ph.D., Shanghai Jiao Tong University).
• Yuying Li, (2024.11-, 1st Master’s, Tsinghua Univeristy).（Visiting Student）

Multi-Agents

• Junqi Gao, (2024.9-, 2nd Ph.D., Harbin Institute of Technology), NIPS’23,’24, CVPR’24, ACL’24, etc.
• Dong Li, (2024.10-, 2nd Ph.D., Harbin Institute of Technology), NIPS’24, CVPR’24, etc.
• Runze Liu, (2024.10-, 2nd Master’s, Tsinghua University), ICLR’23, ICML’24, etc.
• Jing Xiao, (2024.10-, 2nd Master’s, Fudan University), AAAI’25 under reivew.
• Yifan Hu, (2024.10-, 1st Master’s, Tsinghua University), CIKM’24, ICLR‘25 under review.（Remote Intern）
• Xialie Zhuang, (2024.10-, 1st Ph.D., University of Science and Technology of China). (Remote Intern)

Human-AI collaboration Team at Tsinghua C3I lab

• Che Jiang, Kai Tian, Chekai Cheng, Yinghao Chen, Juncheng Wu, Xiangyu Hong, Zheng Yang, Liya Ma, Can Yang, Siqi Song, Chenxuan Wei, Shengzhe Zhu, Hang Yu, Jian Zhao, Yichao Liu.

Interdisciplinary Team with AIUS, SCIR lab

• Pengfei Liu, Fangyuan Li, Yiang Luo, Zouyi Qian, Xiang Zou, Ying Ai, Yichen Niu.

⚔ Projects

Commodity Price Risk Prediction and Demonstration Application Sep.2023-Sep.2026

• (Key Participants) National Science and Technology Major Project:
• Responsible for the technical planning of Project 2 and leading the team in advancing the construction of the labeling system within LLMs.

Research on Theory and Applications of Human-AI Collaboration with LLMs Jan.2024-Jan.2027

• (Key Participants) National Science and Technology Major Project:
• Responsible for designing the project architecture, planning technical aspects, and overseeing the development of human-machine collaborative systems, along with conducting applied research in knowledge discovery for Project 3.

Cognitive Load Optimization in Human-Machine Collaboration Mar.2023-Dec.2026

• (Participated) Key Research Program of the Ministry of Science and Technology in 2030:
• Responsible for project management within Tsinghua Group, as well as interaction modeling and reflective framework optimization in LLMs.

Research for Product Insight, Design, Development to Marketing Innovation Sep.2023-Dec.2025

• Participated）Beijing Municipal Science and Technology Commission Key Project.
• Responsible for project architecture, planing technical aspects.

Proteomics Data based Knowledge Discovery Mar.2022-Dec.2023

• (Student Lead) Preliminary Research Project for Major Scientific Plan.
• Responsible for project architecture, planning technical aspects, and guiding the design of human-AI systems with respect to hypothesis proposers.

Demonstration of Personified Human-Machine Dialogue System Mar.2020-Dec.2023

• (Participated) Key Research Program of the Ministry of Science and Technology in 2030:
• Responsible for the development of a robust dialogue intent detection method.