📝 Publications

Notes:（*）indicates the equal contributions and（†）indicates the corresponding author.

👁 Survey and Position Papers

上海人工智能实验室主任周伯文: 通专融合是实现AGI的战略路径之一

NeurIPS 2024 Exploring Adversarial Robustness of Deep State Space Models, Biqing Qi, Yiang Luo, Junqi Gao, Pengfei Li, Kai Tian, Zhiyuan Ma, Bowen Zhou
SPL 2024 Enhancing Adversarial Transferability via Information Bottleneck Constraints, Biqing Qi, Junqi Gao, Jianxing Liu, Ligang Wu, Bowen Zhou Code
NAACL 2024 On Large Language Models’ Hallucination with Regard to Known Facts, Che jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou
NeurIPS 2023 Perturbation towards easy samples improves targeted adversarial transferability Junqi Gao*, Biqing Qi*, Yao Li, Zhichang Guo, Da Li, Yuming Xing, Dazhi Zhang
TNNLS 2023 Improving robustness of intent detection under adversarial attacks: A geometric constraint perspective Biqing Qi, Bowen Zhou, Weinan Zhang, Jianxing Liu, Ligang Wu
Arxiv Investigating Deep Watermark Security: An Adversarial Transferability Perspective, Biqing Qi, Junqi Gao, Yiang Luo, Jianxing Liu, Ligang Wu, Bowen Zhou
ACM MM 2024 Safe-SD: Safe and Traceable Stable Diffusion with Text Prompt Trigger for Invisible Generative Watermarking, Zhiyuan Ma, Guoli Jia, Biqing Qi, Bowen Zhou

世界人工智能大会报道: Interactive Continual Learning框架是实现通专融合的路径之一

Interactive Continual Learning

CVPR 2024 Interactive continual learning: Fast and slow thinking, Biqing Qi, Xinquan Chen, Junqi Gao, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou,

This work was the first to propose the concept of interactive continual learning.
Instantiated through the Cognitive Complementarity Theory (System1 and System2).
An advanced continual learning framework with the novel structured key-value pairs memory unit.
A potential framework to develop Specialized Generalist AI.

Contrastive Augmented Graph2Graph Memory Interaction

TCSVT 2025 Contrastive Augmented Graph2Graph Memory Interaction for Few Shot Continual Learning, Biqing Qi, Junqi Gao, Xingquan Chen, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou

CoGenesis

PaD

Arxiv SR-CIS: Self-Reflective Incremental System with Decoupled Memory and Reasoning, Biqing Qi, Junqi Gao, Xinquan Chen, Dong Li, Weinan Zhang, Bowen Zhou
Arxiv Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding, Kaiyan Zhang, Jianyu Wang, Ning Ding, Biqing Qi, Eermo Hua, Xingtai Lv, Bowen Zhou
AAAI 2025 (Oral) Fast and Slow Gradient Approximation for Binary Neural Network Optimization, Xinquan Chen, Junqi Gao, Biqing Qi†, Dong Li, Yiang Luo, Fangyuan Li, Pengfei Li
EMNLP 2023 CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model, Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xingwei Long, Bowen Zhou
Arxiv Intuitive Fine-Tuning: Towards Unifying SFT and RLHF into a Single Process, Eermo Hua, Biqing Qi, Kaiyan Zhang, Yue Yu, Ning Ding, Xintai Lv, Kai Tian, Bowen Zhou
NeurIPS 2024 Neural Residual Diffusion Models for Deep Scalable Vision Generation，Zhiyuan Ma, Liangliang Zhao, Biqing Qi, Bowen Zhou

Online DPO

Arxiv Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing, Biqing Qi, Pengfei Li, Fangyuan Li, Junqi Gao, Kaiyan Zhang, Bowen Zhou

ACL 2024 (Findings) SMR: State Memory Replay for Long Sequence Modeling, Biqing Qi, Junqi Gao, Kaiyan Zhang, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou
Arxiv S4++: Elevating Long Sequence Modeling with State Memory Reply, Biqing Qi, Junqi Gao, Dong Li, Kaiyan Zhang, Jianxing Liu, Ligang Wu, Bowen Zhou
EMNLP 2024 (Findings) On the token distance modeling ability of higher RoPE attention dimension, Xiangyu Hong, Che Jiang, Biqing Qi†, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou

Arxiv Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling, Runze Liu, Junqi Gao, Jian Zhao, Kaiyan Zhang, Xiu Li, Biqing Qi†, Wanli Ouyang and Bowen Zhou.
CVPR 2025 (Highlight) Less is More: Efficient Model Merging with Binary Task Switch, Biqing Qi, Fangyuan Li, Zhen Wang, Junqi Gao, Dong Li, Peng Ye, Bowen Zhou
Arxiv Evolution of Thought: Diverse and High-Quality Reasoning via Multi-Objective Optimization, Junqi Gao, Zhouyi Qian, Yiang Luo, Kaiyan Zhang, Biqing Qi†, Jianxing Liu
ICLR 2025 OpenPRM: Building Open-domain Process-based Reward Models with Preference Trees, Kaiyan Zhang, Jiayuan Zhang, Haoxin Li, Xuekai Zhu, Ermo Hua, Xingtai Lv, Ning Ding, Biqing Qi, Bowen Zhou
Arxiv GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning, Jian Zhao, Runze Liu, Kaiyan Zhang, Zhimu Zhou, Junqi Gao, Dong Li, Jiafei Lyu, Zhouyi Qian, Biqing Qi†, Xiu Li, Bowen Zhou
Arxiv Seeing Delta Parameters as JPEG Images: Data-Free Delta Compression with Discrete Cosine Transform, Chenyu Huang, Peng Ye, Xiaohui Wang, Shenghe Zheng, Biqing Qi, Lei Bai, Wanli Ouyang, Tao Chen

COLM 2024 Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation, Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, Zhang-Ren Chen, Sihang Zeng, Ermo Hua, Hu Jinfang, Bowen Zhou
Instruct Following@NeurIPS 2023 Large Language Models are Zero Shot Hypothesis Proposers, Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, Jin-Fang Hu, Bowen Zhou
NeurIPS 2024 D&B Track (Spotlight) UltraMedical: Building Specialized Generalists in Biomedicine, Kaiyan Zhang, Sihang Zeng, Eermo Hua, Ning Ding, Zhang-Ren Chen, Zhiyuan Ma, Hhaoxiang Li, Ganqu Cui, Biqing Qi, Xuekai Zhu, Bowen Zhou,