Publications

Yuxin Zuo, Shang Qu, Linhai Xie, Yifei Li, Zhangren Chen, Xuekai Zhu, Ermo Hua, Kaiyan Zhang, Ning Ding, Bowen Zhou (2025). MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understanding. ICML 2025.

Xuekai Zhu, Daixuan Cheng, Hengli Li, Kaiyan Zhang, Ermo Hua, Xingtai Lv, Ning Ding, Zhouhan Lin, Bowen Zhou (2025). How to Synthesize Text Data without Model Collapse?. ICML 2025.

Lifan Yuan, Wendi Li, Huayu Chen, Ganqu Cui, Ning Ding, Kaiyan Zhang, Bowen Zhou, Zhiyuan Liu, Hao Peng (2025). Free Process Rewards without Process Labels. ICML 2025.

Ermo Hua, Che Jiang, Xingtai Lv, Kaiyan Zhang, Ning Ding, Youbang Sun, Biqing Qi, Yuchen Fan, Xuekai Zhu, Bowen Zhou (2025). Fourier Position Embedding: Enhancing Attentions Periodic Extension for Length Generalization. ICML 2025.

Jian Zhao, Runze Liu, Kaiyan Zhang, Zhimu Zhou, Junqi Gao, Dong Li, Jiafei Lyu, Zhouyi Qian, Biqing Qi, Xiu Li, Bowen Zhou (2025). GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning. Arxiv.

Xingtai Lv, Youbang Sun, Kaiyan Zhang, Shang Qu, Xuekai Zhu, Yuchen Fan, Yi Wu, Ermo Hua, Xinwei Long, Ning Ding, Bowen Zhou (2025). Technologies on Effectiveness and Efficiency: A Survey of State Spaces Models. Arxiv.

Biqing Qi, Fangyuan Li, Zhen Wang, Junqi Gao, Dong Li, Peng Ye, Bowen Zhou (2025). Less is More: Efficient Model Merging with Binary Task Switch. CVPR 2025.

Runze Liu, Junqi Gao, Jian Zhao, Kaiyan Zhang, Xiu Li, Biqing Qi, Wanli Ouyang, Bowen Zhou (2025). Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling. Arxiv.

Kaiyan Zhang, Jiayuan Zhang, Haoxin Li, Xuekai Zhu, Ermo Hua, Xingtai Lv, Ning Ding, Bowen Zhou (2025). OpenPRM: Building Open-domain Process-based Reward Models with Preference Trees. ICLR 2025.

Lifan Yuan, Ganqu Cui, Hanbin Wang, Ning Ding, Xingyao Wang, Jia Deng, Huimin Chen, Ruobing Xie, Yankai Lin, Zhenghao Liu, Boji Shan, Bowen Zhou, Hao Peng, Zhiyuan Liu, Maosong Sun (2025). Advancing LLM Reasoning Generalists with Preference Trees. ICLR 2025.

Chao Yang, Chaochao Lu, Yingchun Wang, Bowen Zhou (2024). Towards AI-45^{\circ} Law: A Roadmap to Trustworthy AGI. Arxiv.

Ning Ding, Shang Qu, Linhai Xie, Yifei Li, Zaoqu Liu, Kaiyan Zhang, Yibai Xiong, Yuxin Zuo, Zhangren Chen, Ermo Hua, Xingtai Lv, Youbang Sun, Yang Li, Dong Li, Fuchu He, Bowen Zhou (2024). Automating exploratory proteomics research via language models.. Arxiv.

Xinwei Long, Zhiyuan Ma, Ermo Hua, Kaiyan Zhang, Biqing Qi, Bowen Zhou (2024). Retrieval-Augmented Visual Question Answering via Built-in Autoregressive Search Engines.. AAAI 2025.

Yulin Chen, Ning Ding, Hai-Tao Zheng, Zhiyuan Liu, Maosong Sun, Bowen Zhou (2024). Empowering private tutoring by chaining large language models.. CIKM 2024.

Zhiyuan Ma, Liangliang Zhao, Biqing Qi, Bowen Zhou (2024). Neural Residual Diffusion Models for Deep Scalable Vision Generation. arXiv preprint.

Zhiyuan Ma, Yuzhu Zhang, Guoli Jia, Liangliang Zhao, Yichao Ma, Mingjie Ma, Gaofeng Liu, Kaiyan Zhang, Jianjun Li, Bowen Zhou (2024). Efficient Diffusion Models: A Comprehensive Survey from Principles to Practices. TPAMI-2025.

Xingtai Lv, Ning Ding, Kaiyan Zhang, Ermo Hua, Ganqu Cui, Bowen Zhou (2024). Scalable Efficient Training of Large Language Models with Low-dimensional Projected Attention. EMNLP 2024.

Xiangyu Hong, Che Jiang, Biqing Qi, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou (2024). On the token distance modeling ability of higher RoPE attention dimension. EMNLP 2024.

Dayuan Fu, Biqing Qi, Yihuai Gao, Che Jiang, Guanting Dong, Bowen Zhou (2024). MSI-Agent: Incorporating Multi-Scale Insight into Embodied Agents for Superior Planning and Decision-Making. EMNLP 2024.

Kaiyan Zhang, Biqing Qi, Bowen Zhou (2024). Towards Building Specialized Generalist AI with System 1 and System 2 Fusion. arXiv preprint.

Zhiyuan Ma, Guoli Jia, Biqing Qi, Bowen Zhou (2024). Safe-SD: Safe and Traceable Stable Diffusion with Text Prompt Trigger for Invisible Generative Watermarking . ACM MM.

Kaiyan Zhang, Sihang Zeng, Ermo Hua, Ning Ding, Zhang-Ren Chen, Zhiyuan Ma, Haoxin Li, Ganqu Cui, Biqing Qi, Xuekai Zhu, Xingtai Lv, Jin-Fang Hu, Zhiyuan Liu, Bowen Zhou (2024). UltraMedical: Building Specialized Generalists in Biomedicine. NeurIPS 2024.

PDF Cite Code Dataset

Biqing Qi, Yiang Luo, Junqi Gao, Pengfei Li, Kai Tian, Zhiyuan Ma, Bowen Zhou (2024). Exploring Adversarial Robustness of Deep State Space Models. NeurIPS 2024.

Biqing Qi, Pengfei Li, Fangyuan Li, Junqi Gao, Kaiyan Zhang, Bowen Zhou (2024). Online DPO: Online Direct Preference Optimization with Fast-Slow Chasing. arXiv preprint.

Ermo Hua, Biqing Qi, Kaiyan Zhang, Yue Yu, Ning Ding, Xingtai Lv, Kai Tian, Bowen Zhou (2024). Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process. arXiv preprint.

Kaiyan Zhang, Jianyu Wang, Ning Ding, Biqing Qi, Ermo Hua, Xingtai Lv, Bowen Zhou (2024). Fast and Slow Generating: An Empirical Study on Large and Small Language Models Collaborative Decoding. arXiv preprint.

Biqing Qi, Junqi Gao, Jianxing Liu, Ligang Wu, Bowen Zhou (2024). Enhancing Adversarial Transferability via Information Bottleneck Constraints. IEEE Signal Processing Letters.

Xinwei Long, Jiali Zeng, Fandong Meng, Jie Zhou, Bowen Zhou (2024). Trust in Internal or External Knowledge? Generative Multi-Modal Entity Linking with Knowledge Retriever. ACL Findings.

Biqing Qi, Junqi Gao, Kaiyan Zhang, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou (2024). SMR: State Memory Replay for Long Sequence Modeling. ACL Findings.

Kaiyan Zhang, Jianyu Wang, Ermo Hua, Biqing Qi, Ning Ding, Bowen Zhou (2024). CoGenesis: A Framework Collaborating Large and Small Language Models for Secure Context-Aware Instruction Following. ACL Main Conference.

Xuekai Zhu, Biqing Qi, Kaiyan Zhang, Xinwei Long, Zhouhan Lin, Bowen Zhou (2024). PaD: Program-aided Distillation Specializes Large Models in Reasoning. NAACL Main Conference.

Che Jiang, Biqing Qi, Xiangyu Hong, Dayuan Fu, Yang Cheng, Fandong Meng, Mo Yu, Bowen Zhou, Jie Zhou (2024). On Large Language Models' Hallucination with Regard to Known Facts. NAACL Main Conference.

Biqing Qi, Kaiyan Zhang, Kai Tian, Haoxiang Li, Zhang-Ren Chen, Sihang Zeng, Ermo Hua, Jin-Fang Hu, Bowen Zhou (2024). Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluation. COLM.

Biqing Qi, Junqi Gao, Yiang Luo, Jianxing Liu, Ligang Wu, Bowen Zhou (2024). Investigating Deep Watermark Security: An Adversarial Transferability Perspective. arXiv preprint.

Biqing Qi, Junqi Gao, Xingquan Chen, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou (2024). Contrastive Augmented Graph2Graph Memory Interaction for Few Shot Continual Learning. arXiv preprint.

Pancheng Zhao, Peng Xu, Pengda Qin, Deng-Ping Fan, Zhicheng Zhang, Guoli Jia, Bowen Zhou, Jufeng Yang (2024). LAKE-RED: Camouflaged Images Generation by Latent Background Knowledge Retrieval-Augmented Diffusion. CVPR.

Biqing Qi, Xinquan Chen, Junqi Gao, Dong Li, Jianxing Liu, Ligang Wu, Bowen Zhou (2024). Interactive Continual Learning: Fast and Slow Thinking. CVPR.

Bowen Zhou, Ning Ding (2024). Generative AI for Complex Scenarios: Language Models are Sequence Processors. International Journal of Artificial Intelligence and Robotics Research, Vol. 1, No. 1.

Zhiyuan Ma, Zhihuan Yu, Jianjun Li, Bowen Zhou (2024). LMD: Faster Image Reconstruction with Latent Masking Diffusion. AAAI Main Conference.

Xinwei Long, Jiali Zeng, Fandong Meng, Zhiyuan Ma, Kaiyan Zhang, Bowen Zhou, Jie Zhou (2024). Generative Multi-Modal Knowledge Retrieval with Large Language Models. AAAI Main Conference.

Zhiyuan Ma, Guoli Jia, Bowen Zhou (2024). AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing. AAAI Main Conference.

Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, Bowen Zhou (2023). Large Language Models are Zero Shot Hypothesis Proposers. NeurIPS Workshop.

Ning Ding, Xingtai Lv, Qiaosen Wang, Yulin Chen, Bowen Zhou, Zhiyuan Liu, Maosong Sun (2023). Sparse Low-rank Adaptation of Pre-trained Language Models. EMNLP Main Conference.

Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, Bowen Zhou (2023). Enhancing Chat Language Models by Scaling High-quality Instructional Conversations. EMNLP Main Conference.

PDF Cite Dataset

Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xinwei Long, Bowen Zhou (2023). CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model. EMNLP Main Conference.

Biqing Qi, Bowen Zhou, Weinan Zhang, Jianxing Liu, Ligang Wu (2023). Improving Robustness of Intent Detection Under Adversarial Attacks: A Geometric Constraint Perspective. TNNLS.

Ge-Peng Ji, Deng-Ping Fan, Peng Xu, Ming-Ming Cheng, Bowen Zhou, Luc Van Gool (2023). SAM Struggles in Concealed Scenes -- Empirical Study on Segment Anything. SCIENCE CHINA Information Sciences..

Bo Li, Peng Qi, Bo Liu, Shuai Di, Jingen Liu, Jiquan Pei, Jinfeng Yi, Bowen Zhou (2023). Trustworthy AI: From Principles to Practices. ACM Computing Surveys, Vol. 55, No. 9, Article 177.