Homepage

I am a first-year PhD student of Multimedia Laboratory at The Chinese University of Hong Kong supervised by Prof. Wanli Ouyang. Before that, I obtained my Bachelor’s degree from the Honor Class of Artificial Intelligence at Shanghai Jiao Tong University. My research interests lie in LLM-based Agents, Multi-agent Systems, and Agentic RL.

News

• 2026.05: StraTA preprint was released on arXiv.
• 2026.01: CoMAS was accepted by ICLR 2026.
• 2025.04: I accepted the offer of Hong Kong PhD Fellowship Scheme.
• 2025.02: ComfyBench was accepted by CVPR 2025.
• 2025.02: I accepted the offer of PhD study at The Chinese University of Hong Kong.
• 2024.05: I interned at Shanghai Artificial Intelligence Laboratory.

Publications

• StraTA: Incentivizing Agentic Reinforcement Learning with Strategic Trajectory Abstraction
  Xiangyuan Xue, Yifan Zhou, Zidong Wang, Shengji Tang, Philip Torr, Wanli Ouyang, Lei Bai, Zhenfei Yin
  arXiv preprint arXiv:2605.06642
  [Paper] [Code]
  

• LatentMem: Customizing Latent Memory for Multi-Agent Systems
  Muxin Fu, Xiangyuan Xue, Yafu Li, Zefeng He, Siyuan Huang, Xiaoye Qu, Yu Cheng, Yang Yang
  arXiv preprint arXiv:2602.03036
  [Paper] [Code]
  

• CoMAS: Co-Evolving Multi-Agent Systems via Interaction Rewards
  Xiangyuan Xue, Yifan Zhou, Guibin Zhang, Zaibin Zhang, Yijiang Li, Chen Zhang, Zhenfei Yin, Philip Torr, Wanli Ouyang, Lei Bai
  International Conference on Learning Representations (ICLR 2026)
  [Paper] [Code]
  

• Scaling Behaviors of LLM Reinforcement Learning Post-Training: An Empirical Study in Mathematical Reasoning
  Zelin Tan, Hejia Geng, Xiaohang Yu, Mulei Zhang, Guancheng Wan, Yifan Zhou, Qiang He, Xiangyuan Xue, Heng Zhou, Yutao Fan, Zhongzhi Li, Zaibin Zhang, Guibin Zhang, Chen Zhang, Zhenfei Yin, Philip Torr, Lei Bai
  Annual Meeting of the Association for Computational Linguistics (ACL 2026)
  [Paper] [Code]
  

• The Landscape of Agentic Reinforcement Learning for LLMs: A Survey
  Guibin Zhang, Hejia Geng, Xiaohang Yu, Zhenfei Yin, Zaibin Zhang, Zelin Tan, Heng Zhou, Zhongzhi Li, Xiangyuan Xue, Yijiang Li, Yifan Zhou, Yang Chen, Chen Zhang, Yutao Fan, Zihu Wang, Songtao Huang, Yue Liao, Hongru Wang, Mengyue Yang, Heng Ji, Michael Littman, Jun Wang, Shuicheng Yan, Philip Torr, Lei Bai
  Transactions on Machine Learning Research (TMLR 2026)
  [Paper] [Code]
  

• Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI
  Sha Zhang, Suorong Yang, Tong Xie, Xiangyuan Xue, Zixuan Hu, Rui Li, Wenxi Qu, Zhenfei Yin, Tianfan Fu, Di Hu, Andres M Bran, Nian Ran, Bram Hoex, Wangmeng Zuo, Philippe Schwaller, Wanli Ouyang, Lei Bai, Yanyong Zhang, Lingyu Duan, Shixiang Tang, Dongzhan Zhou
  arXiv preprint arXiv:2506.19613
  [Paper]
  

• ReSo: A Reward-driven Self-organizing LLM-based Multi-Agent System for Reasoning Tasks
  Heng Zhou, Hejia Geng, Xiangyuan Xue, Li Kang, Yiran Qin, Zhiyong Wang, Zhenfei Yin, Lei Bai
  Conference on Empirical Methods in Natural Language Processing (EMNLP 2025)
  [Paper] [Code]
  

• ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems
  Xiangyuan Xue, Zeyu Lu, Di Huang, Zidong Wang, Wanli Ouyang, Lei Bai
  IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2025)
  [Paper] [Code] [Project]