About Me

I am now a fourth-year Ph.D. candidate majoring in Computer Science at Computer Systems Research Group, Peking University (2023-Present). I am advised by Prof. Xin Jin. My research and engineering work focus on systems for Multimodal LLM (MLLM) pretraining and reinforcement learning.

I received my B.E. from the School of Electronics Engineering and Computer Science (EECS), Peking University (2019-2023). I used to be a research assistant at Software Engineering Institute advised by Prof. Xin Jin (2020-2023).

Email: zzlcs (at) pku (dot) edu (dot) cn

Internship

• [2025.09 - 2026.06] RedNote, RedStar Intern of Infrastructure for Multimodal LLM + RL.
• [2025.04 - 2025.09] ByteDance Seed, TopSeed Intern of Multimodal LLM + RL.
• [2024.04 - 2025.04] StepFun, Research Intern of Infrastructure for Multimodal LLM Training.

Selected Publications

BigMac: Breaking the Pareto Frontier of Compute and Memory in Multimodal LLM Training
Zili Zhang, Chengxu Yang, Shenglong Zhang, Chenyu Wang, Yufan Zhang, Tuo Dai, Zhouyang Li, Yuhong Ge, Chao Jin, Xin Jin, Yuliang Liu
In Preprint.
[PDF] [Slides]

DistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models
Zili Zhang, Yinmin Zhong, Yimin Jiang, Hanpeng Hu, Jianjian Sun, Zheng Ge, Yibo Zhu, Daxin Jiang, Xin Jin
ACM Special Interest Group on Data Communication (SIGCOMM 2025), Coimbra, September 8-11, 2025.
[PDF] [Slides]

UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing
Xinming Wei, Chao Jin, Tuo Dai, Yinmin Zhong, Shan Yu, Chengxu Yang, Bingyang Wu, Zili Zhang, Jing Mai, Qianchao Zhu, Zhouyang Li, Yuliang Liu, Guojie Luo
In Preprint.
[PDF] [Slides]

ReLibra: Routing-Replay-Guided Load Balancing for MoE Training in Reinforcement Learning
Chao Jin, Xinming Wei, Yinmin Zhong, Chengxu Yang, Bingyang Wu, Ruidong Zhu, Zili Zhang, Yuliang Liu, Xin Jin
In Preprint.
[PDF] [Slides]

TokenLake: A Unified Segment-level Prefix Cache Pool for Fine-grained Elastic Long-Context LLM Serving
Bingyang Wu, Zili Zhang, Yinmin Zhong, Guanzhe Huang, Yibo Zhu, Xuanzhe Liu, Xin Jin
In Preprint.
[PDF] [Slides]

StreamRL: Scalable, Heterogeneous, and Elastic RL for LLMs with Disaggregated Stream Generation
Yinmin Zhong, Zili Zhang, Xiaoniu Song, Hanpeng Hu, Chao Jin, Bingyang Wu, Nuo Chen, Yukun Chen, Yu Zhou, Changyi Wan, Hongyu Zhou, Yimin Jiang, Yibo Zhu, Daxin Jiang
In Preprint.
[PDF] [Slides]

Fast Distributed Inference Serving for Large Language Models
Bingyang Wu^*, Yinmin Zhong^*, Zili Zhang^*, Shengyu Liu, Fangyue Liu, Yuanhang Sun, Gang Huang, Xuanzhe Liu, Xin Jin
(^* Equal contribution)
NSDI'26.
[PDF] [Slides]

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation
Chao Jin, Zili Zhang, Xuanlin Jiang, Fangyue Liu, Xin Liu, Xuanzhe Liu, Xin Jin
TOCS'25.
[PDF] [Slides]

RLHFuse: Efficient RLHF Training for Large Language Models with Inter- and Intra-Stage Fusion
Yinmin Zhong, Zili Zhang, Bingyang Wu, Shengyu Liu, Yukun Chen, Changyi Wan, Hanpeng Hu, Lei Xia, Ranchen Ming, Yibo Zhu, Xin Jin
USENIX Symposium on Networked Systems Design and Implementation (NSDI 2025), Philadelphia, April 28–30, 2025.
[PDF] [Slides]

dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving
Bingyang Wu, Ruidong Zhu, Zili Zhang, Peng Sun, Xuanzhe Liu, Xin Jin
USENIX Symposium on Operating Systems Design and Implementation (OSDI 2024), Santa Clara, July 10–12, 2024.
[PDF] [Slides]

Jolteon: Unleashing the Promise of Serverless for Serverless Workflows
Zili Zhang, Chao Jin, Xin Jin
USENIX Symposium on Networked Systems Design and Implementation (NSDI 2024), Santa Clara, April 16–18, 2024.
[PDF] [Slides]

Fast Vector Query Processing for Large Datasets Beyond GPU Memory with Reordered Pipelining
Zili Zhang, Fangyue Liu, Gang Huang, Xuanzhe Liu, Xin Jin
USENIX Symposium on Networked Systems Design and Implementation (NSDI 2024), Santa Clara, April 16–18, 2024.
[PDF] [Slides]

Service

• [2026] TMC (Invited Reviewer)
• [2025] Eurosys (Shadow PC)

Teaching

• [2024 Spring] Teaching Assistant, Operating System (Honor Track) at PKU.
• [2022 Fall] Teaching Assistant, Introduction to Computer System (Honor Track) at PKU.
• [2021 Fall] Teaching Assistant, Introduction to Computer System at PKU.

Interests

• Amateur runner, Here are my ITRA profile and Running Page.
• Outdoor traveling, Hiking, Skiing, and Camping, I believe that only by immersing myself in nature can I find inner peace.
• Video games, I enjoy video games for their immersive storytelling.