Xianyan Jia

Research Engineer at ByteDance Seed

I am an AI infrastructure engineer at ByteDance Seed, where I lead the optimization of training and inference systems for reinforcement learning. Previously at Alibaba, I led the RL infrastructure for Qwen and drove large-scale training acceleration for M6.

15+
Publications
1100+
Citations

Experience

AI Infra Engineer @ ByteDance Seed
Present
Leading the optimization of training and inference systems for reinforcement learning.
Software Engineer @ Alibaba Cloud
Oct 2018 – 2024 · ~6 years
Large-scale training acceleration, RL infra for Qwen, and building ChatLearn and Whale.
AI Engineer @ Tencent
Mar 2018 – Sep 2018 · 6 months
Large-scale distributed training infrastructure.
Deep Learning Engineer @ Intel Corporation
Jul 2016 – Mar 2018 · 1 year 8 months
Core contributor to BigDL; record-breaking ImageNet training speed.

Selected Publications

Highly Scalable Deep Learning Training System with Mixed-Precision: Training ImageNet in Four Minutes
515 cited
X Jia, S Song, W He, Y Wang, H Rong, F Zhou, L Xie, Z Guo, Y Yang, L Yu, ...
arXiv preprint arXiv:1807.11205, 2018
BigDL: A Distributed Deep Learning Framework for Big Data
204 cited
JJ Dai, Y Wang, X Qiu, D Ding, Y Zhang, Y Wang, X Jia, CL Zhang, Y Wan, ...
Proceedings of the ACM Symposium on Cloud Computing, 50-60, 2019
M6: A Chinese Multimodal Pretrainer
172 cited
J Lin, R Men, A Yang, C Zhou, M Ding, Y Zhang, P Wang, A Wang, X Jia, ...
arXiv preprint arXiv:2103.00823, 2021
Whale: Efficient Giant Model Training over Heterogeneous GPUs
89 cited
X Jia, L Jiang, A Wang, W Xiao, Z Shi, J Zhang, X Li, L Chen, Y Li, ...
2022 USENIX Annual Technical Conference (USENIX ATC 22), 673-688, 2022
EasyScale: Elastic Training with Consistent Accuracy and Improved Utilization on GPUs
27 cited
M Li, W Xiao, H Yang, B Sun, H Zhao, S Ren, Z Luan, X Jia, Y Liu, Y Li, ...
Proceedings of the International Conference for High Performance Computing, 2023 (SC'23)

View all publications on Google Scholar →

Education

M.Sc. in Computer Science
National University of Singapore
2014 – 2016 · Singapore
B.Eng. in Computer Software Engineering
Sichuan University
2010 – 2014 · China
Top 1.