Xuyang Chen

I am currently a Postdoctoral Research Fellow in the Department of Electrical and Computer Engineering at the National University of Singapore.

I obtained my Ph.D. degree in Electrical and Computer Engineering from the National University of Singapore in 2025, supervised by Prof. Lin Zhao. I obtained my bachelor's degree in Applied Mathematics from the Hua Luogeng Honors Class at Beihang University in 2019.

Default Image Hover Image

Research Interests

My research interests span all topics of Reinforcement Learning (RL). Building on a strong foundation in learning theory from my Ph.D., I work on understanding the fundamental mathematical principles underlying RL. I aim to leverage these theoretical insights to develop efficient algorithms that bridge the gap between theory and practice—designing methods that are backed by rigorous theoretical guarantees while demonstrating superior empirical performance. Currently, my research focuses on applying this approach to Offline RL, Preference-based RL, and Multi-Agent RL.


News


Publications

Selected

(* denotes equal contribution)

A full list of publications can be found in Google Scholar Page.


RMHE
ICLR 2026
Finite-Time Analysis of Actor-Critic Methods with Deep Neural Network Approximation
Xuyang Chen, Fengzhuo Zhang, Keyu Yan, Lin Zhao
RMHE
ICML 2025
On the Convergence of Continuous Single-timescale Actor-critic
Xuyang Chen, Lin Zhao
RMHE
IJCAI 2024 Oral Presentation
Global Optimality of Single-timescale Actor-critic under Continuous State-Action Space: A Study on Linear Quadratic Regulator
Xuyang Chen, Jingliang Duan, Lin Zhao
RMHE
NeurIPS 2023
Finite-time Analysis of Single-timescale Actor-critic
Xuyang Chen, Jingliang Duan, Lin Zhao
RMHE
AAAI 2023 Oral Presentation
Global Convergence of Two-timescale Actor-critic for Solving Linear Quadratic Regulator
Xuyang Chen, Jingliang Duan, Lin Zhao

Selected Preprints


Services

Conference Reviewer
NeurIPS ICML ICLR AAAI ICRA
Journal Reviewer
IEEE T-Cybernetics IEEE TNNLS




Thank you for visiting!