Featured Publications
Optimization Theory
My series of work provides (near-)optimal algorithms and matching lower bounds on target precision $\epsilon$ for solving game-structured optimization such as minimax and bilevel optimization.- Second-Order Minimax Optimization [Slides in SIAM OP 26]

- Bilevel Optimization [Slides in SIAM OP 26]

AI for Optimization
I've been exploring these questions in second-order optimization for more than one year, and I'm excited to see them fully resolved with the assistance of GPT. [Github Repo]Xinliang Zhang 1, Lesi Chen 1, Zonghan Li, Jingzhao Zhang, Near-Optimal Second-Order Convex Finite-Sum Optimization under Individual Smoothness, arXiv preprint. [arXiv 2026]
Qihao Zhou 1, Lesi Chen 1, Luo Luo, Chengchang Liu, Envelope Cubic Regularized Newton Method for Nonconvex-Strongly-Concave Minimax Optimization, arXiv preprint. [arXiv 2026]
Xinliang Zhang 1, Lesi Chen1, Chengchang Liu, Jingzhao Zhang, Near-Optimal Convex Optimization with Lazy Second-Order Oracles, arXiv preprint. [arXiv 2026]
Xinliang Zhang 1, Lesi Chen1, Linxuan Pan1, Chengchang Liu, Junchi Yang, Jingzhao Zhang, Optimal High-Order Methods for Solving Monotone Variational Inequalities, arXiv preprint. [arXiv 2026]
Lesi Chen1, Xinliang Zhang 1, Junru Li, Chengchang Liu, Luo Luo, and Jingzhao Zhang, Solving Convex-Concave Problems with $\tilde{\mathcal{O}}(\epsilon^{-4/(3p+1)})$ pth-Order Oracle Complexity, arXiv preprint. [arXiv 2026]
[Extension of COLT 2025 below]Lesi Chen, Chengchang Liu, Luo Luo, John C.S. Lui, and Jingzhao Zhang, Optimal Convex Optimization with Inexact Second-Order Oracles, arXiv preprint. [arXiv 2026]
Lesi Chen1, Kaiyi Ji 1, and Jingzhao Zhang, On the Condition Number Dependency in Bilevel Optimization, arXiv preprint. [arXiv 2026] ⭐
Lesi Chen, Chengchang Liu, Luo Luo, and Jingzhao Zhang, Faster Newton Methods for Convex and Nonconvex Optimization in Gradient Complexity, in Conference on Learning Theory. [COLT 2026]
Lesi Chen, Junru Li, El Mahdi Chayti and Jingzhao Zhang, Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization, in International Conference on Learning Representations. [ICLR 2026]
Lesi Chen1, Yaohua Ma1, and Jingzhao Zhang, Near-Optimal Nonconvex-Strongly-Convex Bilevel Optimization with Fully First-Order Oracles, Journal of Machine Learning Research, 1-56. [JMLR 2025] ⭐
Lesi Chen, Chengchang Liu, Luo Luo, and Jingzhao Zhang, Solving Convex-Concave Problems with $\tilde{\mathcal{O}}(\epsilon^{-4/7})$ pth-Order Oracle Complexity, in Conference on Learning Theory. (Best Student Paper) [COLT 2025] [Extension available above] ⭐
Lesi Chen1, Chengchang Liu1, and Jingzhao Zhang, Second-Order Min-Max Optimization with Lazy Hessians, in International Conference on Learning Representations. (Oral, <2%) [ICLR 2025]
Lesi Chen and Luo Luo, Near-Optimal Algorithms for Making the Gradient Small in Stochastic Minimax Optimization, Journal of Machine Learning Research, 1-44. [JMLR 2024]
Huaqing Zhang1, Lesi Chen1, Jing Xu, and Jingzhao Zhang, Functionally Constrained Algorithm Solves Convex Simple Bilevel Problems, in Conference on Neural Information Processing Systems.
[NeurIPS 2024]Lesi Chen1, Jing Xu1, and Jingzhao Zhang, On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis, in Conference on Learning Theory. [COLT 2024]
Lesi Chen, Jing Xu, and Luo Luo, Faster Gradient-Free Algorithms for Nonsmooth Nonconvex Stochastic Optimization, in International Conference on Machine Learning. [ICML 2023]
Lesi Chen, Boyuan Yao, and Luo Luo, Faster Stochastic Algorithms for Minimax Optimization under Polyak-Łojasiewicz Condition, in Conference on Neural Information Processing Systems. [NeurIPS 2022]
See Google Scholar for a complete list.
