research
∙
03/28/2023
Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise
In this work, we study the concentration behavior of a stochastic approx...
share
research
∙
03/08/2023
Convergence Rates for Localized Actor-Critic in Networked Markov Potential Games
We introduce a class of networked Markov potential games where agents ar...
research
∙
03/03/2023
A Finite-Sample Analysis of Payoff-Based Independent Learning in Zero-Sum Stochastic Games
We study two-player zero-sum stochastic games, and propose a form of ind...
research
∙
11/30/2022
Global Convergence of Localized Policy Iteration in Networked Multi-Agent Reinforcement Learning
We study a multi-agent reinforcement learning (MARL) problem where the a...
research
∙
08/05/2022
Sample Complexity of Policy-Based Methods under Off-Policy Sampling and Linear Function Approximation
In this work, we study policy-based methods for solving the reinforcemen...
research
∙
03/05/2022
Target Network and Truncation Overcome The Deadly triad in Q-Learning
Q-learning with function approximation is one of the most empirically su...
research
∙
11/11/2021
Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization
Stochastic approximation (SA) and stochastic gradient descent (SGD) algo...
research
∙
06/24/2021
Finite-Sample Analysis of Off-Policy TD-Learning via Generalized Bellman Operators
In temporal difference (TD) learning, off-policy sampling is known to be...
research
∙
05/26/2021
Finite-Sample Analysis of Off-Policy Natural Actor-Critic with Linear Function Approximation
In this paper, we develop a novel variant of off-policy natural actor-cr...
research
∙
03/02/2021
Nested Vehicle Routing Problem: Optimizing Drone-Truck Surveillance Operations
Unmanned aerial vehicles or drones are becoming increasingly popular due...
research
∙
02/18/2021
Finite-Sample Analysis of Off-Policy Natural Actor-Critic Algorithm
In this paper, we provide finite-sample convergence guarantees for an of...
research
∙
02/02/2021
A Lyapunov Theory for Finite-Sample Guarantees of Asynchronous Q-Learning and TD-Learning Variants
This paper develops an unified framework to study finite-sample converge...
research
∙
02/03/2020
Finite-Sample Analysis of Stochastic Approximation Using Smooth Convex Envelopes
Stochastic Approximation (SA) is a popular approach for solving fixed po...
research
∙
05/27/2019