EVENT    Prof. Yuejie Chi of Carnegie Mellon University to Deliver Keynote at MERL's Virtual Open House

Date & Time:

Wednesday, November 15, 2023; 3:00-3:40pm (EST)

Location:

Virtual Event

Description:

MERL is excited to announce the featured keynote speaker for our Virtual Open House 2023: Prof. Yuejie Chi from Carnegie Mellon University.

Our virtual open house this year will take place on November 15, 2023, 1:00pm - 5:30pm (EST). Prof. Chi’s talk is scheduled for 3:00-3:40pm (EST). For details and agenda of the event, please visit: https://merl.com/events/voh23

Join us to learn more about who we are, what we do, and discuss our internship, post-doc, and full-time employment opportunities. To register, go to: https://mailchi.mp/merl/voh23


Title: Sample Complexity of Q-learning: from Single-agent to Federated Learning

Abstract: Q-learning, which seeks to learn the optimal Q-function of a Markov decision process (MDP) in a model-free fashion, lies at the heart of reinforcement learning practices. However, theoretical understandings on its non-asymptotic sample complexity remain unsatisfactory, despite significant recent efforts. In this talk, we first show a tight sample complexity bound of Q-learning in the single-agent setting, together with a matching lower bound to establish its minimax sub-optimality. We then show how federated versions of Q-learning allow collaborative learning using data collected by multiple agents without central sharing, where an importance averaging scheme is introduced to unveil the blessing of heterogeneity.

Speaker:

Prof. Yuejie Chi
Carnegie Mellon University

Dr. Yuejie Chi is the Sense of Wonder Group Endowed Professor of Electrical and Computer Engineering in AI Systems at Carnegie Mellon University, with courtesy appointments in the Machine Learning department and CyLab. She received her Ph.D. and M.A. from Princeton University, and B. Eng. (Hon.) from Tsinghua University, all in Electrical Engineering. Her research interests lie in the theoretical and algorithmic foundations of data science, signal processing, machine learning and inverse problems, with applications in sensing, imaging, decision making, and societal systems, broadly defined. Among others, Dr. Chi received the Presidential Early Career Award for Scientists and Engineers (PECASE) and the inaugural IEEE Signal Processing Society Early Career Technical Achievement Award for contributions to high-dimensional structured signal processing. She is an IEEE Fellow (Class of 2023) for contributions to statistical signal processing with low-dimensional structures.

MERL Contact:

Bingnan Wang