Absraction for Efficient Reinforcement Learning
Abstract
Successful reinforcement learning requires large amounts of data, compute, and some luck. We explore the ability of abstraction(s) to reduce these dependencies. Abstractions for reinforcement learning share the goals of this abstract: to capture essential details, while leaving out the unimportant. By throwing away inessential details, there will be less to compute, less to explore, and less variance in observations. But, does this always aid reinforcement learning? More specifically, we start by looking for abstractions that are easily solvable. This leads us to a type of linear abstraction. We show that, while it does allow efficient solutions, it also gives erroneous solutions, in the general case. We then attempt to improve the sample efficiency of a reinforcment learner. We do so by constructing a measure of symmetry and using it as an inductive bias. We design and run experiments to test the advantage provided by this inductive bias, but must leave conclusions to future work.
Keywords
Not available
Specialisations
Similar theses
- Natural Language Generation with Reinforcement Learning Thomas Scialom · 2022
- Investigating Overestimation Bias in Reinforcement Learning Andreas Pentaliotis · 2020
- Securing Federated Learning: A Comprehensive Defence Against Privacy Attacks Moyeen, M A · Concordia University · 2025
- A Comprehensive Framework for Targeted Transfer Learning: Privacy-Preserving, Secure, and Efficient Domain Adaptation Sayyed Farid Ahamed · Old Dominion University · 2026
- Learning to Plan with Reinforcement Learning Ming Hay Chung · University of Cambridge · 2025
- EFFICIENT AND PRIVACY-PRESERVING FEDERATED LEARNING FOR RECOMMENDER SYSTEMS Peihua Mai · 2025
