Model-Based Bayesian Sparse Sampling for Data Efficient Control
| dc.contributor.author | Tse, Timmy Rong Tian | |
| dc.date.accessioned | 2019-06-24T18:34:15Z | |
| dc.date.available | 2019-06-24T18:34:15Z | |
| dc.date.issued | 2019-06-24 | |
| dc.date.submitted | 2019-06-14 | |
| dc.description.abstract | In this work, we propose a novel Bayesian-inspired model-based policy search algorithm for data efficient control. In contrast to other model-based approaches, our algorithm makes use of approximate Gaussian processes in the form of random Fourier features for fast online systems identification and computationally efficient posterior updates via rank one Cholesky updates. Furthermore, fast and tractable posterior updates permits policy optimization to leverage knowledge from posterior evolution tracking for a directed Bayesian approach to the exploration-exploitation dilemma. To address the optimization formulation involving belief monitoring as well as the potentiality of a loss surface with zero gradients everywhere, we leverage a blackbox optimizer in the form of covariance matrix adaptation evolution strategy (CMA-ES). We test our algorithm on four challenging control tasks and report the superior data efficiency as well as the exploration capabilities of our model. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/14774 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.subject | machine learning | en |
| dc.subject | reinforcement learning | en |
| dc.subject | artificial intelligence | en |
| dc.title | Model-Based Bayesian Sparse Sampling for Data Efficient Control | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Mathematics | en |
| uws-etd.degree.department | David R. Cheriton School of Computer Science | en |
| uws-etd.degree.discipline | Computer Science | en |
| uws-etd.degree.grantor | University of Waterloo | en |
| uws.contributor.advisor | Poupart, Pascal | |
| uws.contributor.advisor | Law, Edith | |
| uws.contributor.affiliation1 | Faculty of Mathematics | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.published.city | Waterloo | en |
| uws.published.country | Canada | en |
| uws.published.province | Ontario | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |