Learning a Motion Policy to Navigate Environments with Structured Uncertainty
| dc.contributor.author | Tsang, Florence | |
| dc.date.accessioned | 2020-01-24T14:26:16Z | |
| dc.date.available | 2020-01-24T14:26:16Z | |
| dc.date.issued | 2020-01-24 | |
| dc.date.submitted | 2020-01-13 | |
| dc.description.abstract | Navigating in uncertain environments is a fundamental ability that robots must have in many applications such as moving goods in a warehouse or transporting materials in a hospital. While much work has been done on navigation that reacts to unexpected obstacles, there is a lack of research in learning to predict where obstacles may appear based on historical data and utilizing those predictions to form better plans for navigation. This may increase the efficiency of a robot that has been working in the same environment for a long period of time. This thesis first introduces the Learned Reactive Planning Problem (LRPP) that formalizes the above problem and then proposes a method to capture past obstacle information and their correlations. We introduce an algorithm that uses this information to make predictions about the environment and forms a plan for future navigation. The plan balances exploiting obstacle correlations (ie. observing obstacle A is present means obstacle B is present as well) and moving towards the goal. Our experiments in an idealized simulation show promising results of the robot outperforming a commonly used optimistic algorithm. Second, we introduce the Learn a Motion Policy (LAMP) framework that can be added to navigation stacks on real robots. This framework aims to move the problem of predicting and navigating through uncertainties from idealized simulations to realistic settings. Our simulation results in Gazebo and experiments on a real robot show that the LAMP framework has potential to improve upon existing navigation stacks as it confirms the results from the idealized simulation, while also highlighting challenges that still need to be addressed. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/15562 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.relation.uri | https://github.com/nightingale0131/lamp | en |
| dc.relation.uri | https://github.com/nightingale0131/lrpp | en |
| dc.subject | robot navigation | en |
| dc.subject | reinforcement learning | en |
| dc.subject | motion planning | en |
| dc.subject.lcsh | Robots--Motion | en |
| dc.subject.lcsh | Uncertainty (Information theory) | en |
| dc.subject.lcsh | Robots--Programming | en |
| dc.subject.lcsh | Robots--Control systems. | en |
| dc.title | Learning a Motion Policy to Navigate Environments with Structured Uncertainty | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Applied Science | en |
| uws-etd.degree.department | Electrical and Computer Engineering | en |
| uws-etd.degree.discipline | Electrical and Computer Engineering | en |
| uws-etd.degree.grantor | University of Waterloo | en |
| uws.comment.hidden | The following needs to be placed somewhere on the page with my thesis: In reference to IEEE copyrighted material which is used with permission in this thesis, the IEEE does not endorse any of the University of Waterloo's products or services. Internal or personal use of this material is permitted. If interested in reprinting/republishing IEEE copyrighted material for advertising or promotional purposes or for creating new collective works for resale or redistribution, please go to http://www.ieee.org/publications_standards/publications/rights/rights_link.html to learn how to obtain a License from RightsLink. | en |
| uws.contributor.advisor | Smith, Stephen | |
| uws.contributor.affiliation1 | Faculty of Engineering | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.published.city | Waterloo | en |
| uws.published.country | Canada | en |
| uws.published.province | Ontario | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |