A Structured Testing Framework for ADAS Software Development
| dc.contributor.author | Fernando, Sachin | |
| dc.date.accessioned | 2023-08-15T18:11:35Z | |
| dc.date.available | 2023-08-15T18:11:35Z | |
| dc.date.issued | 2023-08-15 | |
| dc.date.submitted | 2023-08-10 | |
| dc.description.abstract | A major task in the design of automated vehicles is the need to quickly and thoroughly validate a development teams algorithms. There currently exists no explicitly defined common standard for developers working on Advanced Driver Assisted Systems to adopt during their software testing process. Instead different teams customize their testing process specifically to their software systems current needs. Literature indicates that these processes can be comprehensive but convoluted, and not flexible to change as test requirements and the system itself does. This thesis introduces a test framework at the unit, integration, and system test levels with the objective of addressing these challenges through a complete test framework centered around rapid execution and modular test design. At the unit test level a recommendation guide is put forth that is largely aimed at new developers with concrete actionable items that can be integrated into a teams process. For integration and system level testing, a software solution for ROS based development referred to as University of Waterloo Structured Testing Framework (UW-STF) is described in regards to both the benefits it provides as well as its low level implementation details. This includes how to tie the framework into using data generated from the popular simulator CARLA for end-to-end testing of a system. Lastly the test framework is applied to the codebase of UWAFT for their development efforts related to connected and automated vehicles. The framework was shown to increase readability/clarity at the unit test level, facilitate robust automated testing at the integration level and provide transparency on the teams current algorithms performance at the system test level (average F1-score of 0.77 and average OSPA of 2.42). When compared to the standard ROS integration test framework, UW-STF executed the same test suite with 60%+ reduction in lines of code and meaningful differences in CPU and memory requirements. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/19690 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.subject | integration testing | en |
| dc.subject | system testing | en |
| dc.subject | robot operating system (ROS) | en |
| dc.subject | continuous integration | en |
| dc.title | A Structured Testing Framework for ADAS Software Development | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Applied Science | en |
| uws-etd.degree.department | Mechanical and Mechatronics Engineering | en |
| uws-etd.degree.discipline | Mechanical Engineering | en |
| uws-etd.degree.grantor | University of Waterloo | en |
| uws-etd.embargo.terms | 0 | en |
| uws.contributor.advisor | Fraser, Roydon | |
| uws.contributor.affiliation1 | Faculty of Engineering | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.published.city | Waterloo | en |
| uws.published.country | Canada | en |
| uws.published.province | Ontario | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |