Performance Test Selection Using Machine Learning and a Study of Binning Effect in Memory Allocators
| dc.contributor.author | Oliveira Sousa, Anderson | |
| dc.date.accessioned | 2019-04-30T19:24:06Z | |
| dc.date.available | 2019-04-30T19:24:06Z | |
| dc.date.issued | 2019-04-30 | |
| dc.date.submitted | 2019-04-30 | |
| dc.description.abstract | Performance testing is an essential part of the development life cycle that must be done in a timely fashion. However, checking for performance regressions in software can be time-consuming, especially for complex systems containing multiple lengthy tests cases. The first part of this thesis presents a technique to performance test selection using machine learning. In our approach, we build features using information extracted from the previous software versions to train classifiers that assist developers in deciding whether or not to execute a performance test on a new version. Our results show that the classifiers can be used as a mechanism that aids test selection and consequently avoids unnecessary testing. The second part of this work investigates the binning effect on user-space memory allocators. First, we examine how binning events can be a source of performance outliers in Redis and CPython object allocators. Second, we implement a \textit{Pintool} to detect the occurrence of binning on Python programs. The tool performs dynamic binary instrumentation on the interpreter and outputs information that helps developers in performing code optimizations. Finally, we use our tool to investigate the presence of binning in various widely used Python libraries. | en |
| dc.identifier.uri | http://hdl.handle.net/10012/14598 | |
| dc.language.iso | en | en |
| dc.pending | false | |
| dc.publisher | University of Waterloo | en |
| dc.subject | performance evaluation | en |
| dc.subject | performance test selection | en |
| dc.subject | binning effect | en |
| dc.subject | machine learning | en |
| dc.subject | performance test prioritisation | en |
| dc.subject | benchmarking | en |
| dc.subject | performance variability | en |
| dc.title | Performance Test Selection Using Machine Learning and a Study of Binning Effect in Memory Allocators | en |
| dc.type | Master Thesis | en |
| uws-etd.degree | Master of Applied Science | en |
| uws-etd.degree.department | Electrical and Computer Engineering | en |
| uws-etd.degree.discipline | Electrical and Computer Engineering | en |
| uws-etd.degree.grantor | University of Waterloo | en |
| uws.contributor.advisor | Fischmeister, Sebastian | |
| uws.contributor.affiliation1 | Faculty of Engineering | en |
| uws.peerReviewStatus | Unreviewed | en |
| uws.published.city | Waterloo | en |
| uws.published.country | Canada | en |
| uws.published.province | Ontario | en |
| uws.scholarLevel | Graduate | en |
| uws.typeOfResource | Text | en |
Files
Original bundle
1 - 1 of 1
Loading...
- Name:
- OliveiraSousa_Anderson.pdf
- Size:
- 1.94 MB
- Format:
- Adobe Portable Document Format
- Description:
- Master's thesis
License bundle
1 - 1 of 1
No Thumbnail Available
- Name:
- license.txt
- Size:
- 6.08 KB
- Format:
- Item-specific license agreed upon to submission
- Description: