Performance Test Selection Using Machine Learning and a Study of Binning Effect in Memory Allocators
Abstract
Performance testing is an essential part of the development life cycle that must be done in a timely fashion. However, checking for performance regressions in software can be time-consuming, especially for complex systems containing multiple lengthy tests cases. The first part of this thesis presents a technique to performance test selection using machine learning. In our approach, we build features using information extracted from the previous software versions to train classifiers that assist developers in deciding whether or not to execute a performance test on a new version. Our results show that the classifiers can be used as a mechanism that aids test selection and consequently avoids unnecessary testing.
The second part of this work investigates the binning effect on user-space memory allocators. First, we examine how binning events can be a source of performance outliers in Redis and CPython object allocators. Second, we implement a \textit{Pintool} to detect the occurrence of binning on Python programs. The tool performs dynamic binary instrumentation on the interpreter and outputs information that helps developers in performing code optimizations. Finally, we use our tool to investigate the presence of binning in various widely used Python libraries.
Collections
Cite this version of the work
Anderson Oliveira Sousa
(2019).
Performance Test Selection Using Machine Learning and a Study of Binning Effect in Memory Allocators. UWSpace.
http://hdl.handle.net/10012/14598
Other formats
Related items
Showing items related by title, author, creator and subject.
-
High Performance Window Systems and their Effect on Perimeter Space Commercial Building Energy Performance
Lee, Ivan Yun Tong (University of Waterloo, 2010-09-29)In the quest for improving building energy efficiency raising the level of performance of the building enclosure has become critical. As the thermal performance of the building enclosure improves so does the overall energy ... -
In Search of Manual Asymmetries in Aging during Performance of Activities of Daily Living: Does Upper Limb Performance Become More Symmetric with Age?
Lulic, Tea (University of Waterloo, 2013-09-27)Introduction: A common disorder arising most frequently after a left hemisphere stroke is limb apraxia. Limb apraxia is a deficit of skilled movement, such as performance of activities of daily living (ADLs), that is not ... -
The Effects of Reward Type and Relative Performance Information on Budget Slack and Performance
Presslee, Charles Adam (University of Waterloo, 2014-01-07)To motivate effort, organizations commonly use budget-based tangible rewards (e.g., gift cards, merchandise) in lieu of or in addition to cash rewards and they can distribute tangible rewards to employees either directly ...