UWSpace is currently experiencing technical difficulties resulting from its recent migration to a new version of its software. These technical issues are not affecting the submission and browse features of the site. UWaterloo community members may continue submitting items to UWSpace. We apologize for the inconvenience, and are actively working to resolve these technical issues.
 

Measuring the Performance of Code Produced with GitHub Copilot

Thumbnail Image

Files

Erhabor_Daniel.pdf (629.13 KB)

Date

2022-12-22

Authors

Erhabor, Daniel

Journal Title

Journal ISSN

Volume Title

Publisher

University of Waterloo

Abstract

GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing code with better performance. We evaluate the performance of code produced when developers use GitHub Copilot versus when they do not. To this end, we conducted a user study with 32 participants where each participant solved two C++ programming problems, one with Copilot and the other without it and measured the running time of the participants' solutions on our test data. Our results suggest that using Copilot can produce code with a significantly slower running time.

Description

Keywords

LC Keywords

Citation

URI

http://hdl.handle.net/10012/19000

Collections

Theses
Computer Science