Making sure things really add up: Ways to assess research impact responsibly

Abstract

University administrators love the numbers. The idea of having data to measure, compare, support decision making, and to understand initiatives and invested resources is something we strive for. The idea of using bibliometric data to assess research and benchmark institutional success/lack of success has been a long-standing modus operandi in academic institutions. However, when this type of analysis is done, it often feels like it’s missing something. The data doesn’t always appear to accurately reflect what we know is happening at our institutions, and the impacts that are observed both in our communities and across research disciplines. In this interactive session, we will explore how responsible ways of measuring research, that include quantitative and qualitative assessments and choosing the right indicators, can provide more meaningful data. Through this and thoughtful reflection on the challenges of measuring impacts at large institutions we can more fully reveal the stories of the research being done at our institutions. The session organizers include librarians and research offices, representing the collaborative approach we believe is necessary for institutions to meet these challenges. We will discuss initiatives at Canadian institutions that advocate for the responsible use of research impact metrics. And with the audience, we will explore ways in which these types of assessments can be used at other institutions to change what and how things are measured around research so that more accurate, more holistic, and more meaningful data can be gathered.