Choosing indicators of impact
Meaningful indicators are essential to determine if the intended impacts have occurred.
Impact indicators are measurable signs of change that help you understand and show whether your research is making a real-world difference. Because impact takes many forms, from policy shifts to changed behaviours, selecting meaningful indicators is an essential step in planning, capturing, and evidencing research impact.
What is the purpose of impact indicators?
The purpose of impact indicators may vary depending on the context and intended audience. Indicators not only help track whether your research is making a difference, but also guide you toward where to look for evidence and what kind of information to collect. For example:
- Funders often require researchers to demonstrate the societal or economic benefits of their work, highlighting the value generated from the investment.
- Stakeholders, such as policymakers, industry professionals, and community members, may be interested in indicators that demonstrate practical applications, policy implications, or improvements in specific areas.
- Institutions may use indicators for internal evaluation, promotions, or strategic planning.
You can also involve stakeholders in indicator development. Co-developing indicators with funders, collaborators, or intended beneficiaries can improve relevance, buy-in, and the likelihood of meaningful impact. This engagement also strengthens partnerships and encourages knowledge exchange from the outset.
What type of indicators should I choose?
It is important to strike a balance between qualitative and quantitative indicators. While quantitative data can provide valuable insights, qualitative information can capture the nuances and context-specific aspects of impact.
Quantitative indicators are measurable and countable, such as attendance figures, citations, or money saved. Qualitative indicators offer descriptive evidence, such as stakeholder testimonials, case studies, or expect reflections.
For example, a research team studying urban housing insecurity could use survey data (quantitative) to track changes in eviction rates and a series of community interviews (qualitative) to understand how policy changes affect tenants’ sense of security.
What makes a good indicator?
A good indicator should be SMART:
- Specific: Clearly linked to your intended impact and focused on a particular change or outcome. Indicators should be accurate, bias-free, and tailored to your context.
- Measurable: Capable of being observed, recorded, or quantified using trustworthy methods or tools.
- Achievable: Realistic to collect within the research context, considering time, resources, and access to data.
- Relevant: Meaningful to your research goals and valued by the communities, funders, or decision-makers involved.
- Time-bound: Collected or assessed at specific intervals, milestones, or against a defined baseline to show change over time.
Key questions to consider when choosing impact indicators
- What type of impact have I planned for?
- What kinds of change will indicate success?
- What benefits do my key audiences and stakeholders expect to see?
- What data or stories can help show that this change has happened?
- How will I collect this information, and when?
Identifying indicators helps you clarify what to measure, when to measure it, and how to know whether change has occurred.