Key Terms in Impact Assessment You Need to Know

Every government scheme, NGO programme, or health intervention eventually faces one question: did it really work? Answering this is the job of impact assessment, a structured way of measuring what a project actually changes in people’s lives. But before you can measure anything, you need a shared vocabulary. Terms like input, output, outcome, effectiveness, and sustainability sound similar but mean very different things, and confusing them is one of the most common reasons evaluations go wrong. This post walks through the core terms you will encounter in any serious impact assessment exercise.

Starting with the basics: project, input, and assessment 🔗

A project is a planned intervention with defined objectives, a time frame, a budget, and identifiable beneficiaries. In population and family health studies, a project could be a polio immunisation drive in a district, a nutrition supplementation scheme for adolescent girls, or a maternal health awareness campaign run by a state government. What makes it a project, rather than routine work, is that it has a beginning, an end, and a goal it is trying to achieve.

Assessment refers to the systematic process of judging the merit, worth, or significance of that project. It is not the same as casual observation or anecdotal feedback. A proper assessment uses evidence, applies criteria, and reaches a conclusion that can be defended. The OECD’s Development Assistance Committee has defined six widely used evaluation criteria: relevance, coherence, effectiveness, efficiency, impact, and sustainability. Most impact assessments draw on at least some of these.

Inputs: what you put in 🔗

An input is any resource committed to make the project happen. Typical inputs include money, staff time, equipment, training materials, vehicles, and expertise. For a rural maternal health project, inputs would be the salaries of ANMs and ASHA workers, the cost of iron and folic acid tablets, the petrol for the outreach vehicle, the training given to health workers, and the time of the supervising medical officer.

Inputs are often confused with activities, but they are not the same. Activities are what you do with the inputs, such as conducting antenatal check-ups or organising village health and nutrition days. Inputs are what enables those activities to happen in the first place. Tracking inputs is essential because it tells you how efficiently your resources are being converted into results.

Outputs, effects, and outcomes: the chain of results 🔗

This is where most confusion happens, so it is worth slowing down.

Outputs 🔗

Outputs are the direct, immediate products of project activities. They are usually countable and within the direct control of the implementing team. For a tuberculosis screening campaign, outputs would include the number of people screened, the number of sputum samples tested, and the number of patients diagnosed and put on treatment. Output indicators describe the delivery of products such as training sessions, equipment, or services, and should capture both quantity and quality.

The crucial point is that outputs do not by themselves prove a project worked. Training 500 ASHA workers is an output. Whether those 500 trained workers actually change household behaviour is a different question altogether.

Effects and outcomes 🔗

Effects are the changes that follow from outputs. They cover the broader consequences of the project, both planned and unplanned, positive and negative. In evaluation language, the medium-term effects are usually called outcomes.

An outcome is the change in knowledge, attitude, behaviour, or condition among the target group as a result of the outputs. For the TB screening example, outcomes would be improved treatment adherence rates, reduced household transmission, and increased community awareness about TB symptoms. Outcomes typically refer to the medium-term consequences of the project and should clearly link back to project goals.

The leap from output to outcome is critical and not automatic. You can distribute one lakh insecticide-treated bednets (output) and still see no decline in malaria cases if people use them as fishing nets or do not hang them properly. The output happened, but the intended outcome did not follow.

Effectiveness 🔗

Effectiveness is the degree to which a project achieves its stated objectives. The OECD glossary defines it as the extent to which a development intervention’s objectives were achieved, or are expected to be achieved, taking into account their relative importance. In simpler words, effectiveness asks: did we hit the targets we set for ourselves?

A national immunisation programme aiming for 90% full immunisation coverage of children under two would be judged effective if it reaches that figure, partially effective if it reaches 75%, and ineffective if it stalls at 50%. Effectiveness is closely tied to outcomes because objectives are usually framed in outcome terms.

It is also worth distinguishing effectiveness from efficiency. Efficiency looks at the relationship between inputs and results, asking whether the same outcomes could have been achieved with fewer resources or in less time. A project can be effective but inefficient, or efficient but ineffective at the outcome level.

Impact: the long-term, deeper change 🔗

Impact refers to the long-term, higher-order effects produced by a project, whether intended or unintended, positive or negative, direct or indirect. The OECD defines impact as positive and negative, primary and secondary long-term effects produced by a development intervention, directly or indirectly, intended or unintended.

For a state-level Janani Suraksha Yojana evaluation, outcomes might be the increase in institutional deliveries and antenatal visits. Impact, however, would be the long-term reduction in maternal mortality ratio and neonatal mortality rate in the state, alongside changes such as improved nutritional status of mothers, shifts in community norms about childbirth, or even unintended effects on the workload of frontline workers.

Impact is the hardest level to measure for two reasons. First, it shows up over years, sometimes decades. Second, attribution is difficult. A district may see falling infant mortality during a nutrition programme, but the credit also belongs to better sanitation, rising household incomes, increased female literacy, and improved access to health services. Separating the contribution of one project from everything else happening simultaneously is a methodological challenge that occupies entire chapters of evaluation textbooks.

Sustainability and significance 🔗

Sustainability 🔗

Sustainability asks whether the benefits of the project will continue once external support ends. Sustainability is the extent to which the net benefits of the intervention continue, or are likely to continue, and involves examining financial, economic, social, environmental, and institutional capacities.

A nutrition counselling project that depends entirely on donor-funded supervisors will collapse the day the funding stops, no matter how strong its short-term results were. A similar project that trains panchayat members, integrates into the existing ICDS structure, and builds anganwadi worker capacity has a much better chance of surviving. Sustainability is not just about money; it is also about institutional ownership, community buy-in, environmental resilience, and political support.

Significance 🔗

Significance is about how meaningful the changes are, both statistically and substantively. A reduction in anaemia prevalence from 52% to 51% may be statistically detectable in a large sample, but it tells us little about whether the project made a real difference in women’s lives. A reduction from 52% to 38% is significant in a way that matters for policy. Significance therefore pushes evaluators beyond numbers and toward judgements about whether observed changes are large enough, broad enough, and important enough to count as meaningful.

In population and family health studies, significance often involves equity considerations as well. A programme that improves average health indicators while leaving the poorest quintile untouched may show statistically significant outcomes but raise serious questions about its real worth.

Stakeholders: the people who matter 🔗

Stakeholders are all individuals, groups, and institutions that affect or are affected by the project. They can be grouped into several categories. Primary stakeholders are the direct beneficiaries, such as pregnant women, infants, adolescents, or elderly persons in a health scheme. Secondary stakeholders are those involved in delivery, including ASHA workers, ANMs, anganwadi workers, medical officers, and NGO staff. Key stakeholders include funders, policymakers, district health officials, and panchayati raj institutions whose decisions shape the project.

Stakeholder identification is not a formality. A scoping step in a health impact assessment normally involves senior project staff, health specialists, and key stakeholders such as representatives of local communities, local government, and public health services. Leaving out important voices, especially those of beneficiaries, can produce evaluations that miss what the project actually meant for the people it was supposed to help.

A systematic review of stakeholder engagement in healthcare research found that involving patients, providers, and policymakers helps ensure research addresses real-world needs and strengthens its influence on practice. Stakeholders are not just data sources; they shape what gets measured, how findings are interpreted, and whether recommendations get implemented.

Bringing the terms together 🔗

Think of these terms as links in a chain. Inputs feed into activities. Activities produce outputs. Outputs lead to outcomes, which over time accumulate into impact. Effectiveness judges whether objectives were met along this chain. Sustainability asks whether the benefits will last. Significance asks whether the changes matter. Stakeholders are the people for whom this entire chain exists, and whose perspectives must inform every link.

Mastering this vocabulary is not about memorising definitions. It is about being able to ask the right question at the right level. When someone reports that a project “succeeded,” a trained evaluator immediately wants to know: succeeded at what level? Did it deliver outputs? Produce outcomes? Achieve impact? Will the gains last? Did the right people benefit? Without clear terms, these questions cannot even be framed, let alone answered.

What do you think? If you had to evaluate a health programme in your own district, which of these terms would be the hardest to measure honestly, and why? And do you think Indian public health evaluations pay enough attention to sustainability and stakeholder voices, or do they stop at counting outputs?

References

1. https://www.oecd.org/en/topics/sub-issues/development-co-operation-evaluation-and-effectiveness/evaluation-criteria.html
2. https://www.intrac.org/app/uploads/2024/12/Outputs-outcomes-and-impact.pdf
3. https://www.researchtoaction.org/2023/03/how-to-develop-input-activity-output-outcome-and-impact-indicators/
4. https://evaluateblog.wordpress.com/2013/06/10/difference-between-inputs-activities-outputs-outcomes-and-impact/
5. https://www.oecd.org/content/dam/oecd/en/publications/reports/2019/12/better-criteria-for-better-evaluation_f7a307eb/15a9c26b-en.pdf
6. https://pmc.ncbi.nlm.nih.gov/articles/PMC4067933/
7. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12080155/