What is Impact Assessment? Understanding Its Meaning and Importance

Every public health programme, social welfare scheme, or development project is launched with a promise: it will change lives for the better. But how do we actually know if a scheme like Janani Suraksha Yojana reduced maternal mortality, or if a literacy mission truly empowered rural women? This is where impact assessment steps in. It is the disciplined process of looking beyond activity reports and beneficiary numbers to ask the harder question: did this intervention create lasting change in people’s lives?

Defining impact assessment 🔗

Impact assessment is a structured method of evaluating the long-term, significant effects of a project, programme, or policy on a population. Unlike monitoring (which tracks ongoing activities) or evaluation (which judges overall performance), impact assessment isolates the changes that can be attributed to a specific intervention, including effects that were never planned.

The OECD Development Assistance Committee (DAC) treats impact as one of its six core evaluation criteria, alongside relevance, coherence, effectiveness, efficiency, and sustainability. According to the OECD, impact evaluation asks: what difference does the intervention make? It examines the extent to which an intervention has generated, or is expected to generate, significant positive or negative, intended or unintended, higher-level effects.

A widely cited definition comes from Chris Roche, whose 1999 book for Oxfam shaped how NGOs across the world approach this work. Roche defines impact assessment as the systematic analysis of the lasting or significant changes – positive or negative, intended or not – in people’s lives brought about by a given action or series of actions. The strength of this definition lies in two phrases: “lasting or significant” and “intended or not”. It pushes practitioners to think beyond the immediate deliverables and look at deeper, sometimes unexpected, social consequences.

How impact differs from outputs and outcomes 🔗

Students often confuse outputs, outcomes, and impact. Outputs are the immediate products of a project – number of vaccines administered, classrooms built, or pamphlets distributed. Outcomes are the medium-term results, such as improved immunisation coverage or higher enrolment rates. Impact refers to the long-term, deeper transformations – reduced child mortality, intergenerational improvements in literacy, or shifts in social norms around early marriage. Impact assessment focuses on this last, hardest-to-measure layer.

Why impact assessment matters 🔗

The importance of impact assessment in population and family health work cannot be overstated. India spends thousands of crores every year on health, nutrition, and welfare programmes. Without rigorous assessment, governments and donors would be flying blind, unable to tell which schemes deserve scaling up and which need redesign.

Measuring real effectiveness 🔗

Impact assessment moves the conversation from “how much did we spend” to “what changed because of what we did”. For example, an impact study of Janani Suraksha Yojana using District Level Health Survey data found that the conditional cash transfer scheme not only increased institutional deliveries but also led to substantial reductions in maternal and infant mortality, partly because of cash incentives that motivated health workers to bring women to hospitals. This kind of evidence transforms a scheme from a budget line item into a proven public health intervention.

Guiding policy and resource allocation 🔗

Policymakers operate in a world of competing priorities. Should the next rupee go to anganwadi nutrition, adolescent reproductive health, or non-communicable disease prevention? Impact assessment supplies the evidence that informs such trade-offs. The World Health Organization describes health impact assessment as a valuable tool that helps shape policy and assist decision-makers, especially when it is introduced early enough for its recommendations to influence the final design of a programme.

Enhancing accountability and learning 🔗

Public money creates a public duty to demonstrate value. Whether a project is funded by the central government, a state department, or an international donor like the World Bank or UNICEF, stakeholders increasingly demand evidence of change. Impact assessment serves both accountability – proving that resources were used responsibly – and learning, by exposing what worked, what failed, and why. The OECD/DAC framework explicitly notes that impact evaluation guides decision-making, facilitates learning, and enables organisations to refine their strategies.

Capturing unintended consequences 🔗

Programmes rarely behave exactly as planned. A microfinance scheme intended to empower women might inadvertently shift household debt burdens. A sanitation drive might succeed in toilet construction but fail to change open-defecation behaviour. Roche’s emphasis on “intended or not” reminds assessors to look at the full picture. In family health programmes, capturing such ripple effects – on gender relations, on caste dynamics, on local economies – is often where the most important insights emerge.

Applications of impact assessment 🔗

Impact assessment is not a single tool but a family of approaches applied across the project life cycle. Understanding when and how to use it is essential for any researcher or programme manager.

Ex-ante and ex-post assessment 🔗

Impact assessment can be conducted before a project begins or after it ends. Ex-ante assessments forecast the expected effects of a planned intervention to inform policymakers, while ex-post assessments evaluate what actually happened once the project has run its course. A third form, concurrent assessment, runs alongside implementation. In the Indian context, an ex-ante Health Impact Assessment might be used before approving a large mining project to predict its effects on respiratory disease in nearby villages, while an ex-post study could examine how the National Rural Health Mission changed maternal outcomes over a decade.

Helping project managers course-correct 🔗

For programme managers, impact assessment is not just a final report card – it is a steering mechanism. By revealing which components are working and which are not, it helps managers reallocate staff, redesign training, or change beneficiary targeting. If an adolescent health programme finds that its school-based sessions are improving knowledge but failing to change actual contraceptive use, the manager can introduce peer counsellors or community outreach. Without impact data, such mid-course corrections rely on guesswork.

Strengthening policy in India 🔗

Despite its global recognition, formal health impact assessment is still underused in Indian policymaking. Scholars writing in the Economic and Political Weekly have argued that health impact assessment is gaining widespread credibility globally because it leads to a more holistic view of healthcare, but in India this process has not yet been mainstreamed. As the country pursues universal health coverage and ambitious population health goals, embedding impact assessment into the design of every major scheme – from Ayushman Bharat to POSHAN Abhiyaan – could significantly improve outcomes for women, children, and vulnerable communities.

Building evidence for civil society 🔗

Impact assessment is equally important for NGOs and community-based organisations working in family planning, maternal nutrition, adolescent health, and reproductive rights. Rigorous assessment helps these organisations secure continued funding, advocate for policy change, and most importantly, ensure they are genuinely serving the communities they claim to help. Roche’s case studies of BRAC and PROSHIKA in Bangladesh remain influential examples of how participatory impact assessment can reshape the way development agencies measure success.

Key features of a good impact assessment 🔗

Whether the assessment is for a government scheme, a research study, or an NGO project, certain features distinguish a credible exercise. It should be systematic, following a clear methodology rather than anecdote. It should be longitudinal, because true impact often takes years to surface – the OECD itself notes that impact evaluation is advisable only with a longitudinal approach, sufficient data for long-term analysis, and specialised expertise. It should be participatory, drawing on the voices of beneficiaries themselves. And it should be honest about attribution, acknowledging when changes might be caused by factors outside the intervention.

Challenges in conducting impact assessment 🔗

Impact assessment is powerful but rarely easy. Attribution is the central headache: when child mortality falls in a district, is it because of the new immunisation drive, improved roads, rising household incomes, or all of the above? Researchers tackle this using counterfactual designs, control groups, and mixed methods, but each approach has trade-offs. There are also practical hurdles – limited funding, scarce baseline data, weak monitoring systems, and the political sensitivity of negative findings. Despite these difficulties, the alternative – continuing to fund programmes without knowing whether they work – is far costlier in the long run.

What do you think? If you were asked to evaluate a family planning programme in your home district, which long-term changes would you focus on measuring, and how would you separate the programme’s true impact from other social changes happening at the same time?

References

1. https://www.oecd.org/en/topics/sub-issues/development-co-operation-evaluation-and-effectiveness/evaluation-criteria.html
2. https://developmentinpractice.org/readers/DebDev/Deb%20Dev%20Roche.pdf
3. https://isbinsight.isb.edu/impact-assessment-data-analysis-for-better-decision-making/
4. https://www.who.int/news-room/questions-and-answers/item/the-role-of-health-impact-assessment-(hia)-in-decision-making
5. https://www.activityinfo.org/blog/posts/2024-04-30-Introduction-to-the-role-of-oecd-dac-criteria-in-impact-evaluation.html
6. https://space-economy.esa.int/article/129/the-oecds-stand-of-what-is-impact-assessment
7. https://pmc.ncbi.nlm.nih.gov/articles/PMC4067933/
8. https://www.epw.in/journal/2007/35/special-articles/health-impact-assessment-project-and-policy-formulation.html
9. https://www.activityinfo.org/about/assets/pdf/2024-01-25-oecd-criteria-in-impact-evaluations.pdf