Designing a nutrition programme is only half the work. The harder, often invisible half is finding out whether it actually changes what people eat, how they feed their children, or how their health improves over time. That answer comes from evaluation, and evaluation itself comes in different forms, each timed to a specific stage of the programme. Understanding the three core types, formative, process, and summative, helps planners spend resources wisely and prevents well-intentioned interventions from quietly failing.
Table of Contents
- Why nutrition programmes need structured evaluation
- Formative evaluation: shaping the programme before and during early implementation
- What formative evaluation typically includes
- An example from maternal nutrition programmes
- Process evaluation: monitoring how the programme is actually delivered
- Key questions in process evaluation
- What process evaluation reveals in practice
- Methods used
- Summative evaluation: measuring outcomes, impact, and the unexpected
- Short-term, medium-term, and long-term outcomes
- Capturing unintended effects
- Methods used
- How the three types work together
- Practical considerations for evaluators
Why nutrition programmes need structured evaluation
Nutrition programmes rarely fail because of bad intentions. They fail because no one notices, in time, that the supplementary food is not reaching beneficiaries, that messages are misunderstood, or that behaviour change is not happening at the household level. Evaluation is the systematic process of collecting, analysing, and interpreting information about a programme to judge its design, delivery, and effects. According to the CDC Program Evaluation Framework, evaluation is essential for improving programmes, demonstrating accountability to funders, and building evidence about what works.
In the Indian context, structured evaluation has shaped some of the country’s largest nutrition interventions. The Planning Commission’s evaluation of the Integrated Child Development Services (ICDS) scheme assessed programme design, implementation process, outcomes, and impact across multiple states. Such evaluations have repeatedly exposed gaps, such as interrupted food supplies at Anganwadi Centres or low coverage of nutrition and health education, that would otherwise stay hidden in glossy progress reports.
The Food and Agriculture Organization describes evaluation as serving two broad functions: formative and summative, with process evaluation often treated as a continuous monitoring activity that connects the two. Together, these three types form a complete evaluation cycle.
Formative evaluation: shaping the programme before and during early implementation
Formative evaluation happens early. It is the work done before a programme is fully launched, or during its initial roll-out, to make sure the design fits the people it is meant to serve. The CDC defines formative evaluation as the assessment of whether a programme or approach is feasible, appropriate, and acceptable before it is fully implemented.
In nutrition work, this stage often involves understanding the community’s existing food habits, cultural beliefs about food, literacy levels, language preferences, and the constraints families face. Without this groundwork, even technically sound interventions can collapse on contact with reality.
What formative evaluation typically includes
Formative evaluation usually relies on qualitative methods such as focus group discussions with mothers, in-depth interviews with frontline workers, pilot testing of educational materials, and key informant interviews with community leaders. As the FAO notes, qualitative approaches are particularly useful in making a programme work better by feeding information back to managers during design.
Common questions at this stage include:
- Is the message understandable? A poster on iron-rich foods is useless if the images do not match what families actually eat.
- Is the delivery channel right? Counselling sessions scheduled when women are working in the fields will simply not reach them.
- Are the materials culturally appropriate? Recommending foods that are taboo for pregnant women in a particular community will be ignored, however nutritionally sound.
- Can frontline workers deliver the content? If Anganwadi workers themselves do not understand the science, the message will not travel.
An example from maternal nutrition programmes
Consider a district planning a nutrition counselling programme for pregnant women. Before scaling up, the team conducts focus groups to find out which foods women already consume, which they avoid, and what advice they trust from elders. They pilot a flipbook with a small group of Anganwadi workers and discover that one illustration is being misread, and that a key term in the local dialect carries a different meaning. These findings are folded back into the design before the full launch. That feedback loop is the essence of formative evaluation.
Process evaluation: monitoring how the programme is actually delivered
Once a programme is running, the next question is whether it is being delivered the way it was designed. Process evaluation, also called implementation evaluation, assesses how the programme is being implemented relative to its intended theory of change. It looks at content, quality, quantity, and structure of what is being delivered.
This is the evaluation type that catches problems while they can still be fixed. A perfectly designed programme can fail at the implementation stage if supplies do not arrive, staff are not trained, sessions are skipped, or records are inaccurate.
Key questions in process evaluation
Process evaluation usually tracks indicators such as:
- Coverage: What proportion of the intended beneficiaries is the programme actually reaching?
- Fidelity: Are activities being carried out as planned, with the right content and dosage?
- Quality: Are counselling sessions interactive, or are they reduced to one-way lectures?
- Inputs and logistics: Are supplies, materials, and staff in place when and where needed?
- Beneficiary experience: Are participants satisfied, and are dropouts being recorded?
What process evaluation reveals in practice
Process evaluation of the ICDS scheme has repeatedly highlighted operational gaps. A facility-based study in Gujarat found that supplementary nutrition coverage was reported in 48.3% of children, and interruption in supply of supplementary nutrition during the last six months was reported in 61.7% of Anganwadi centres. Another analytical study reported that across services, the mean coverage of ICDS services was 58.3%, with maximum coverage for supplementary nutrition and minimal coverage for nutrition and health education.
These are exactly the kinds of findings process evaluation is designed to surface. Without them, planners would have no way to know that the bottleneck is not the design of the programme but its delivery on the ground.
Methods used
Process evaluation typically combines record reviews, observation of sessions, exit interviews with beneficiaries, supervisor checklists, and supply chain audits. It is meant to be continuous rather than one-off, so that emerging problems trigger course corrections in near real time. In nutrition education programmes specifically, qualitative methods such as participant observation and key informant interviews are critical for understanding why something is or is not working, not just whether it is.
Summative evaluation: measuring outcomes, impact, and the unexpected
Summative evaluation is conducted at the end of a programme phase, or after sufficient time has passed, to judge whether the programme achieved what it set out to achieve. The FAO defines summative evaluation as the measurement of the outcome of an activity or set of activities, often used to satisfy accountability requirements of sponsors. The CDC further distinguishes outcome evaluation, which measures how well intended outcomes have been achieved, from impact evaluation, which examines longer-term and broader effects.
Short-term, medium-term, and long-term outcomes
A community nutrition intervention aimed at preventing anaemia in adolescent girls might track:
- Short-term outcomes: Improved knowledge of iron-rich foods and changes in attitudes immediately after the programme.
- Medium-term outcomes: Reported changes in dietary behaviour and supplement intake three to six months later.
- Long-term outcomes: Reduction in anaemia prevalence and improvement in haemoglobin levels after one or more years.
Each layer answers a different question. Knowledge change alone does not guarantee behaviour change, and behaviour change alone may not translate into measurable health improvement without sustained support.
Capturing unintended effects
Good summative evaluation also looks for unexpected outcomes, both positive and negative. A programme promoting fortified foods might unintentionally reduce demand for traditional iron-rich local foods. A school meal programme might improve attendance more than nutritional status. Evaluations of large Indian nutrition programmes have noted, for example, that some interventions succeeded in reducing severe malnutrition but not moderate malnutrition, an important nuance that simple success-or-failure reporting would miss.
Methods used
Summative evaluation typically uses quantitative methods, such as pre-post surveys, anthropometric measurements, biochemical tests for micronutrient status, and comparison with control groups or baseline data wherever possible. It often combines these with qualitative interviews to interpret why outcomes did or did not occur.
How the three types work together
The three evaluation types are not alternatives to each other. They are sequential and complementary stages of a single learning cycle.
A well-designed nutrition programme typically follows this rhythm:
- Formative evaluation shapes the design and pilots the materials.
- Process evaluation monitors implementation and corrects course as the programme runs.
- Summative evaluation measures outcomes and impact, and feeds lessons back into the next cycle.
The CDC describes program evaluation as part of a continuous improvement lifecycle, with findings from one stage feeding the next. Skipping any of the three weakens the others. A programme without formative work risks being culturally tone-deaf. A programme without process evaluation cannot explain why outcomes did or did not occur. A programme without summative evaluation cannot defend its continuation, scale-up, or redesign with evidence.
Practical considerations for evaluators
Choosing the right mix of evaluation types depends on the programme’s stage, available resources, and the questions stakeholders most need answered. A pilot project in a single block may need heavy formative work but minimal summative measurement. A long-running national scheme like the ICDS requires periodic process evaluation in every state and rigorous summative evaluation to inform policy.
Evaluators also need to plan for cultural sensitivity, ethical data collection, and meaningful engagement with the community being evaluated. Numbers without context can mislead, and context without numbers cannot drive policy.
What do you think? If you were designing a nutrition programme for adolescent girls in your district, which type of evaluation would you invest in most heavily, and why? And how would you decide when a programme has been evaluated “enough” to scale up or shut down?
References
- https://www.cdc.gov/mmwr/volumes/73/rr/rr7306a1.htm
- https://dmeo.gov.in/sites/default/files/2019-10/Evaluation%20Report%20on%20Integrated%20Child%20Development%20Services%20Volume%201.pdf
- https://www.fao.org/4/w3733e/w3733e06.htm
- https://www.cdc.gov/evaluation/php/about/index.html
- https://www.fao.org/4/w0795t/w0795t05.htm
- https://pubmed.ncbi.nlm.nih.gov/25228602/
- https://www.researchgate.net/publication/373366644_EVALUATION_OF_INTEGRATED_CHILD_DEVELOPMENT_SCHEME_IN_INDIA_AN_ANALYTICAL_STUDY
- https://www.ncbi.nlm.nih.gov/books/NBK258728/

Leave a Reply