Exploring Process, Summative, and Formative Evaluation in Nutrition

Imagine you’ve just poured months of effort into launching a community nutrition program. You’ve designed beautiful pamphlets, trained volunteers, and run dozens of workshops aimed at improving the eating habits of new mothers. Everyone *seems* happy, and the workshops are full. But a critical question lingers: Is it actually working? Are the mothers learning? Are they changing their behaviours? Most importantly, are their children healthier? This is where program evaluation steps in. It’s not just a final exam or a “pass/fail” grade. Instead, it’s a vital, ongoing process of learning, adapting, and proving that our efforts are making a real difference. In public nutrition, evaluation is the tool we use to move from “we *think* this helps” to “we *know* this helps, and here’s how.”

To get the full picture, we can’t just look at the end result. We need different types of evaluation to act as our guides at different stages of the journey. Think of it like navigating a ship: you need a map to plan your route (formative), a compass to check you’re on course (process), and a destination check to see if you arrived (summative). Let’s break down these three core types of evaluation.

What is formative evaluation? (And what does it have to do with soup?) 🔗

Formative evaluation is the work you do before or during the very early stages of a program. Its main goal is to “form” or shape the intervention to be as effective as possible right out of the gate. It’s all about ensuring feasibility, appropriateness, and acceptability. In short, it’s research that helps you build the *right* program for the *right* people in the *right* way.

The most famous and helpful analogy for this concept was coined by Robert Stake: “When the cook tastes the soup, that’s formative evaluation.”

Imagine you are the cook (the program manager), and the soup is your new nutrition program. You wouldn’t just create a recipe, dump all the ingredients in a pot, and serve it at a banquet without tasting it first, would you? Of course not. You’d taste it as you go. You’d ask yourself: Does this need more salt? Is it too spicy for the intended audience? Is the texture right?

This tasting process is formative evaluation. It’s a low-stakes check designed to provide immediate feedback so you can fine-tune the intervention before you spend thousands of dollars rolling it out to 10,000 people. It helps you catch design flaws early.

Using formative evaluation to fine-tune interventions 🔗

Let’s say your program plans to use a radio programme to spread messages about breastfeeding. Formative evaluation would involve:

• Concept Testing: You’d gather a small group of new mothers (a focus group) and share the *idea* of the radio show. You’d ask: Do you listen to the radio? What time of day? What kind of programming do you trust?
• Pre-testing Materials: You would create a *draft* of the radio script and the informational pamphlets. Then, you’d show them to the focus group. You’d ask: Is this message clear? Is the language confusing? Is the person on the radio believable? Is this image appropriate or does it look silly?

Based on this feedback, you might discover that your radio show is scheduled when most mothers are working in the fields, or that the pamphlets use technical jargon no one understands. Formative evaluation gives you the chance to fix these problems. It ensures that by the time your program launches, it’s not just a good idea in *your* head, but a good, practical, and well-received idea in the *community’s* reality.

Are we doing what we said we would? Understanding process evaluation 🔗

Once your program is shaped and launched, the work shifts. Now, you need to know: Is the program actually being delivered as we planned? This is the job of process evaluation. It monitors the *implementation* of the program in real-time. It’s less about the *outcome* (did health improve?) and more about the *outputs* and *activities* (did we do the things we said we would do?).

If formative evaluation is tasting the soup, process evaluation is checking your kitchen operations while the banquet is underway. It answers questions like:

• Did all the ingredients arrive from the supplier on time?
• Are the chefs following the recipe exactly as written?
• Are we serving the courses in the right order?
• Are we running out of food, or are we making way too much?

Process evaluation is the day-to-day management tool that tracks the “how” of your program. It’s the “monitoring” part of “Monitoring & Evaluation” (M&E).

Monitoring progress and adjusting in real-time 🔗

In our nutrition program, process evaluation would track key metrics to see if the program is being implemented with fidelity. This is crucial, because if your program *doesn’t* show good results at the end, you need to know why. Was it a bad program idea (a “theory failure”), or did the program just not happen as planned (an “implementation failure”)?

Process evaluation stops you from guessing. It would track:

• Reach: We planned to reach 500 mothers. How many have actually attended a workshop?
• Fidelity: We trained 20 community health workers (CHWs) with a specific checklist. Are the CHWs actually *using* the checklist during home visits?

Storage: Are the micronutrient supplements being stored at the correct temperature in the clinics?

• Community Mobilization: Our plan included six meetings with village leaders. Have those meetings happened? Did the leaders agree to support the program?
• Participant Satisfaction: After a workshop, you might ask: Was the room comfortable? Could you hear the speaker? Was the session too long? This feedback allows you to make immediate adjustments for the *next* workshop.

This kind of monitoring is essential. The World Health Organization emphasizes that process evaluation helps identify bottlenecks and inefficiencies early. If you find that workshop attendance is low, you can investigate *why* (maybe they are at the wrong time of day) and fix it, instead of waiting a year to find out your program failed to reach anyone.

Did it actually work? The final verdict with summative evaluation 🔗

Finally, we arrive at summative evaluation. This is the one most people *think* of when they hear “evaluation.” It happens at the end (or at major milestones) of a program, and its purpose is to “sum up” the program’s overall effectiveness. It’s the big-picture verdict.

Let’s return to our soup analogy. The cook tasted the soup (formative). The kitchen manager checked the operations (process). Now, the soup is served to the guests. “When the guests taste the soup, that’s summative evaluation.”

Their reaction is the final judgment. Did they like it? Did it satisfy their hunger? Was it worth the price? Would they come back to this restaurant? At this point, the cook can’t run back to the kitchen and add more salt. The “intervention” is complete. The goal now is to learn from the final result to decide if the “recipe” (the program) should be continued, expanded, or discontinued.

Measuring effectiveness and unexpected outcomes 🔗

Summative evaluation focuses on outcomes and impact. It answers the “so what?” question. Did all our hard work-the workshops, the radio shows, the home visits-actually lead to the change we wanted?

In our nutrition program, summative evaluation would measure:

• Knowledge & Attitudes: Did parents’ knowledge about healthy eating improve? Do they now believe that complementary feeding is important?
• Behaviour Change: This is a key outcome. Are parents *actually* feeding their children more diverse diets? Are they using the safe food preparation techniques they learned?
• Nutritional Status (Impact): This is the ultimate goal. Did the rates of stunting, wasting, or micronutrient deficiencies (like anemia) decrease among the children in our program? To do this properly, we’d often compare our program group to a control group that didn’t receive the program.

Summative evaluation is also where we look for unexpected outcomes, both good and bad. Perhaps the workshops had an unintended positive effect: the mothers formed a social support group and started a community garden. That’s a fantastic, unexpected outcome! Or, perhaps the program had a negative effect: the free supplements disrupted the local market. Summative evaluation, when done well, captures this full picture to determine the program’s total value.

Formative, process, summative: Why you need all three 🔗

It’s tempting to see these three types as separate, but they work best as a continuous cycle. They are not mutually exclusive; they are partners in creating a successful, accountable, and impactful program.

Think of it one last time, like building a custom house:

1. Formative Evaluation: This is the architect sitting down with the family *before* drawing the blueprints. What do you need? How many rooms? Do you need a ground-floor bedroom? You *must* do this first to ensure you are building the *right house*.
2. Process Evaluation: This is the construction foreman checking the site *every day*. Are the workers using the right materials? Is the foundation being laid to code? Is the plumbing being installed correctly? You do this to ensure the house is being *built correctly*.
3. Summative Evaluation: This is the final inspection *after* the house is built. Does it meet the family’s needs? Is it safe? Is the electricity working? This tells you if the project was a *success*.

You would never wait until the house is finished to ask the family what they wanted (summative without formative). And you wouldn’t do a final inspection if you knew the workers used shoddy materials (summative without process). You need all three to turn a good idea into a great, lasting result.

What do you think?

Can you think of a time in your own life (like starting a new project at work or even trying to learn a new skill) where you used a “formative” or “process” approach without realizing it? How could asking these evaluation questions earlier and more often help improve community projects you care about?

References

1. https://www.cdc.gov/evaluation/steps/index.htm
2. https://www.betterevaluation.org/en/themes/formative_evaluation
3. https://www.usaid.gov/global-health/monitoring-and-evaluation