Evaluation Design
Evaluation design is the structure that allows you to collect and analyze the data needed to answer your evaluation questions. It is important that the evaluation design align with your logic model, goals, research questions, available resources, and (funder) requirements.
Impact Evaluation
What is it? Impact and outcome assessment have differing definitions, but are sometimes used interchangeably, depending on who you talk to. Although similar in concept, they have different uses. As the name implies, impact evaluation is evaluating the change, effects, or impact that are associated with a program’s activities. The goals of this type of evaluation are to document whether and to what extent a program met its stated objectives and sub-objectives, as well as its short and medium-term objectives. While change can sometimes be assessed through self-reported measures at varying points, at other times in order to determine change, a comparison or control group may be required. These types of evaluation are usually quasi-experimental (comparison group) or experimental (control group), and rely heavily on quantitative data collection and more advanced analysis. Because they rely more on quantitative methods, they seek to answer quantifiable questions: How often? How many? How much? What is the average…? What percentage?
Our consultants can help you build the necessary impact design to evaluate the change as a result of your program, as well as meet your organizational (and funder, if applicable) requirements.
How can we help you?
- Determine the type of evaluation design needed for your evaluation
- Experimental (impact design)
- Quasi-experimental (impact design)
- Non-experimental (process design, outcome design)
Related Services
Lessons Learned
Lessons learned are experiences, knowledge, understandings, or outcomes gained by experience from a particular project or program that should be taken into account on future projects or programs.
Learn MoreMonitoring & Evaluation
Coaches have experience and expertise to support the learning and tasks of the people that need help.
Learn MoreEvaluation Coaching & Training
Coaches have experience and expertise to support the learning and tasks of the people that need help.
Learn MoreEvaluation Logic Models
A logic model is a one-page, compelling graphic (your road map) that tells the reader/reviewer exactly what, when, where, why, and how.
Learn MoreArticles and White Papers About Impact Evaluation
Baselines: The Bottom Line
Articles and White Papers About Impact Evaluation Baselines: The Bottom Line Read More What Are You Actually Measuring? Selecting the Right Indicator to Measure Progress Articles and White Papers About Monitoring & Evaluation To RCT or Not? Randomized Control Trials in Nonprofit Work Read More Whose Job is it to...
Read MoreWhat Are You Actually Measuring? Selecting the Right Indicator to Measure Progress
Articles and White Papers About Monitoring & Evaluation To RCT or Not? Randomized Control Trials in Nonprofit Work Read More Whose Job is it to Evaluate? Read More The Problem with Relying Solely on Dashboards Read More Finalizing Reports: Statements of Differences Read More Load More
Read MoreMonitoring Versus Evaluation
Articles and White Papers About Monitoring & Evaluation To RCT or Not? Randomized Control Trials in Nonprofit Work Read More Whose Job is it to Evaluate? Read More The Problem with Relying Solely on Dashboards Read More Finalizing Reports: Statements of Differences Read More Load More
Read MoreHow Do You Conduct a Needs Assessment?
Articles and White Papers About Need Assessments How Do You Conduct a Needs Assessment? Read More Why Should You Think About Needs Assessments? Read More Needs Assessments: Their Importance In Times of Crisis Read More Needs Assesment in Healthcare- Why CHNA? Read More Load More
Read MoreFAQ About Impact Evaluation
This depends on the type of data you have and your target audience, but there are many options when it comes to data visualization. A few examples include Tableau, SAS, and Nvivo.
The major advantages of longitudinal analysis are that you can assess change or show clear patterns, as there are multiple time points of data collection. The major disadvantages are that this type of study takes longer to do, is more expensive, and is more limited in terms of breadth of experience.
There are many things to keep in mind when creating an evaluation plan, but some considerations are the program/project goals, the evaluation questions that need to be answered, who the key stakeholders are, program/project activities, outputs, outcomes, and any challenges or other factors that may affect the program.
Impact assessment should be considered early in planning, and its timing should be carefully considered. It should not be conducted too early because there may not have been enough time to develop longer term impacts, while if conducted too late, the impacts may be declined. The assessment should be conducted when its intended use is clear and its findings used for necessary decisions.
Generally speaking, outcome evaluation can begin to measure changes at least six months after program implementation.
What Our Clients Say About Us
Peggy Ostrander, DNPc, APRN, FNP-C Plano, Texas