• Evaluation is about asking good, critical questions to help us learn and be accountable. Identifying “good” questions is an important aspect of creating useful evaluations.

      
  • What is important to measure?
  • What will you spend time and resources on?

• One of the greatest benefits of the logic model is that it clarifies what the program is. Understanding what the program is, is the first step in any evaluation.
• What, in particular, do you want to evaluate? Is the focus of the evaluation the whole program or a component of the program?

• Section 7: Using Logic Models in Evaluation

   

  <!-- .entry-header -->     

    

     
• In addition to helping you plan a program, the logic model can help you measure your outcomes and improve your evaluation practice. In this section you will learn how the logic model can help you determine what to evaluate, identify appropriate questions for evaluation, select indicators, know when to collect data and determine what data collection methods are most appropriate.
• • Recognize how the logic model helps determine what you will evaluate – the focus of your evaluation.
  • Recognize how the logic model helps you determine meaningful and useful evaluation questions – know what to measure.
  • Understand indicators and know what information best answers your evaluation questions.
  • Be able to identify appropriate timing for data collection.

1 more annotation...

• As you finalize your outcome chain and focus on the outcome(s) of interest, streamline your outcome chain by considering whether the outcomes are:

      
  1. Important: Are the end outcomes important? Do they represent significant change or improvements that are valued by participants and key stakeholders? Outcomes may be achievable but not really worth the effort. Apply the “Who cares?” test.
  2. Reasonable: Are the outcomes linked in reasonable order? Is it likely that one will lead to the next, which will then will lead to the next?
  3. Realistic: Are the outcomes realistic given the nature of the problem, your resources, and your abilities? Will the program lead to or help contribute to these outcomes? (Be careful to ensure that the outcomes are realistic given the level of effort.)
  4. Potentially negative/accompanied by negative consequences: What are potential negative effects that we need to anticipate? What else might happen? Or, how else might the sequence of events unfold?

• The environment in which the program exists includes a variety of external factors that can influence the program’s success. External factors include the cultural milieu, the climate, economic structure, housing patterns, demographic patterns, political environment, background and experiences of program participants, media influence, and changing policies and priorities. These external factors may have a major influence on the achievement of outcomes. We can’t ignore them! They may affect a variety of things including the following:

      
  • Program implementation
  • Participants and recipients
  • The speed and degree to which change occurs
  • Staffing patterns and resources available