Why is Evaluation Important?
Evaluation, in an evidence-informed organization, is intended to provide insights into the successes or problems as they are occurring in any policy or program initiative and to provide accountability. Although evaluation also has technical components, the power of evaluation is in providing organizations with credible and defensible information for adapting, adjusting or even changing course based on evidence about the progress and impact of organizational initiatives.
- Evaluation is important to measure progress and ensure effective project or program implementation as well as effective use of public money.
- Evaluating identifies what works and what doesn’t, informs decision-making, and contributes to evidence-based policy development and improvement.
- Evaluation demonstrates accountability, builds collective capacity, and reflects government’s commitment to improve student outcomes.
Getting Started: A 10 Step Process to Conducting Evaluations
Evaluation usually involves collecting and analyzing information about a program or initiative’s activities, characteristics, and outcomes.
Conducting Evaluations – 10 Steps (if you are hiring someone to conduct the evaluation)
Evaluation is important to ensure effective project or program implementation as well as effective use of public money.
- Information from evaluations tells us what works and what doesn’t, and ultimately contributes to implementing evidence-based practices in education.
- After you have clarified the issue and defined the project, follow the steps below as they contain information and tools to guide you through an external evaluation project.
- N.B. The steps are only a guide; you may not follow them sequentially.
Step 1: Review the Literature
There is an abundance of literature in education and indeed there is little that is completely unknown. It is important to identify and use existing research within the organization, or externally to guide your evaluation. For a thorough review, it is important to seek multiple sources of information. This guide will help you get started on conducting a research literature review.
Step 2: Determine the Evaluation Question(s)
The success of the evaluation rests on the quality of the questions. Evaluation questions should be specific and reflect the purpose of the project. High quality evaluation questions establish the parameters of the evaluation to inform decisions regarding the issue. The external contractor should be responsible for determining the final evaluation questions; however, you should have an idea of the potential questions. This tip sheet will assist you in developing an evaluation question.
Step 3: Develop a Logic Model and/or Theory of Action
A logic model is a graphic representation of the inputs, activities, outputs, and outcomes of a program. It will typically be up to the external contractor to create a logic model for an evaluation, however it is important to understand logic models in order to be able to work with the evaluation team. This tip sheet will assist you in developing logic models.
The theory of action forms the foundation for developing an evaluation process that will address the evaluation questions that are important for making adjustments along the way, in any initiative, and in determining how well the initiative is meeting its goals.
Step 4: Understand Evaluation Approaches and Methodologies
There are several different types of evaluation approaches and methodologies, depending on the question being asked, time and resources available, and the purpose of the project. Again, it will be up to the contractor to decide on the methods; however, it is helpful for you to understand the methods in order to assess the appropriateness of what is recommended by the external evaluator.
This tip sheet will help you better understand the different types of evaluation approaches.
Step 5: Identify Existing Data
Recognize that there may be existing data that could be used to support an evaluation project. Scan and identify existing sources of data.
Step 6: Doing it Yourself or Hiring Someone
OPTION A – Doing it yourself
Workflow Chart (if you are conducting the evaluation)
OPTION B – Hiring an Evaluator (if you are hiring someone to do the evaluation)
This process may vary depending on your organizational protocol. It is best to consult your organization’s protocols and guidelines for procuring external services.
- Prepare a Request For Services (RFS)/Request for Proposals for Evaluation
- Assess Proposals Received for Carrying Out an Evaluation Project
- Prepare a Contract for Evaluation
Step 7: Refine the Evaluation Questions, Scope and Plan
- Determine the nature of evaluation that is aligned with the strategic direction set by the organization and/or senior management.
- Clarify purpose of evaluation and check if the evaluation goals or purposes serve the direction.
- Work together to develop sound evaluation framework that is most appropriate to address evaluation questions, taking into account the theory of action.
- Check if the approach to the evaluation (e. g. evaluation purpose, scope, logic model) is likely to satisfy the expectation
Step 8: Manage, Support and Monitor Progress
This tip sheet will tell you everything you need to know about maintaining a good working relationship with your external contractor.
Step 9: Assess Final Evaluation Report
It is important to assess the final evaluation report against the original proposal and the original evaluation question(s). This tip sheet and checklist will help you do that.
Step 10: Communicate the Findings
Communicating the findings in a clear and concise way is important to ensure that the findings will be understood and used to inform policy and practice. Results of an evaluation project that has been done externally will most likely be communicated internally, but could be communicated externally as well. Whether you communicate internally or externally, ask yourself the following questions as early as possible:
- Who is your audience? Who is interested in this information, and who else could benefit from it?
- Are the results confidential? What information can you share, and with whom?
- How much time will the target audience have to digest the information?
- How can you best reach your target audience?
- What format will be suitable to share this information?
If you’re looking for more information about communicating your findings, see Knowledge Mobilization for tools and templates.