Learning from Experience
Toolkit Home | Phase 1 | Phase 2 | Phase 3 | Phase 4
For the final stage of the QIF, after the intervention has been fully implemented, the team needs to review the entire implementation process and articulate what they have learned. Not only can they learn from their own experience, but they should share these lessons learned with other attempting similar projects. 
​
For this step, the implementation team needs to identify:
​
-
the lessons that have been learned about the implementation of the intervention. 
-
The best channels for sharing this information with others that may be interested in enacting similar interventions.
Tools to use during the Learning from Experience phase:
Formative Evaluation
This formative evaluation training package guides the implementation support team in completing formative evaluation using mixed methods for internal learning of the implementation process. Formative evaluation gathers and analyzes feedback during the implementation process. The goal is to enable teams to know what changes to make on the project while they are still implementing it.
Who should use Formative Evaluation?
Any team that is working on an implementation project should develop standards used to evaluate their progress during the implementation process. Teams with complex structures or untested interventions would benefit from working through the full Formative Evaluation training to design a complex multi-stage evaluation process. ​
​
How does the tool help with Implementation?
The training provides a base line for the kind of summative evaluation questions teams should be asking. Formative evaluation needs to be accounted for during Phase three as part of the Process evaluation step. ​The use of the formative evaluation tools should be used during the entire implementation process.
​
Resources recommended:
Time: Using the Formative Evaluation training to design and implement a full evaluation process for the team's implementation process can be time intensive depending on the needs of the team. Time heavy resource.
​
People: Most of the implementation planning team should be involved in developing the evaluation process with input from those directly working with the interventions. Personnel medium resource.
​
Funding: The only cost for the tool itself is the personnel time to create and implement the evaluation process. Funding heavy resource.
​
-
-
​Full Slide deck with description of training along with slides that cover qualitative, quantitative, and mix-methods data collection along with how to select the appropriate method.
-
​​​​
Toolkit Evaluation Guide
The toolkit evaluation guide assesses the implementation process, identifies missed steps, and facilitates and informs discussions about how to improve the process of moving through the four phases of the Quality Implementation Framework (QIF). The guide also provides specific deliverables and markers of success for each QIF phase. The answers to the questions will allow the user to assess if the activities are occurring as expected.
Who should use the Toolkit Evaluation Guide?
Every team should use the evaluation guide to develop their implementation strategy and should evaluate the process after each step.​
​
How does the tool help with Implementation?
The Toolkit Evaluation Guide enables a feasible, structured process to identify how the implementation process is going, as well as missed steps and/or areas for improvement. Through this evaluation process, the questionnaire enables awareness and accountability at every phase of the QIF.
​
Resources recommended:
Time: Each tool you use during the QIF step needs to be evaluated. However, this evaluation does not need to be exhaustive, but capturing how the process went and if the tool met the teams need is helpful when trying to ascertain the success of the implementation process while still implementing the intervention. Time light resource.
​
People: Ideally the implementation support team will evaluate each step together, but the lead on each tool could fill in most of the relevant information. Personnel light resource.
​
Funding: Personnel time is the only funding resource needed. Funding light resource.
​
-
Process Evaluation Questionnaire Tool
-
Slide desk with a description of the tool along with instructions on how to complete the evaluation.
-
​