Process Evaluation
Toolkit Home | Phase 1 | Phase 2 | Phase 3 | Phase 4 | Phase 3 Action Steps
As the team implements the intervention, there is the need to monitor  the progress of the implementation process This includes collecting qualitative and quantitative data about the implementation process. They also need a system for collecting, storing, and analyzing.
​
As part of this step, the implementing organizations needs to:
​
-
Evaluate the strengths and limitations of the innovation's implementation over time, including how well different aspects of the innovation are being conducted and the performance of different individuals implementing the innovation.
Tools to use during the Process Evaluation phase:
Run Charts
Run charts display data to make process performance visible. The charts include explanations of shifts or trends in data focusing on special causes. Run charts allow teams to learn from data patterns, determine whether changes are leading to improvement, focus attention on changes in the process, and see if gains are sustained.
Who should use Run Charts?
Every team working on an implementation project should keep track of their implementation outcomes and run charts are an easy way to collect and display the data so that teams can judge their progress. ​
​
How does the tool help with Implementation?
Implementation teams will create and monitor data during phase three of the QIF, while they are implementing interventions with PDSA cycles. The charts and analysis will inform phases 4, when teams are learning from the work they have accomplished and beyond as they consider how to scale-up and sustain the interventions.
​
Resources recommended:
Time: Setting up the data collection for run charts can take some time, especially if the team needs to decide on what measures to collect. After creation, the data collection and analysis should be integrated into their normal workflow. Time medium resource.
​
People: Most of the implementation planning team should be involved in developing the run chart measures and data collection process with input from those directly working with the interventions. Personnel medium resource.
​
Funding: The only cost for the tool itself is the personnel time to create and implement the data collection processes. Funding medium resource.
​
-
-
Slide deck introducing run charts, along with instructions, and screen shots of the data entry and display features of run charts.
-
​
-
-
Simple 1-line Run chart template that teams can adapt to meet their needs.
-
​
PDSA
PDSAs are iterative cycles of change that is integral to the Model for Improvement. Through PDSA cycles, implementation teams can turn ideas into action and connect this action to learning. PDSAs are valuable, as iterative testing is less risky, easier to adapt and can inform participants belief in an intervention, which ultimately minimizes resistance to the proposed change.
Who should use PDSA?
All teams should use the general PDSA format when designing how to implement their interventions. It is recommended that teams with complex interventions or working within a complex system use the full PDSA worksheets. ​
​
How does the tool help with Implementation?
PDSAs, as part of the Model for Improvement, play a large role in how the intervention is put into action during Phase 3 of the QIF. These cycles provide much of the structure teams will use when putting an intervention into place. ​The PDSA Ramps, in particular, tie into the process of scaling up an intervention outline in the Going to Full Scale Framework as part of the sustainability work tied to the QIF​.
​
Resources recommended:
Time: Fully utilizing the worksheets in the PDSA toolkit for every intervention is relatively time intensive. Time medium resource.
​
People: Most of the implementation planning team should be involved in developing PDSA cycles with input from those directly working with the interventions. Personnel medium resource.
​
Funding: The only cost for the tool itself is the personnel time to fill out the PDSA worksheets. Funding medium resource.
​
-
-
Slide Deck with introduction slide with PDSA Ramp template and PDSA worksheet both blank and with annotations explaining how to fill both out.
-
​