Tools
State Leadership Team Materials
- Overview of State Leadership Team (SLT)
- Effective Teaming Strategies
- The Hexagon Tool
- SLT Meeting Planning and Evaluation Package
- State Coordinator(s) position description
- Considerations for State Annual Reports
- Considerations for a Written Sustainability and Scale-Up Plan
- RP Sustainability and Scale-up Planning Worksheet
- State Leadership Team (SLT) Checklist of Sustainability Features
Professional Development Network of Program Implementation Coaches Materials
- Overview of Professional Development Network of Program Implementation Coaches (PDN)
- Professional Development Network Q&A
- Program Coach Scope of Work
- Program Coach and Implementation Site Agreement
- Sample Letter of Invitation and Application Packet for PDN Members
- Sequence for PDN Training Events
Implementation and Demonstration Sites Materials
- Overview of Implementation and Demonstration Sites
- Demonstration Sites: Your Best Advocate for Practice and System Change
- Practitioner Coach position description
- Data Coordinator position description
- Sample Site Application Packet
- Program Leadership Team Q&A
- Sample News Release
- Implementation Site Development from Selection, through Practice Fidelity, to Scale-up and Demonstration
- Learning Lab: Exploring Coaching for Practice Change
Data Decision Making Materials
Tip Sheet Series: Evaluating the Implementation of Evidence-based Practices
This tip sheet series provides concise guidance for collecting and analyzing high-quality data on the implementation of evidence-based practices.
- Introduction
- Key Terms and Definitions
- Tip Sheet 1: What to Measure
- Tip Sheet 2: Characteristics of a High-quality Measurement Tool
- Tip Sheet 3: Establishing a Fidelity Threshold
- Tip Sheet 4: Summarizing Data for Decision-Making
- Tip Sheet 5: Analyzing Data for Decision-Making
- Entire Tip Sheet Series: Evaluating the Implementation of Evidence-based Practices
Measures
State Leadership Team Tools
- SLT Benchmarks of Quality: Implementing Evidence-based Practices Statewide
- SLT Benchmarks of Quality: Process for Self-Assessment
- SLT Benchmarks of Quality: Progress Tracking Spreadsheet (blank)
- SLT Benchmarks of Quality: Progress Tracking Spreadsheet (sample)
- SLT Benchmarks of Quality: Action Plan
Program Implementation Tools: Classroom
- RP Benchmarks of Quality for Classroom-Based Programs
- RP Observation Scale: Classrooms
- RP Observation Scale: Classroom (blank)
- RP Observation Scale: Classroom (sample)
- Classroom Benchmarks of Quality (blank)
- Classroom Benchmarks of Quality (sample)
- STARE (blank)
- STARE (sample)
Program Implementation Tools: Home-Visiting/Infant Toddler
- RP Benchmarks of Quality for Home-Visiting Programs
- RP Observation Scale: Home-Visiting
- RP Observation Scale: Home-Visiting (blank)
- RP Observation Scale: Home-Visiting (sample)
- Home-Visiting Benchmarks of Quality (blank)
- Home-Visiting Benchmarks of Quality (sample)
Coaching Tools
- RP Practitioner Coaching Log: Classroom
- RP Practitioner Coaching Log: Home-Visiting
- Program Coach Contact Record
- Individual Coaching Log (blank)
- Individual Coaching Log: A (sample)
- Individual Coaching Log: B (sample)
- Individual Home-Visiting Coaching Log (blank)
- Individual Home-Visiting Coaching Log (sample)
- Program Classroom Coaching Log (blank)
- Program Classroom Coaching Log (sample)
- Program Home-Visiting Coaching Log (blank)
- Program Home-Visiting Coaching Log (sample)
Data Decisions
- Data Decision-Making for Program-Wide Implementation
- Key Considerations for Reaching and Maintaining Implementation/Practice Fidelity
- Look-Think-Act Model
- Data Decision Making for the State Leadership Team
- Data Decision Making: Benchmarks of Quality: State Leadership Team
- Data Decision Making: Benchmarks of Quality: Program-Wide in Centers or Home-Visiting Program
- Data Decision Making: Child Outcomes STARE or Child Engagement Scale
- Data Decision Making: Coaching Log
- Data Decision Making: Reaching Potentials through Recommended Practices Observation Scale: RP2OS-C and RP2OS-HV
Sample Data Reports
- Utah RP2 SLT Annual Report
- Program Annual Data Report
- Program Coaching Contact Summary
- Sample Classroom Infographics
- Sample Home-visiting Infographics
Companion Resources
These companion resources to the Statewide Implementation Guide will help state teams understand the details of implementation stages, timelines and steps, and the components of the System Framework infrastructure needed to support and sustain statewide systems change.
- ECTA System Framework: The Personnel/Workforce component and Self-Assessment may be especially helpful. https://ectacenter.org/sysframe
- DEC Recommended Practices: practices known to improve learning outcomes and promote development of children (0-5) who have or are at risk for developmental delays or disabilities. http://www.dec-sped.org/dec-recommended-practices
- ECTA Practice Improvement Tools: Performance Checklists, Practice Guides and other tools. https://ectacenter.org/decrp
- State Systemic Improvement Plan (SSIP): statewide implementation and scale-up of evidence-based practices is a key aspect of the SSIP. https://ectacenter.org/topics/ssip
- Learning Lab: Coaching for Practice Change: provides a remote learning opportunity to explore how coaching for practice change can be supported by states and used within local programs to improve implementation of evidence-based practices. https://ectacenter.org/~calls2017/learninglab.asp
- National Implementation Research Network (NIRN): Active Implementation Hub http://implementation.fpg.unc.edu
Additional References and Resources by Stage of Implementation
Stage 1: Exploration and Planning
- Charles and Lynn Shusterman Family Philanthropy. (2023). More than numbers: A guide towards diversity, equity and inclusion in data collection. https://schusterman.widen.net/s/rrcfkzdxtn/deidatacollectionguide
- Fixsen, D.L., Naoom, S.F., Blase, K.A., Friedman, R.M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. (FMHI Publication 231). Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
- Halle, T., Metz, A. & Martinez-Beck, I. (Eds.). (2013). Applying implementation science in early childhood programs and systems. Paul H. Brookes.
- Metz, A., & Bartley, L. (2012). Active implementation frameworks for program success: How to use implementation science to improve outcomes for children. Zero to Three Journal, 34(4), 11–18.
- Metz, A., Woo, B., & Loper, A. (2021). Equitable implementation at work. Stanford Social Innovation Review, 19(3), A29–A31. https://doi.org/10.48558/R793-6704
- Smith, B.J., Fox, L., Strain, P., Binder, D.P., Bovey, T., Jones, A., McCullough, K., Veguilla, M., Dunlap, G., Blase, K., Trivette, C.M., Shapland, D., and Danaher, J. (2018). Statewide Implementation Guide. https://ectacenter.org/sig
- Wandersman Center. (n.d.). Readiness Thinking Tool. https://www.wandersmancenter.org/uploads/1/2/8/5/128593635/wc_readiness_thinking_tool.pdf
- Wandersman Center. (n.d.). Quality Implementation Self-Assessment Rating Scale. https://www.wandersmancenter.org/uploads/1/2/8/5/128593635/qisars_v2_083119.pdf
- Wandersman Center. (n.d.). Using readiness. https://www.wandersmancenter.org/using-readiness.html
Stage 2: Installation
- Early Childhood Technical Assistance Center. Early Childhood Implementation Snapshots. https://ectacenter.org/implementationsnapshots/
- Early Childhood Technical Assistance Center. Key Considerations for Reaching and Maintaining Implementation/Practice Fidelity. https://ectacenter.org/~pdfs/sig/4_4_key_considerations_for_fidelity.pdf
- Early Childhood Technical Assistance Center & National Center for Pyramid Model Innovations. (2018). Sample site application packet evidence-based practices implementation site selection. https://ectacenter.org/~pdfs/sig/4_2_sample_app.pdf
- Early Childhood Technical Assistance Center & National Center for Pyramid Model Innovations. (2018). State coordinator(s) position description. https://ectacenter.org/~pdfs/sig/2_2_state_coordinator.pdf
- Ferro, J., Fox, L., Binder, D., & von der Embse, M. (March 2022). Pyramid model equity coaching guide. National Center for Pyramid Model Innovations. https://challengingbehavior.org/implementation/equity/coaching-guide/
- IDEA Data Center (2022). Response rate, representativeness, and nonresponse bias—They all matter! https://ideadata.org/sites/default/files/media/documents/2022-02/ResponseRate-vs-Representativeness.pdf
- IDEA Data Center (n.d.) Tip Sheet Series: Evaluating the Implementation of Evidence-based Practices. https://dasycenter.org/ebp-tip-sheets/
- IDEA Data Center (2019) Tip Sheet Series: Establishing a Fidelity Threshold. https://dasycenter.org/ebp-tip-sheets/3-fidelity/
- Kinavey Wennerstrom, W., Stegenga, S., Allen, R., McIntosh, K., Smith, J.L., Ferro, J., Winneker, A., & Clayback, K. (2021). Early childhood program-wide PBS benchmarks of quality (EC-BoQ) cultural responsiveness companion. National Center for Pyramid Model Innovations. https://challengingbehavior.org/docs/ECBoQ_Cultural-Responsiveness-Companion.pdf
- National Center for Pyramid Model Innovations & Early Childhood Technical Assistance Center. (2021). State leadership team (SLT) checklist of sustainability features. https://challengingbehavior.org/docs/SLT_checklist-sustainability-features.pdf
- National Center for Pyramid Model Innovations. (2021). Roadmap to Effective Intervention Practices: Statewide Implementation of the Pyramid Model. https://challengingbehavior.org/wp-content/uploads/2022/02/roadmap_6_roadmap-to-statewide-implementation.pdf
- National Center for Pyramid Model Innovations. (2021). State Leadership Team Equity Inventory: Considerations for the Essential Structures of Statewide Implementation of the Pyramid Model. https://challengingbehavior.org/docs/State-Equity-Inventory.pdf
- National Center for Pyramid Model Innovations. (2020). Roadmap to Effective Intervention Practices: Data Decision-Making and Program-Wide Implementation of the Pyramid Model. https://challengingbehavior.org/document/roadmap-7-data-decision-making-and-program-wide-implementation-of-the-pyramid-model/
- National Center for Pyramid Model Innovations. (2022). Pyramid Model State Leadership Team: Data Coordination Responsibilities. https://challengingbehavior.org/document/pyramid-model-state-leadership-team-data-coordination-responsibilities/
- State Implementation and Scaling-Up of Evidence-based Practices Center. (2013). Activity 3.2: Engaging community and building hospitable environments. Active Implementation Hub. https://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/AIModules-Activity-3-2-EngagingCommunityBuildingHospitableEnvironments.pdf
- State Implementation and Scaling-Up of Evidence-based Practices Center. (n.d). Function 3: Create hospitable environments. Active Implementation Hub. https://implementation.fpg.unc.edu/resource/activity-creating-hospitable-environments/
- State Implementation and Scaling-Up of Evidence-based Practices Center. (n.d.). Topic 3: Leadership. Active Implementation Hub. https://implementation.fpg.unc.edu/resource/drivers-overview/
- State Implementation and Scaling-Up of Evidence-based Practices Center. (n.d). Voices from the field: Implementation Team 5 [Video}.YouTube. https://www.youtube.com/watch?v=MxG1yOiTED8
- State Implementation and Scaling-up of Evidence-based Practices Center. (n.d.). Voices from the field: Sustainability 2 [Video]. YouTube. https://www.youtube.com/watch?v=kqs-iPChGkY
Stage 3: Initial Implementation
- Early Childhood Technical Assistance Center. (2015). A system framework for building high-quality early intervention and preschool special education programs. https://ectacenter.org/sysframe
- Early Childhood Technical Assistance Center & National Center for Pyramid Model Innovation. (2018). Considerations for state annual reports. https://ectacenter.org/~pdfs/sig/2_7_considerations_for_state_annual_report.pdf
Stage 4: Full Implementation, Scale-Up, and Sustainability
- National Center for Pyramid Model Innovations. (2022). Evaluation of State and Program Implementation of the Pyramid Model: Suggested Data Elements. https://challengingbehavior.org/docs/Eval-State-Program-Implementation.pdf
- National Center for Pyramid Model Innovations (2022). Sustaining and Scaling/Expanding Pyramid Model High-Fidelity Practices: A Resource Brief. https://challengingbehavior.org/document/sustaining-and-scaling-high-fidelity-practices-resource-brief/