Data Quality
The following materials were developed by ECO to help states improve the quality of their outcomes data. An overview to ensuring quality data is provided in the presentation Quality Assurance: Looking for Quality Data (2013).
Pattern Checking to Ensure Data Quality
- Data Patterns for COS Ratings: What to Expect and What to Question (2019) — This document provides guidance on analyzing and displaying Child Outcome Summary (COS) data to investigate the quality of the COS ratings. For each pattern discussed, a rationale, expected pattern, unexpected pattern and guidance for interpretation are provided.
- Pattern Checking Table (2012) — This table describes strategies for using data analysis to improve the quality of state data by looking for patterns that indicate potential issues for further investigation. The pattern checking table was revised July 2012. Work is currently underway to expand the document including information about how to use the table and example visual displays of patterns. The expanded version will be posted as soon as it is available.
- Looking at Data — This presentation covers child outcomes data analysis and use and is designed for intermediate or advanced learners, particularly those who are responsible for or interested in data management, interpretation, and reporting.
COS Form Record Review
- Guidance for Reviewing Completed COS Forms (2008) — This document describes what to look for when reviewing completed COS forms for quality, including accuracy and adequate, appropriate supporting evidence.
The following forms can be used as part of a process for comparing COS ratings with assessment and other information in the child's records:
- COS Form Record Review Entry (2009)
- COS Form Record Review Exit (2009)
Some states also have developed their own forms to review COS records:
Implementation Surveys
Surveys of providers can help identify issues that influence data quality and help states plan technical assistance and training activities.
The ENHANCE Research Project consisted of four studies examining the quality of the data being collected through the Child Outcomes Summary (COS) process.
State-Developed COSF Provider Implementation Surveys
- Alaska (2008)
- Delaware (2010)
- Kansas (2007)
- Idaho (2015)
- Minnesota (2010)
- North Carolina (2010)
- Vermont (2016)