Data Quality
Child and family outcomes data must be valid in order to make decisions about system and practice improvements. Ensuring data quality is a multistep process, including:
- Training and support for staff before and during data collection.
- A good data system and data entry procedures.
- Ongoing supervision and feedback to implementers.
- Analysis of the data after data collection.
- Validity checks.
The following materials can help states improve the quality of their outcomes data. An overview to ensuring quality data is provided in the presentation Quality Assurance: Looking for Quality Data (2013).
Pattern Checking to Ensure Data Quality
- Data Patterns for COS Ratings: What to Expect and What to Question (2019) — This document provides guidance on analyzing and displaying Child Outcome Summary (COS) data to investigate the quality of the COS ratings. For each pattern discussed, a rationale, expected pattern, unexpected pattern and guidance for interpretation are provided.
- Pattern Checking Table — This document describes strategies for using data analysis to improve the quality of state data by looking for patterns that indicate potential issues.
- Looking at Data — This presentation covers child outcomes data analysis and use and is designed for intermediate or advanced learners, particularly those who are responsible for or interested in data management, interpretation, and reporting.
See also: Child Outcomes Data Use
COS Form Record Review
The Child Outcomes Summary (COS) Rating Fidelity Tool provides a systematic way to review COS forms and evidence about the child's functioning to assess the quality, timeliness, and accuracy of the COS ratings.
Reviewing child records for effective documentation is important for monitoring quality of the COS process.
Implementation Surveys
Surveys of providers can help identify issues that influence data quality and help states plan technical assistance and training activities.
The ENHANCE Research Project consisted of four studies examining the quality of the data being collected through the Child Outcomes Summary (COS) process.
State-Developed COSF Provider Implementation Surveys
- Alaska (2008)
- Delaware (2010)
- Kansas (2007)
- Idaho (2015)
- Minnesota (2010)
- North Carolina (2010)
- Vermont (2016)
