TY - JOUR
T1 - Psychometric Evaluation of a Pragmatic Measure for Assessing Adherence to System of Care Principles in Behavioral Health Service Interactions
AU - Williams, Nathaniel J.
AU - Beauchemin, James
AU - Giuntini, Guido
AU - Griffis, Jennifer
AU - Mo, Ya
N1 - Publisher Copyright:
© Hammill Institute on Disabilities 2021.
PY - 2022/9
Y1 - 2022/9
N2 - Provider adherence to system of care principles in service interactions with families is an important indicator of behavioral health service quality for youth; however, valid and pragmatic measures suitable for monitoring this quality indicator at population scale have not been developed. This article reports on two studies that developed and evaluated such a measure. In Study 1, an iterative, family-partnered process resulted in generation of 18 items that demonstrated unidimensionality and strong reliability among caregivers of youth participating in behavioral health services (N = 141). In Study 2, data from a second, statewide, stratified random sample of caregivers (N = 351) confirmed the items’ unidimensionality, discriminant validity, and criterion-related validity. Higher scores on the System of Care Adherence Scale were associated with lower risk of youth psychiatric hospitalization, greater perceived improvement in youth functioning, and greater increases in caregivers’ self-efficacy to access services. Item response theory analyses indicated the items were strongly related to adherence; however, most were optimal for differentiating between low to moderate levels of adherence. The System of Care Adherence Scale is a psychometrically sound measure suitable for population surveillance of the extent to which families experience system of care principles in their interactions with providers.
AB - Provider adherence to system of care principles in service interactions with families is an important indicator of behavioral health service quality for youth; however, valid and pragmatic measures suitable for monitoring this quality indicator at population scale have not been developed. This article reports on two studies that developed and evaluated such a measure. In Study 1, an iterative, family-partnered process resulted in generation of 18 items that demonstrated unidimensionality and strong reliability among caregivers of youth participating in behavioral health services (N = 141). In Study 2, data from a second, statewide, stratified random sample of caregivers (N = 351) confirmed the items’ unidimensionality, discriminant validity, and criterion-related validity. Higher scores on the System of Care Adherence Scale were associated with lower risk of youth psychiatric hospitalization, greater perceived improvement in youth functioning, and greater increases in caregivers’ self-efficacy to access services. Item response theory analyses indicated the items were strongly related to adherence; however, most were optimal for differentiating between low to moderate levels of adherence. The System of Care Adherence Scale is a psychometrically sound measure suitable for population surveillance of the extent to which families experience system of care principles in their interactions with providers.
KW - adherence, psychometrics
KW - families/parents involvement
KW - program/practices implementation
KW - systems of care
UR - http://www.scopus.com/inward/record.url?scp=85110195108&partnerID=8YFLogxK
UR - https://scholarworks.boisestate.edu/socialwork_facpubs/122
U2 - 10.1177/10634266211028204
DO - 10.1177/10634266211028204
M3 - Article
SN - 1063-4266
VL - 30
SP - 221
EP - 234
JO - Journal of Emotional and Behavioral Disorders
JF - Journal of Emotional and Behavioral Disorders
IS - 3
ER -