Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children

C. E. Rice; L. A. Carpenter; M. J. Morrier; C. Lord; M. DiRienzo; A. Boan; C. Skowyra; A. Fusco; J. Baio; A. Esler; W. Zahorodny; N. Hobson; A. Mars; A. Thurm; S. Bishop; L. D. Wiggins

doi:10.1007/s10803-021-05377-y

Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children

C. E. Rice, L. A. Carpenter, M. J. Morrier, C. Lord, M. DiRienzo, A. Boan, C. Skowyra, A. Fusco, J. Baio, A. Esler, W. Zahorodny, N. Hobson, A. Mars, A. Thurm, S. Bishop, L. D. Wiggins

Pediatrics - Neuropsychology

Research output: Contribution to journal › Article › peer-review

7 Scopus citations

Abstract

This paper describes a process to define a comprehensive list of exemplars for seven core Diagnostic and Statistical Manual (DSM) diagnostic criteria for autism spectrum disorder (ASD), and report on interrater reliability in applying these exemplars to determine ASD case classification. Clinicians completed an iterative process to map specific exemplars from the CDC Autism and Developmental Disabilities Monitoring (ADDM) Network criteria for ASD surveillance, DSM-5 text, and diagnostic assessments to each of the core DSM-5 ASD criteria. Clinicians applied the diagnostic exemplars to child behavioral descriptions in existing evaluation records to establish initial reliability standards and then for blinded clinician review in one site (phase 1) and for two ADDM Network surveillance years (phase 2). Interrater reliability for each of the DSM-5 diagnostic categories and overall ASD classification was high (defined as very good.60–.79 to excellent ≥.80 Kappa values) across sex, race/ethnicity, and cognitive levels for both phases. Classification of DSM-5 ASD by mapping specific exemplars from evaluation records by a diverse group of clinician raters is feasible and reliable. This framework provides confidence in the consistency of prevalence classifications of ASD and may be further applied to improve consistency of ASD diagnoses in clinical settings.

Original language	English (US)
Pages (from-to)	5308-5320
Number of pages	13
Journal	Journal of Autism and Developmental Disorders
Volume	52
Issue number	12
DOIs	https://doi.org/10.1007/s10803-021-05377-y
State	Published - Dec 2022

Bibliographical note

Funding Information:
Funding for the SC SUCCESS project was provided by Autism Speaks (Grant No. 7793 and 8408), Foundation for the National Institutes of Health (Grant No. UL1TR001450), and the Centers for Disease Control and Prevention (Grant No. DD10-1002). Funding for co-author (Thurm), Intramural Research Program of the NIMH (1ZICMH002961). The ADDM Network is supported by the Department of Health and Human Services, Centers for Disease Control and Prevention, National Center on Birth Defects and Developmental Disabilities.

Publisher Copyright:
© 2021, This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.

Keywords

Autism
Autism spectrum disorder
Classification
Clinician reliability
DSM-5
Diagnosis

PubMed: MeSH publication types

Journal Article

Access

10.1007/s10803-021-05377-y

OpenUrl availability

Full text

Cite this

Rice, C. E., Carpenter, L. A., Morrier, M. J., Lord, C., DiRienzo, M., Boan, A., Skowyra, C., Fusco, A., Baio, J., Esler, A., Zahorodny, W., Hobson, N., Mars, A., Thurm, A., Bishop, S., & Wiggins, L. D. (2022). Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children. Journal of Autism and Developmental Disorders, 52(12), 5308-5320. https://doi.org/10.1007/s10803-021-05377-y

Rice, CE, Carpenter, LA, Morrier, MJ, Lord, C, DiRienzo, M, Boan, A, Skowyra, C, Fusco, A, Baio, J, Esler, A, Zahorodny, W, Hobson, N, Mars, A, Thurm, A, Bishop, S & Wiggins, LD 2022, 'Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children', Journal of Autism and Developmental Disorders, vol. 52, no. 12, pp. 5308-5320. https://doi.org/10.1007/s10803-021-05377-y

@article{e1a04b16ab1745c2b585493d36099f4f,

title = "Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children",

abstract = "This paper describes a process to define a comprehensive list of exemplars for seven core Diagnostic and Statistical Manual (DSM) diagnostic criteria for autism spectrum disorder (ASD), and report on interrater reliability in applying these exemplars to determine ASD case classification. Clinicians completed an iterative process to map specific exemplars from the CDC Autism and Developmental Disabilities Monitoring (ADDM) Network criteria for ASD surveillance, DSM-5 text, and diagnostic assessments to each of the core DSM-5 ASD criteria. Clinicians applied the diagnostic exemplars to child behavioral descriptions in existing evaluation records to establish initial reliability standards and then for blinded clinician review in one site (phase 1) and for two ADDM Network surveillance years (phase 2). Interrater reliability for each of the DSM-5 diagnostic categories and overall ASD classification was high (defined as very good.60–.79 to excellent ≥.80 Kappa values) across sex, race/ethnicity, and cognitive levels for both phases. Classification of DSM-5 ASD by mapping specific exemplars from evaluation records by a diverse group of clinician raters is feasible and reliable. This framework provides confidence in the consistency of prevalence classifications of ASD and may be further applied to improve consistency of ASD diagnoses in clinical settings.",

keywords = "Autism, Autism spectrum disorder, Classification, Clinician reliability, DSM-5, Diagnosis",

author = "Rice, {C. E.} and Carpenter, {L. A.} and Morrier, {M. J.} and C. Lord and M. DiRienzo and A. Boan and C. Skowyra and A. Fusco and J. Baio and A. Esler and W. Zahorodny and N. Hobson and A. Mars and A. Thurm and S. Bishop and Wiggins, {L. D.}",

note = "Funding Information: Funding for the SC SUCCESS project was provided by Autism Speaks (Grant No. 7793 and 8408), Foundation for the National Institutes of Health (Grant No. UL1TR001450), and the Centers for Disease Control and Prevention (Grant No. DD10-1002). Funding for co-author (Thurm), Intramural Research Program of the NIMH (1ZICMH002961). The ADDM Network is supported by the Department of Health and Human Services, Centers for Disease Control and Prevention, National Center on Birth Defects and Developmental Disabilities. Publisher Copyright: {\textcopyright} 2021, This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.",

year = "2022",

month = dec,

doi = "10.1007/s10803-021-05377-y",

language = "English (US)",

volume = "52",

pages = "5308--5320",

journal = "Journal of Autism and Developmental Disorders",

issn = "0162-3257",

publisher = "Springer New York",

number = "12",

}

TY - JOUR

T1 - Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children

AU - Rice, C. E.

AU - Carpenter, L. A.

AU - Morrier, M. J.

AU - Lord, C.

AU - DiRienzo, M.

AU - Boan, A.

AU - Skowyra, C.

AU - Fusco, A.

AU - Baio, J.

AU - Esler, A.

AU - Zahorodny, W.

AU - Hobson, N.

AU - Mars, A.

AU - Thurm, A.

AU - Bishop, S.

AU - Wiggins, L. D.

N1 - Funding Information: Funding for the SC SUCCESS project was provided by Autism Speaks (Grant No. 7793 and 8408), Foundation for the National Institutes of Health (Grant No. UL1TR001450), and the Centers for Disease Control and Prevention (Grant No. DD10-1002). Funding for co-author (Thurm), Intramural Research Program of the NIMH (1ZICMH002961). The ADDM Network is supported by the Department of Health and Human Services, Centers for Disease Control and Prevention, National Center on Birth Defects and Developmental Disabilities. Publisher Copyright: © 2021, This is a U.S. government work and not under copyright protection in the U.S.; foreign copyright protection may apply.

PY - 2022/12

Y1 - 2022/12

N2 - This paper describes a process to define a comprehensive list of exemplars for seven core Diagnostic and Statistical Manual (DSM) diagnostic criteria for autism spectrum disorder (ASD), and report on interrater reliability in applying these exemplars to determine ASD case classification. Clinicians completed an iterative process to map specific exemplars from the CDC Autism and Developmental Disabilities Monitoring (ADDM) Network criteria for ASD surveillance, DSM-5 text, and diagnostic assessments to each of the core DSM-5 ASD criteria. Clinicians applied the diagnostic exemplars to child behavioral descriptions in existing evaluation records to establish initial reliability standards and then for blinded clinician review in one site (phase 1) and for two ADDM Network surveillance years (phase 2). Interrater reliability for each of the DSM-5 diagnostic categories and overall ASD classification was high (defined as very good.60–.79 to excellent ≥.80 Kappa values) across sex, race/ethnicity, and cognitive levels for both phases. Classification of DSM-5 ASD by mapping specific exemplars from evaluation records by a diverse group of clinician raters is feasible and reliable. This framework provides confidence in the consistency of prevalence classifications of ASD and may be further applied to improve consistency of ASD diagnoses in clinical settings.

AB - This paper describes a process to define a comprehensive list of exemplars for seven core Diagnostic and Statistical Manual (DSM) diagnostic criteria for autism spectrum disorder (ASD), and report on interrater reliability in applying these exemplars to determine ASD case classification. Clinicians completed an iterative process to map specific exemplars from the CDC Autism and Developmental Disabilities Monitoring (ADDM) Network criteria for ASD surveillance, DSM-5 text, and diagnostic assessments to each of the core DSM-5 ASD criteria. Clinicians applied the diagnostic exemplars to child behavioral descriptions in existing evaluation records to establish initial reliability standards and then for blinded clinician review in one site (phase 1) and for two ADDM Network surveillance years (phase 2). Interrater reliability for each of the DSM-5 diagnostic categories and overall ASD classification was high (defined as very good.60–.79 to excellent ≥.80 Kappa values) across sex, race/ethnicity, and cognitive levels for both phases. Classification of DSM-5 ASD by mapping specific exemplars from evaluation records by a diverse group of clinician raters is feasible and reliable. This framework provides confidence in the consistency of prevalence classifications of ASD and may be further applied to improve consistency of ASD diagnoses in clinical settings.

KW - Autism

KW - Autism spectrum disorder

KW - Classification

KW - Clinician reliability

KW - DSM-5

KW - Diagnosis

UR - http://www.scopus.com/inward/record.url?scp=85122270248&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85122270248&partnerID=8YFLogxK

U2 - 10.1007/s10803-021-05377-y

DO - 10.1007/s10803-021-05377-y

M3 - Article

C2 - 34981308

AN - SCOPUS:85122270248

SN - 0162-3257

VL - 52

SP - 5308

EP - 5320

JO - Journal of Autism and Developmental Disorders

JF - Journal of Autism and Developmental Disorders

IS - 12

ER -

Defining in Detail and Evaluating Reliability of DSM-5 Criteria for Autism Spectrum Disorder (ASD) Among Children

Abstract

Bibliographical note

Keywords

PubMed: MeSH publication types

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this