Classification Accuracy of Curriculum-Based Measures for Beginning Writers in First Grade

Pyung Gang Jung; Kristen L. McMaster

doi:10.1177/1534508417730823

Classification Accuracy of Curriculum-Based Measures for Beginning Writers in First Grade

Pyung Gang Jung, Kristen L. McMaster

Educational Psychology

Research output: Contribution to journal › Article › peer-review

1 Scopus citations

Abstract

We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language–Third Edition (TOWL-3; Hammill & Larsen, 1996). Prompts scored for WSC showed acceptable levels of sensitivity (.947) and specificity (.587) with the TOWL-3 Contextual Language. Positive predictive values were low (approximately.20 to.30), and negative predictive values were high (mostly above.95). Overall classification accuracy, represented by the area under curve (AUC), ranged from.727 to.831. Further research regarding ways to improve classification accuracy of CBM-W and preliminary implications for practice are discussed.

Original language	English (US)
Pages (from-to)	131-143
Number of pages	13
Journal	Assessment for Effective Intervention
Volume	43
Issue number	3
DOIs	https://doi.org/10.1177/1534508417730823
State	Published - Jun 1 2018

Bibliographical note

Funding Information:
The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported in part by Grant H324H030003 awarded to the Institute on Community Integration and the Department of Educational Psychology, College of Education and Human Development, at the University of Minnesota, by the Office of Special Education Programs in the U.S. Department of Education.

Publisher Copyright:
© 2017, © Hammill Institute on Disabilities 2017.

Keywords

ROC
beginning writers
classification accuracy
curriculum-based measures

Access

10.1177/1534508417730823

OpenUrl availability

Full text

Cite this

@article{802584bb907644f89dabaa7e2ed62507,

title = "Classification Accuracy of Curriculum-Based Measures for Beginning Writers in First Grade",

abstract = "We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language–Third Edition (TOWL-3; Hammill & Larsen, 1996). Prompts scored for WSC showed acceptable levels of sensitivity (.947) and specificity (.587) with the TOWL-3 Contextual Language. Positive predictive values were low (approximately.20 to.30), and negative predictive values were high (mostly above.95). Overall classification accuracy, represented by the area under curve (AUC), ranged from.727 to.831. Further research regarding ways to improve classification accuracy of CBM-W and preliminary implications for practice are discussed.",

keywords = "ROC, beginning writers, classification accuracy, curriculum-based measures",

author = "Jung, {Pyung Gang} and McMaster, {Kristen L.}",

note = "Funding Information: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported in part by Grant H324H030003 awarded to the Institute on Community Integration and the Department of Educational Psychology, College of Education and Human Development, at the University of Minnesota, by the Office of Special Education Programs in the U.S. Department of Education. Publisher Copyright: {\textcopyright} 2017, {\textcopyright} Hammill Institute on Disabilities 2017.",

year = "2018",

month = jun,

day = "1",

doi = "10.1177/1534508417730823",

language = "English (US)",

volume = "43",

pages = "131--143",

journal = "Assessment for Effective Intervention",

issn = "1534-5084",

publisher = "Council for Exceptional Children, Council for Educational Diagnostic Services",

number = "3",

}

TY - JOUR

T1 - Classification Accuracy of Curriculum-Based Measures for Beginning Writers in First Grade

AU - Jung, Pyung Gang

AU - McMaster, Kristen L.

N1 - Funding Information: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research was supported in part by Grant H324H030003 awarded to the Institute on Community Integration and the Department of Educational Psychology, College of Education and Human Development, at the University of Minnesota, by the Office of Special Education Programs in the U.S. Department of Education. Publisher Copyright: © 2017, © Hammill Institute on Disabilities 2017.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language–Third Edition (TOWL-3; Hammill & Larsen, 1996). Prompts scored for WSC showed acceptable levels of sensitivity (.947) and specificity (.587) with the TOWL-3 Contextual Language. Positive predictive values were low (approximately.20 to.30), and negative predictive values were high (mostly above.95). Overall classification accuracy, represented by the area under curve (AUC), ranged from.727 to.831. Further research regarding ways to improve classification accuracy of CBM-W and preliminary implications for practice are discussed.

AB - We examined the classification accuracy of Curriculum-Based Measurement in writing (CBM-W) Picture Word prompts scored for words written (WW), words spelled correctly (WSC), and correct word sequences (CWS). First graders (n = 133) were administered CBM-W prompts and the Test of Written Language–Third Edition (TOWL-3; Hammill & Larsen, 1996). Prompts scored for WSC showed acceptable levels of sensitivity (.947) and specificity (.587) with the TOWL-3 Contextual Language. Positive predictive values were low (approximately.20 to.30), and negative predictive values were high (mostly above.95). Overall classification accuracy, represented by the area under curve (AUC), ranged from.727 to.831. Further research regarding ways to improve classification accuracy of CBM-W and preliminary implications for practice are discussed.

KW - ROC

KW - beginning writers

KW - classification accuracy

KW - curriculum-based measures

UR - http://www.scopus.com/inward/record.url?scp=85046006429&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85046006429&partnerID=8YFLogxK

U2 - 10.1177/1534508417730823

DO - 10.1177/1534508417730823

M3 - Article

AN - SCOPUS:85046006429

SN - 1534-5084

VL - 43

SP - 131

EP - 143

JO - Assessment for Effective Intervention

JF - Assessment for Effective Intervention

IS - 3

ER -

Classification Accuracy of Curriculum-Based Measures for Beginning Writers in First Grade

Abstract

Bibliographical note

Keywords

Access

OpenUrl availability

Other files and links

Fingerprint

Cite this