Examining Validity and Reliability of a Mathematics Assessment Tool for K-2 Students

Carl F. Siebert; Jonathan L. Brendefur

Examining Validity and Reliability of a Mathematics Assessment Tool for K-2 Students

Carl F. Siebert, Jonathan L. Brendefur

Boise State University

Research output: Contribution to journal › Article › peer-review

1 Downloads (Pure)

Abstract

The Primary Math Assessment (PMA) tool is increasingly being used in multiple districts in a northwestern state. The PMA provides both screening and diagnostic information in six domains to assess mathematical proficiency in young students in their early educational years. A previous study using multidimensional Rasch analyses found support for the PMA’s six-dimensional theoretical framework, and that the PMA is a reliable mathematics assessment for early grades. This study extended the examination of a Rasch model, implementing exploratory and confirmatory factor analysis, Item Response Theory, and Differential Item Functioning analyses. In doing so, this study found an IRT 2-PL model to fit best with these data and provided ways to improve the accuracy of measuring mathematical proficiency in early grades.

Original language	American English
Journal	Journal of Education and Development
State	Published - 1 Apr 2018

Keywords

Differential Item Functioning
Item Response Theory
confirmatory factor analysis
exploratory factor analysis
math proficiency assessment

EGS Disciplines

Curriculum and Instruction
Science and Mathematics Education
Teacher Education and Professional Development

Access to Document

Examining Validity and Reliability of a Mathematics Assessment ToFinal published version, 824 KBLicense: Unspecified

Cite this

@article{5fc064090d8b4c128cbce528d5f96dd1,

title = "Examining Validity and Reliability of a Mathematics Assessment Tool for K-2 Students",

abstract = " The Primary Math Assessment (PMA) tool is increasingly being used in multiple districts in a northwestern state. The PMA provides both screening and diagnostic information in six domains to assess mathematical proficiency in young students in their early educational years. A previous study using multidimensional Rasch analyses found support for the PMA{\textquoteright}s six-dimensional theoretical framework, and that the PMA is a reliable mathematics assessment for early grades. This study extended the examination of a Rasch model, implementing exploratory and confirmatory factor analysis, Item Response Theory, and Differential Item Functioning analyses. In doing so, this study found an IRT 2-PL model to fit best with these data and provided ways to improve the accuracy of measuring mathematical proficiency in early grades.",

keywords = "Differential Item Functioning, Item Response Theory, confirmatory factor analysis, exploratory factor analysis, math proficiency assessment",

author = "Siebert, {Carl F.} and Brendefur, {Jonathan L.}",

year = "2018",

month = apr,

day = "1",

language = "American English",

}

TY - JOUR

T1 - Examining Validity and Reliability of a Mathematics Assessment Tool for K-2 Students

AU - Siebert, Carl F.

AU - Brendefur, Jonathan L.

PY - 2018/4/1

Y1 - 2018/4/1

N2 - The Primary Math Assessment (PMA) tool is increasingly being used in multiple districts in a northwestern state. The PMA provides both screening and diagnostic information in six domains to assess mathematical proficiency in young students in their early educational years. A previous study using multidimensional Rasch analyses found support for the PMA’s six-dimensional theoretical framework, and that the PMA is a reliable mathematics assessment for early grades. This study extended the examination of a Rasch model, implementing exploratory and confirmatory factor analysis, Item Response Theory, and Differential Item Functioning analyses. In doing so, this study found an IRT 2-PL model to fit best with these data and provided ways to improve the accuracy of measuring mathematical proficiency in early grades.

AB - The Primary Math Assessment (PMA) tool is increasingly being used in multiple districts in a northwestern state. The PMA provides both screening and diagnostic information in six domains to assess mathematical proficiency in young students in their early educational years. A previous study using multidimensional Rasch analyses found support for the PMA’s six-dimensional theoretical framework, and that the PMA is a reliable mathematics assessment for early grades. This study extended the examination of a Rasch model, implementing exploratory and confirmatory factor analysis, Item Response Theory, and Differential Item Functioning analyses. In doing so, this study found an IRT 2-PL model to fit best with these data and provided ways to improve the accuracy of measuring mathematical proficiency in early grades.

KW - Differential Item Functioning

KW - Item Response Theory

KW - confirmatory factor analysis

KW - exploratory factor analysis

KW - math proficiency assessment

UR - https://scholarworks.boisestate.edu/cifs_facpubs/212

M3 - Article

JO - Journal of Education and Development

JF - Journal of Education and Development

ER -

Examining Validity and Reliability of a Mathematics Assessment Tool for K-2 Students

Abstract

Keywords

EGS Disciplines

Access to Document

Other files and links

Fingerprint

Cite this