Using Think-Alouds for Response Process Evidence of Teacher Attentiveness

Ya Mo, Michele Carney, Laurie Cavey, Tatia Totorica

Research output: Contribution to journalArticlepeer-review

3 Scopus citations

Abstract

There is a need for assessment items that assess complex constructs but can also be efficiently scored for evaluation of teacher education programs. In an effort to measure the construct of teacher attentiveness in an efficient and scalable manner, we are using exemplar responses elicited by constructed-response item prompts to develop selected-response assessment items. Through analyses of think-aloud interview data, this study examines the alignment between participant responses to, and scores arising from, the two item types. The interview protocol was administered to 12 mathematics teachers and teacher candidates who were first presented a constructed-response version of an item followed by the selected-response version of the same item stem. Our analyses focus on the alignment between responses and scores for eight item stems across the two item types and the identification of items in need of modification. The results have the potential to influence the way test developers generate and use response process evidence to support or refute the assumptions inherent in a particular score interpretation and use.

Original languageEnglish
Pages (from-to)10-26
Number of pages17
JournalApplied Measurement in Education
Volume34
Issue number1
DOIs
StatePublished - Jan 2021

EGS Disciplines

  • Curriculum and Instruction
  • Teacher Education and Professional Development

Fingerprint

Dive into the research topics of 'Using Think-Alouds for Response Process Evidence of Teacher Attentiveness'. Together they form a unique fingerprint.

Cite this