An examination of inter-rater reliability for high stakes testing

Authors

Alan K. Mirly, Idaho State University
Melanie M. Domenech-Rodriguez, Utah State UniversityFollow

Document Type

Presentation

Journal/Book Title/Conference

Western Consortium Conference

Location

Hillsboro, OR

Publication Date

6-1-2016

Abstract

This poster examines inter-rater reliability during mock patient examinations. This high stakes, semi-subjective examination is performed across 3 campuses with up to 14 examiners per examination. There were notable differences in inter-rater reliabilities that might impact student outcomes as a result of the raters. Variability in raters over time does provide some protection for this bias.

Recommended Citation

Mirly, A. K., & Domenech Rodríguez, M. (2016, June). An examination of inter-rater reliability for high stakes testing. Poster presented at the annual Western Consortium Conference, Hillsboro, OR.