An examination of inter-rater reliability for high stakes testing
Western Consortium Conference
This poster examines inter-rater reliability during mock patient examinations. This high stakes, semi-subjective examination is performed across 3 campuses with up to 14 examiners per examination. There were notable differences in inter-rater reliabilities that might impact student outcomes as a result of the raters. Variability in raters over time does provide some protection for this bias.
Mirly, A. K., & Domenech Rodríguez, M. (2016, June). An examination of inter-rater reliability for high stakes testing. Poster presented at the annual Western Consortium Conference, Hillsboro, OR.