تعداد نشریات | 44 |
تعداد شمارهها | 1,473 |
تعداد مقالات | 12,039 |
تعداد مشاهده مقاله | 22,276,100 |
تعداد دریافت فایل اصل مقاله | 9,788,121 |
Detecting halo effects across rubric criteria in L2 writing assessment: A Many-facet Rasch analysis | ||
Applied Research on English Language | ||
مقالات آماده انتشار، پذیرفته شده، انتشار آنلاین از تاریخ 20 تیر 1401 | ||
نوع مقاله: Research Article | ||
شناسه دیجیتال (DOI): 10.22108/are.2022.132503.1848 | ||
نویسندگان | ||
Hakimeh Ayoobiyan* 1؛ Alireza Ahmadi2 | ||
1Shiraz university | ||
2Foreign Languages and Linguistics, Shiraz University, Shiraz | ||
چکیده | ||
This study applied multi-faceted Rasch measurement to investigate the halo effect in the performance-based assessment of writing across rubric criteria. Five raters who had received specialized training applied a four-criteria rating rubric to analytically rate writing scripts on two argumentative topics. Facets, a Rasch computer program, was utilized to pinpoint the halo effect by analyzing rater and rubric criteria interactions. After examining the appropriateness of the rubric in terms of functionality, the results showed that except for one rater, the raters did not exhibit any sign of the halo effect across rubric criteria. Generally, the severity hierarchies for raters and difficulty levels for rubric criteria suggested that raters’ training and their perceptions of the importance of criteria were associated with their manifestation of the halo effect. Pedagogically, through a detailed Facet analysis of interactions between raters and rubric criteria, rater trainers may better realize how to design effective training programs to minimize raters’ variance including the halo effect and improve the overall objectivity of human rating. | ||
کلیدواژهها | ||
Halo effect؛ Rubric criteria؛ Rater Variance؛ Many-facet Rasch measurement (MFRM) | ||
آمار تعداد مشاهده مقاله: 142 |