The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory

Document Type : Original Article

Author

She holds a doctorate, specializing in measurement and evaluation Umm Al Qura University A teacher at the Ministry of Education in the Makkah Al-Mukarramah region

Abstract

             The study aimed to determine the relative of all source's variance due the tasks, Method, raters and the interactions between them, and determine the conditions numbers of facets that can be relied upon to reach Generalizability coefficients to estimate student performance, the psychometric characteristics of the tools by applying the tasks on (27) Students, estimated in a holistic and analytic methods by three raters. Results were verified, and the values of the variance components were small for the sources of variance that are due estimation method, tasks and interactions between them, which give that the performance estimates in the tasks relied upon, the values coefficients relative and absolute generalizations (0,92 - 0,89). sample of 115 students, performed three performance tasks, estimated by tow raters. using fully crossed three facets design (Persons x Tasks x Method x Rater). results showed that object of measurement ratio (60.8%), then variance due to the interaction (Students x Tasks) rate (19.8%). the relative and absolute generalizability coefficients were (0.88-0.85). The results showed that increasing the facet levels of the tasks affects the values of the generalizability coefficients, in order to reach high values, it is necessary to increase the number of tasks to three.

Keywords


Volume 116, Issue 116 - Serial Number 116
مناهج وطرق التدریس ( اللغة العربیة- الإنجلیزیة – الفرنسیة – الریاضیات – العلوم- الفنون- الاقتصاد المنزلی- التجاری ... )
2023
Pages 257-285
  • Receive Date: 18 August 2023
  • Revise Date: 10 September 2023
  • Accept Date: 17 September 2023