The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory
She holds a doctorate, specializing in measurement and evaluation Umm Al Qura University A teacher at the Ministry of Education in the Makkah Al-Mukarramah region
The study aimed to determine the relative of all source's variance due the tasks, Method, raters and the interactions between them, and determine the conditions numbers of facets that can be relied upon to reach Generalizability coefficients to estimate student performance, the psychometric characteristics of the tools by applying the tasks on (27) Students, estimated in a holistic and analytic methods by three raters. Results were verified, and the values of the variance components were small for the sources of variance that are due estimation method, tasks and interactions between them, which give that the performance estimates in the tasks relied upon, the values coefficients relative and absolute generalizations (0,92 - 0,89). sample of 115 students, performed three performance tasks, estimated by tow raters. using fully crossed three facets design (Persons x Tasks x Method x Rater). results showed that object of measurement ratio (60.8%), then variance due to the interaction (Students x Tasks) rate (19.8%). the relative and absolute generalizability coefficients were (0.88-0.85). The results showed that increasing the facet levels of the tasks affects the values of the generalizability coefficients, in order to reach high values, it is necessary to increase the number of tasks to three.
Al-Hajjaji, A. A. M. (2023). The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory. المجلة التربوية لکلية التربية بسوهاج, 116(116), 257-285. doi: 10.21608/edusohag.2023.331643
MLA
Aisha Ahmed Muhammad Al-Hajjaji. "The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory". المجلة التربوية لکلية التربية بسوهاج, 116, 116, 2023, 257-285. doi: 10.21608/edusohag.2023.331643
HARVARD
Al-Hajjaji, A. A. M. (2023). 'The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory', المجلة التربوية لکلية التربية بسوهاج, 116(116), pp. 257-285. doi: 10.21608/edusohag.2023.331643
VANCOUVER
Al-Hajjaji, A. A. M. The Effect of The Number of Performance Tasks and Method assessment and Raters on The Reliability of Rating Scales to Evaluate Performance in Science Course Using Generalizability Theory. المجلة التربوية لکلية التربية بسوهاج, 2023; 116(116): 257-285. doi: 10.21608/edusohag.2023.331643