Utilizing Generalizability Theory in Estimating the Reliability of the Test-Wiseness Scale among High School Students in the Context
of a Two-Facet Crossed Design
This research aimed to identify the most influential sources of variance affecting the reliability of the test-wiseness scale scores, examine the impact of each variance source on the scale's reliability, and determine the effect of sample size on the values of both relative and absolute generalizability coefficients of the scale. The study involved 300 participants, both male and female high school students, aged between 14 and 20 years, with a mean age of 16.822 years and a standard deviation of 1.234 years. The research instrument used was the test-wiseness scale, developed by the authors. Statistical methods, specifically generalizability and decision studies, were employed to extract the relative and absolute generalizability coefficients using the EduG software version 6.1-e, based on a two-facet crossed design (Persons × Dimensions × Occasions). The results indicated that the test-wiseness scale demonstrated good relative and absolute generalizability coefficients of 0.90 and 0.81, respectively. The largest component of error variance in relative measurement was attributed to the interaction of (Persons × Occasions), which accounted for 52.1% of the total variance, while in absolute measurement, the largest error variance component was due to the number of dimensions, accounting for 50.3% of the total variance. It was found that increasing the number of dimensions had a negligible effect on the values of both relative and absolute generalizability coefficients. Conversely, increasing the number of occasions significantly affected the values of these coefficients. Additionally, the values of both relative and absolute generalizability coefficients significantly increased with the sample size. The results were discussed and interpreted within the framework of the theoretical background and previous studies, and several recommendations and proposed research ideas were provided.
Gadallah, A. S., & ali, R. E. S. F. (2024). Utilizing Generalizability Theory in Estimating the Reliability of the Test-Wiseness Scale among High School Students in the Context
of a Two-Facet Crossed Design . المجلة التربوية لکلية التربية بسوهاج, 123(123), 973-1060. doi: 10.21608/edusohag.2024.294354.1484
MLA
Ashraf saad Gadallah; Ramadan El Sayed Frahat ali. "Utilizing Generalizability Theory in Estimating the Reliability of the Test-Wiseness Scale among High School Students in the Context
of a Two-Facet Crossed Design ". المجلة التربوية لکلية التربية بسوهاج, 123, 123, 2024, 973-1060. doi: 10.21608/edusohag.2024.294354.1484
HARVARD
Gadallah, A. S., ali, R. E. S. F. (2024). 'Utilizing Generalizability Theory in Estimating the Reliability of the Test-Wiseness Scale among High School Students in the Context
of a Two-Facet Crossed Design ', المجلة التربوية لکلية التربية بسوهاج, 123(123), pp. 973-1060. doi: 10.21608/edusohag.2024.294354.1484
VANCOUVER
Gadallah, A. S., ali, R. E. S. F. Utilizing Generalizability Theory in Estimating the Reliability of the Test-Wiseness Scale among High School Students in the Context
of a Two-Facet Crossed Design . المجلة التربوية لکلية التربية بسوهاج, 2024; 123(123): 973-1060. doi: 10.21608/edusohag.2024.294354.1484
)
مشاهدة على SCiNiTO