A Scale Development Study for The Evaluation of Digital Content

This study aimed to develop a rubric for evaluating digital contents specifically Web 2.0 tools in education to improve the quality of digital content, as well as to assess the rubric's validity and reliability. Data were collected from pre-service science teachers in their third year. In the development process, expert opinions were sought, and the rubric's items, criteria, and proficiency levels were created based on relevant literature. The draft rubric was used to evaluate digital contents prepared by these pre-service teachers, followed by analyzes to ensure validity and reliability. Exploratory Factor Analysis (EFA), Confirmatory Factor Analysis (CFA), Cronbach's Alpha, and Kappa analyzes were performed on the collected data. EFA revealed that the 25-item rubric explained 52.70% of the total variance, with factor loadings between .498 and .862 across three factors. CFA results showed a chi 2/sd value of 1.437 and an RMSEA value of .071. The rubric's internal consistency was measured with a Cronbach's Alpha coefficient of .785. To further assess reliability, kappa analysis indicated a moderate inter-rater agreement with a kappa value of .64. Based on these results, the EWES rubric is considered both a valid and reliable evaluation tool.