Validation of Instrument to Measure Science Pre-Service Teachers Digital Skills: Confirmatory Factor Analysis
DOI:
10.29303/jpm.v20i7.10423Published:
2025-12-05Issue:
Vol. 20 No. 7 (2025): in ProgressKeywords:
Confirmatory Factor Analysis; Digital Skill; Instrument; Pre-Service Teachers; ValidationArticles
Downloads
How to Cite
Downloads
Abstract
Validating instruments that measure digital skills—such as through Confirmatory Factor Analysis (CFA)—is crucial to ensure that pre-service teachers, particularly those from Generation Z, possess accurate, reliable, and pedagogically meaningful digital competencies. Using a quantitative survey design, data were collected from 349 Generation Z pre-service teachers across four science specializations (chemistry, physics, biology, and general science). The instrument used was adapted from previous studies and translated using the back-translation method to ensure its validity. Confirmatory Factor Analysis (CFA) was employed in AMOS 24 to evaluate both first-order and second-order models to analyze the data. The six dimensions assessed—Access to and Management of Digital Content (AMDC), Use of Digital Means (UDM), Communication Skills (CS), Creative Skills (CrS), Digital Safety Skills (DSS), and Digital Empathy (DES)—demonstrated strong loadings onto the higher-order construct of Digital Skills (standardized regression weights = 0.94–0.97). Model fit indices confirmed the robustness of the structure (χ² = 865.079, RMSEA = 0.075, TLI = 0.908, CFI = 0.923). Reliability was high, with Cronbach’s alpha ranging from 0.674 to 0.966 and Composite Reliability (CR) exceeding 0.70 for most constructs. Correlation analysis revealed strong interrelationships among dimensions (r = 0.779–0.998), underscoring the integrated nature of digital skills. The findings suggest that digital skills among pre-service science teachers can be conceptualized as a unified but multidimensional construct. The validated instrument offers a reliable tool for assessing digital competencies in teacher education. Practically, the results have implications for curriculum development, underscoring the need to integrate digital literacy training into teacher preparation programs. Future research should expand validation to diverse cultural contexts and apply longitudinal approaches to capture changes in digital skill development over time.
References
K. Hava and Ö. Babayiğit, “Exploring the relationship between teachers’ competencies in AI-TPACK and digital proficiency,” Educ. Inf. Technol., vol. 30, no. 3, pp. 3491–3508, 2025, doi: 10.1007/s10639-024-12939-x.
F. Karataş and B. A. Ataç, “When TPACK meets artificial intelligence: Analyzing TPACK and AI-TPACK components through structural equation modelling,” Educ. Inf. Technol., vol. 30, no. 7, pp. 8979–9004, 2025, doi: 10.24815/jipi.v9i3.48648.
A. Ivanov et al., “Teachers’ digital competencies before, during, and after the COVID-19 pandemic,” Sustainability, vol. 17, no. 5, p. 2309, 2025, doi: 10.3390/su17052309.
C. Stevens, “Teachers and teaching: Pedagogy, digital skills and professional development,” Open Learn., vol. 40, no. 1, pp. 1–3, 2025, doi: 10.1080/02680513.2024.2436665.
S. F. Irandoost, M. Saki, M. Behzadifar, and A. Ahmadi, “Challenges of online teaching and adaptation strategies among Iranian female teachers during the COVID-19 pandemic: A qualitative study,” Soc. Sci. Humanit. Open, vol. 11, p. 101605, 2025, doi: 10.1016/j.ssaho.2025.101605.
C. Rubach and R. Lazarides, “Empowering teacher professionalization with digital competencies,” Educ. Sci., vol. 15, no. 7, p. 867, 2025, doi: 10.3390/educsci15070867.
J. Stofkova et al., “Digital skills as a significant factor of human resources development,” Sustainability, vol. 14, no. 20, p. 13117, 2022, doi: 10.3390/su142013117.
W. Adam, H. Qudratuddarsi, S. R. Tari, and E. P. Putri, “Generation Z pre-service science teacher artificial intelligence competence self-efficacy (AICS): A survey study,” Saqbe: J. Sains Pembelajaran, vol. 1, no. 2, pp. 86–96, 2024.
W. Adam et al., “Validation of pre-service science teacher artificial intelligence competence self-efficacy (AICS): Rasch model analysis,” J. Ilm. Profesi Pendidik., vol. 10, no. 2, pp. 1985–1995, 2025, doi: 10.29303/jipp.v10i2.3662.
A. Szymkowiak et al., “Information technology and Gen Z: The role of teachers, the internet, and technology in the education of young people,” Technol. Soc., vol. 65, p. 101565, 2021, doi: 10.1016/j.techsoc.2021.101565.
M. Kabatiah et al., “Enhancing digital literacy with AR media: Perception of prospective teacher students Gen Z as digital native generation,” in Proc. ICSSIS 2024, pp. 286–295, 2025, doi: 10.2991/978-2-38476-448-8_29.
S. Suyatno et al., “How do Gen Z teachers develop their intrapersonal skills? Evidence from Indonesia,” Educ. Process Int. J., vol. 14, p. e2025016, 2025, doi: 10.22521/edupij.2025.14.16.
H. Husain and H. Aziz, “Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to measure the validity and reliability constructs of historical thinking skills, TPACK, and application of historical thinking skills,” Int. J. Educ. Psychol. Counsel., vol. 7, no. 46, pp. 608–623, 2022, doi: 10.35631/IJEPC.746046.
Å. Hermansen et al., “Preliminary validity testing of the eHealth Literacy Questionnaire (eHLQ): A confirmatory factor analysis (CFA) in Norwegian hospitalized patients,” BMC Psychol., vol. 11, p. 409, 2023, doi: 10.1186/s40359-023-01449-z.
M. J. Kas et al., “A quantitative approach to neuropsychiatry: the why and the how,” Neurosci. Biobehav. Rev., vol. 97, pp. 3–9, 2019, doi: 10.1016/j.neubiorev.2017.12.008.
H. Qudratuddarsi, E. Meivawati, and R. Saputra, “Pelatihan penelitian metode kuantitatif dan systematic literature review bagi dosen dan mahasiswa,” Beru’-beru’ J. Pengabdi. Masy., vol. 3, no. 1, pp. 22–32, 2024.
J. Bloomfield and M. J. Fisher, “Quantitative research design,” J. Australas. Rehabil. Nurses Assoc., vol. 22, no. 2, pp. 27–30, 2019, doi: 10.4236/jss.2023.112010.
J. Chalmers and F. Cowdell, “What are quantitative and qualitative research methods? A brief introduction,” Dermatol. Nurs., vol. 20, no. 2, 2021, doi: 10.4236/oalib.1113434.
H. Qudratuddarsi et al., “Using item option characteristics curve (IOCC) to unfold misconception on chemical reaction,” J. Trop. Chem. Res. Educ., vol. 6, no. 2, pp. 105–118, 2024, doi: 10.14421/jtcre.2024.62-04.
C. Fan and J. Wang, “Development and validation of a questionnaire to measure digital skills of Chinese undergraduates,” Sustainability, vol. 14, no. 6, p. 3539, 2022, doi: 10.3390/su14063539.
A. Saddia, M. Yanti, and H. Qudratuddarsi, “The impact of ChatGPT-assisted problem-based learning on students’ physics achievement and their ChatGPT acceptance,” Compton: J. Ilm. Pendidik. Fis., vol. 12, no. 1, pp. 42–56, 2025, doi: 10.30738/cjipf.v12i1.19852.
J. Jumriani et al., “Validation of instrument to measure Gen-Z pre-service teacher chemistry virtual lab acceptance and use,” Chem. Educ. Pract., vol. 8, no. 1, pp. 128–136, 2025, doi: 10.29303/cep.v8i1.8701.
Z. Awang, S. Lim, and N. F. Syahira, Pendekatan Mudah SEM (Structural Equation Modelling). MPWS, 2018, doi: 10.5539/mas.v9n9p58.
B. Saeed, R. Tasmin, A. Mahmood, and A. Hafeez, “Development of a multi-item operational excellence scale: Exploratory and confirmatory factor analysis,” TQM J., vol. 34, no. 3, pp. 576–602, 2022, doi: 10.1108/TQM-10-2020-0227.
R. Rattanachaithada et al., “A confirmatory factor analysis of scientific critical thinking in secondary school,” Cogent Educ., vol. 12, no. 1, p. 2467508, 2025, doi: 10.1080/2331186X.2025.2467508.
J. A. López-Lemus, “Development of a social commerce scale: Exploratory and confirmatory factor analysis using structural equation modelling,” Int. J. Organ. Anal., vol. 32, no. 10, pp. 2683–2704, 2024, doi: 10.1186/s43093-025-00471-4.
T. Shimels, B. Gashawbeza, and T. G. Fenta, “Validation of the Amharic version of perceived access to healthcare services for patients with cervical cancer in Ethiopia: A second-order confirmatory factor analysis,” PLoS One, vol. 19, no. 5, p. e0300815, 2024, doi: 10.1371/journal.pone.0300815.
Y. Yang, Z. He, Y. Wei, and E. Tang, “Development and validation of the socially shared regulated learning questionnaire: Insights from a second-order confirmatory factor analysis,” Front. Psychol., vol. 16, p. 1635325, 2025, doi: 10.3389/fpsyg.2025.1635325.
Author Biographies
Dyah Pusptasari Ningthias, Chemistry Education Department, University of Mataram
Hilman Qudratuddarsi, Science Education Department, Universitas Sulawesi Barat
License
Copyright (c) 2025 Dyah Pusptasari Ningthias, Hilman Qudratuddarsi
This work is licensed under a Creative Commons Attribution 4.0 International License.
The following terms apply to authors who publish in this journal:
1. Authors retain copyright and grant the journal first publication rights, with the work simultaneously licensed under a Creative Commons Attribution License 4.0 International License (CC-BY License) that allows others to share the work with an acknowledgment of the work's authorship and first publication in this journal.
2. Authors may enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., posting it to an institutional repository or publishing it in a book), acknowledging its initial publication in this journal.
3. Before and during the submission process, authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website), as this can lead to productive exchanges as well as earlier and greater citation of published work (See The Effect of Open Access).
