Development of a Critical Thinking Skills Test Instrument Based on Rasch Modelling for Temperature and Heat
DOI:
10.29303/jpm.v21i4.12069Published:
2026-07-09Downloads
Abstract
Critical thinking skills are essential competencies in 21st-century physics learning. However, the availability of assessment instruments that accurately measure these skills remains limited, particularly for physics topics such as temperature and heat. Previous studies have rarely integrated Rasch modelling into the development of critical-thinking assessment instruments, particularly at the secondary school level. Therefore, this study aimed to develop and analyze the validity, reliability, and item fit of a critical thinking skills test instrument on temperature and heat topics using the Rasch model. This study employed a Research and Development (R&D) approach using the ADDIE model, comprising Analysis, Design, Development, Implementation, and Evaluation stages. The instrument consisted of 20 multiple-choice items constructed from critical-thinking indicators. Content validity was analyzed using Aiken’s V, while empirical analysis was conducted using the Rasch model through Ministeps Software. The analysis included item reliability, person reliability, item fit, difficulty level, and unidimensionality. The results showed that the instrument achieved an average Aiken’s V value of 0.8068, indicating that the instrument met the content validity criteria. Rasch analysis revealed that the item reliability was 0.86, while the person reliability was 0.35. In addition, 19 items were categorized as fit, whereas one item was identified as a misfit and required revision. The instrument also met the unidimensionality requirement with a raw variance explained value of 22.7%. In conclusion, the developed instrument meets the criteria for validity, reliability, and item fit and is suitable for measuring students’ critical thinking skills on topics related to temperature and heat. The findings indicate that Rasch modelling can support the development of more objective and comprehensive assessment instruments for physics learning and classroom assessment practices.
Keywords:
Assessment Critical Thinking Skills Rasch Model Temperature and Heat Test InstrumentReferences
[1] D. T. Tiruneh, M. De Cock, and J. Elen, “Designing Learning Environments for Critical Thinking: Examining Effective Instructional Approaches,” Int. J. Sci. Math. Educ., vol. 16, no. 6, pp. 1065–1089, 2018, doi: 10.1007/s10763-017-9829-z.
[2] R. H. Ennis, “The Nature of Critical Thinking: An Outline of Critical Thinking Dispositions and Abilities i,” May 2011.
[3] K. J. Arni, “Systematic Review of Research Trends on Critical Thinking Skills in Physics Learning,” International Journal of Science Education and Science, vol. 2, no. 1, pp. 43–52, Mar. 2025, doi: 10.56566/ijses.v2i1.262.
[4] G. Lecornu, “Critical Thinking across the Curriculum: A Guide for Teachers.,” 2020.
[5] I. Kadek Suarjana, “How Critical Thinking Skills Can Speed Up Solving Physics Problems for Senior High School. SEARCH: Science Education Research,” Oct. 2023. doi: https://doi.org/10.47945/search.v2i1.1313.
[6] S. L. E. W. Fajari and Chumdari, “Critical Thinking Skills And Their Impacts On Elementary School Students,” Malaysian Journal of Learning and Instruction, vol. 18, no. 2, pp. 161–187, Jul. 2021, doi: 10.32890/mjli2021.18.2.6.
[7] K. Arafah, B. D. Amin, S. S. Sari, and A. Hakim, “The Development of Higher Order-Thinking Skills (HOTS) Instrument Assessment in Physics Study,” in Journal of Physics: Conference Series, IOP Publishing Ltd, May 2021. doi: 10.1088/1742-6596/1899/1/012140.
[8] D. Rahmawati and B. Santoso, “Evaluasi Penggunaan Game Sebagai Media Pembelajaran Fisika: Dampak Terhadap Pemahaman Konsep Siswa SMA,” Jurnal Penelitian Pendidikan, vol. 24, no. 1, pp. 59–68, 2020.
[9] J. Radianti, T. A. Majchrzak, J. Fromm, and I. Wohlgenannt, “A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda,” Comput. Educ., vol. 147, Apr. 2020, doi: 10.1016/j.compedu.2019.103778.
[10] D. A. Kurniawan, A. Astalini, and D. K. Sari, “An evaluation analysis of students’ attitude towards physics learning at senior high school,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 23, no. 1, pp. 26–35, Jun. 2019, doi: 10.21831/pep.v23i1.20821.
[11] D. A. Kusumaningtyas, M. Manyunu, E. Kurniasari, A. N. Awalin, R. Rahmaniati, and A. Febriyanti, “Enhancing Learning Outcomes: A Study on the Development of Higher Order Thinking Skills based Evaluation Instruments for Work and Energy in High School Physics,” Indonesian Journal on Learning and Advanced Education (IJOLAE), pp. 14–31, Jan. 2024, doi: 10.23917/ijolae.v6i1.23125.
[12] S. M. Brookhart, “How to Assess Higher-Order Thinking Skills in Your Classroom,” 2010. [Online]. Available: www.ascd.org/memberbooks
[13] H. A. Rahman, B. S. Bachri, and I. Y. Maureen, “Instrumen Tes untuk Mengukur Keterampilan Berpikir Kritis pada Materi Statistika,” Jurnal Cendekia : Jurnal Pendidikan Matematika, vol. 8, no. 2, pp. 1472–1480, Jul. 2024, doi: 10.31004/cendekia.v8i2.3343.
[14] A. Khasanah, “pengembangan instrumen penilaian otentik pembelajaran fisika untuk mengukur keterampilan proses sains dan berpikir kritis”, [Online]. Available: https://journal.student.uny.ac.id/ojs/index.php/pfisika/index
[15] Y. B. Bhakti, R. Arthur, and Y. Supriyati, “Development of an assessment instrument for critical thinking skills in Physics: A systematic literature review,” in Journal of Physics: Conference Series, Institute of Physics, 2023. doi: 10.1088/1742-6596/2596/1/012067.
[16] H. Retnawati, Analisis Kuantitatif Instrumen Penelitian, Pertama. Yogyakarta, 2016. [Online]. Available: www.nuhamedika.gu.ma
[17] T. G. . Bond and C. M. . Fox, Applying the Rasch model : fundamental measurement in the human sciences. Routledge, Taylor and Francis Group, 2015.
[18] C. O. Solomon and O. O. Romy, “application of classical test theory as linear modeling to test item development and analysis,” International Research Journal of Modernization in Engineering Technology and Science, no. 10, Oct. 2023, doi: 10.56726/irjmets45379.
[19] B. Trevor G and F. Christine M, “Applying the Rasch Model: Fundamental Measurement in the Human Sciences Second Edition,” 2007.
[20] B. Sumintono and W. Widhiarso, “Aplikasi Model Rasch Untuk Penelitian Ilmu-Ilmu Sosial,” 2014.
[21] D. Hope et al., “Exploring the use of Rasch modelling in ‘common content’ items for multi-site and multi-year assessment,” Advances in Health Sciences Education, vol. 30, no. 2, pp. 427–438, Apr. 2025, doi: 10.1007/s10459-024-10354-y.
[22] M. Polat, N. S. Turhan, and Ç. Toraman, “Comparison of Classical Test Theory vs. Multi-Facet Rasch Theory,” Pegem Egitim ve Ogretim Dergisi, vol. 12, no. 2, pp. 213–225, 2022, doi: 10.47750/pegegog.12.02.21.
[23] A. Alyamuari, W. Liliawati, and D. Saepuzaman, “item analysis of the critical thinking test instrument on temperature and heat using rasch modelling,” Jurnal Eduscience (JES), Aug. 2024, doi: https://doi.org/10.36987/jes.v11i2.5676.
[24] E. Avinç and F. Doğan, “Digital literacy scale: Validity and reliability study with the rasch model,” Educ. Inf. Technol. (Dordr)., vol. 29, no. 17, pp. 22895–22941, Dec. 2024, doi: 10.1007/s10639-024-12662-7.
[25] Khaeruddin and B. D. Amin, “Development and Validation of Critical Thinking Skills Instruments of Physics Subjects,” in Proceedings of the 7th Mathematics, Science, and Computer Science Education International Seminar, MSCEIS 2019, European Alliance for Innovation, 2020. doi: 10.4108/eai.12-10-2019.2296474.
[26] B. Sartono, W. Sunarno, B. A. Prayitno, and N. Y. Indriyanti, “Development and Validation of A Critical Thinking Assessment on Temperature and Heat for Secondary Physics Education,” Educational Process: International Journal, vol. 16, 2025, doi: 10.22521/edupij.2025.16.264.
[27] E. Yusliani, “Jurnal Penelitian dan Pengembangan Pendidikan Fisika,” JPPPF, vol. 8, no. 1, 2022, doi: 10.21009/1.
[28] S. Aryani, H. Novia, and A. Setiawan, “Development and Analysis Validation Instrument Critical Thinking Heat Concept (CTHT) Using Rash Model,” Jurnal Penelitian Pendidikan IPA, vol. 10, no. 7, pp. 3731–3738, Jul. 2024, doi: 10.29303/jppipa.v10i7.7727.
[29] F. D. P. Nesri and Y. D. Kristanto, “Pengembangan Modul Ajar Berbantuan Teknologi untuk Mengembangkan Kecakapan Abad 21 Siswa,” AKSIOMA: Jurnal Program Studi Pendidikan Matematika, vol. 9, no. 3, p. 480, Sep. 2020, doi: 10.24127/ajpm.v9i3.2925.
[30] Saheri, K. I. Supardi, and S. Haryani, “Pengembangan Instrumen Penilaian Keterampilan Berpikir Kritis Siswa SMA Melalui Model Pembelajaran Berbasis Masalah Materi Larutan Penyangga,” Aug. 2017.
[31] I. G. E. Saputra, I. N. Jampel, and I. G. L. A. Parwata, “Pengembangan Instrumen Penilaian Kemampuan Berpikir Kritis Peserta Didik Kelas VIII SMP pada Materi Getaran dan Gelombang,” Jurnal Pendidikan dan Pembelajaran Sains Indonesia, vol. 5, Oct. 2022.
[32] M. Ulfah and N. Imam Bonjol Padang, “instrumen pengujian produk pembelajaran (pengujian validitas, praktikalitas, efektivitas),” 2025.
[33] M. Safihin, H. S. Tiur Maria, and Hamdani, “pengembangan tes menggunakan model rasch materi gaya untuk SMA,” 2019.
[34] F. Nyimbili and L. Nyimbili, “Types of Purposive Sampling Techniques with Their Examples and Application in Qualitative Research Studies,” British Journal of Multidisciplinary and Advanced Studies, vol. 5, no. 1, pp. 90–99, Feb. 2024, doi: 10.37745/bjmas.2022.0419.
[35] R. H. Ennis, “Critical thinking: Its nature, measurement, and improvement.,” 1985.
[36] S. Yustina Purnama and S. Sri Wulandari, “Pengembangan Modul Administrasi Perkantoran pada Mata Pelajaran Administrasi Humas dan Keprotokolan Kelas XI APK di SMK Muhammadiyah 1 Lamongan,” 2021. [Online]. Available: https://journal.unesa.ac.id/index.php/jpap
[37] Y. B. Bhakti, R. Arthur, and Y. Supriyati, “The Content Validity: Multiple Choices Complex Physics Instrument to Measure Critical Thinking Skills,” JIPF (Jurnal Ilmu Pendidikan Fisika), vol. 9, no. 1, p. 56, Feb. 2024, doi: 10.26737/jipf.v9i1.4765.
[38] R. P. Z, R. Sari, J. Jumadi, and A. Ariswan, “Pengembangan dan Validasi Instrumen Tes untuk Mengukur Keterampilan Menyelesaikan Masalah Peserta Didik SMA pada Pelajaran Fisika,” Jurnal Penelitian Pembelajaran Fisika, vol. 11, no. 1, pp. 17–26, Mar. 2020, doi: 10.26877/jp2f.v11i1.3993.
[39] L. Missa, R. N. K. Mellu, and D. Langtang, “Pengembangan Alat Evaluasi Fisika Untuk Mengidentifikasi Miskonsepsi Siswa Kelas VIII SMP Negeri Oenino,” Jurnal Fisika Indonesia, vol. 24, no. 3, p. 164, Dec. 2020, doi: 10.22146/jfi.v24i3.57639.
[40] N. Mappalesye, S. S. Sari, and K. Arafah, “pengembangan instrumen tes kemampuan berpikir kritis dalam pembelajaran fisika,” Jurnal Sains dan Pendidikan Fisika (JSPF) Jilid, vol. 17, no. 1, pp. 69–82, Apr. 2021.
[41] M. subair, S. Salmah Sari, and Jasruddin, “pengembangan instrumen tes hasil belajar fisika kelas xi sma. Negeri 1 pangkajene development of instrument physics learning results in class xi science senior high school 1 in Pangkajene 1),” Jurnal Sains dan Pendidikan Fisika, vol. 15, no. 1, pp. 8–12, Apr. 2019, [Online]. Available: http://ojs.unm.ac.id
[42] D. Wahyuni, “Pengembangan Instrumen Tes Berpikir Kritis Mahasiswa Universitas Dharmawangsa,” 2024.
[43] J. Jamaluddin, A. W. Jufri, M. Muhlis, and I. Bachtiar, “Pengembangan Instrumen Keterampilan Berpikir Kritis Pada Pembelajaran IPA di SMP,” Jurnal Pijar Mipa, vol. 15, no. 1, pp. 13–19, Jan. 2020, doi: 10.29303/jpm.v15i1.1296.
[44] Y. H. Putri Hapsari and D. Gularso, “Pengembangan Kepraktisan Instrumen Penilaian Berbasis Keterampilan Berpikir Kritis Siswa Kelas IV SD Negeri Wirosaban,” Jurnal Cendekia : Jurnal Pendidikan Matematika, vol. 8, no. 2, pp. 1351–1357, Jul. 2024, doi: 10.31004/cendekia.v8i2.3309.
[45] N. Siti Ratna Gumilang, Wahidin, and A. Tsurayya, “Pengembangan Instrumen Kemampuan Berpikir Kritis dan Kreatif Matematika Peserta Didik Kelas VII SMP Development of Mathematics’ Critical and Creative Thinking Instruments for Grade VII on Secondary School,” Jurnal Pendidikan Matematika dan Sains, vol. 9, no. 2, pp. 89–98, 2021, doi: 10.21831/jpms.v9i1.27349.
[46] Bahraeni Tajri Zahrah Via Faradisa, Septi Kurniasih, and Liska Berlian, “Pengembangan Instrumen Tes 4TMC CBT Pada Materi Sistem Pernapasan untuk Mengukur Berpikir Kritis Siswa SMP Kelas VIII,” JURNAL PENDIDIKAN MIPA, vol. 14, no. 4, pp. 909–918, Dec. 2024, doi: 10.37630/jpm.v14i4.2010.
[47] N. N. Simamora, E. Istiyono, and I. Wilujeng, “Development of an Assessment Instrument to Measure High School Students’ Collaboration Skills in Physics Learning,” JPPPF (Jurnal Penelitian dan Pengembangan Pendidikan Fisika), vol. 10, no. 1, Jun. 2024, doi: doi.org/10.21009/1.10104.
[48] K. Khotimah and Q. Fariyani, “Development of a Physics Assessment Instrument to Measure High School Students Multirepresentation Skills in Momentum and Impulse,” Impulse: Journal of Research and Innovation in Physics Education, vol. 5, no. 1, pp. 49–61, Oct. 2025, doi: 10.14421/impulse.2025.51-04.
[49] P. W. Pradana, F. Febriani, M. Ibnusaputra, and J. Jumadi, “Development of Physics Test Instrument to Measure Verbal Representation of High School Student on Optical Instrument Topic,” Jurnal Penelitian Pendidikan IPA, vol. 9, no. 10, pp. 7963–7968, Oct. 2023, doi: 10.29303/jppipa.v9i10.3775.
[50] R. Sheptian, R. Arthur, and R. Wardhani, “psychometric analysis of mathematics readiness assessment tool for elementary school students: a rasch model approach,” Jurnal Inovasi Penelitian Pendidikan dan Pembelajaran, vol. 4, no. 4, Nov. 2024, [Online]. Available: https://jurnalp4i.com/index.php/learning
[51] S. Nuryanti, M. Masykuri, and E. Susilowati, “Analisis Iteman dan model Rasch pada pengembangan instrumen kemampuan berpikir kritis peserta didik sekolah menengah kejuruan,” Jurnal Inovasi Pendidikan IPA, vol. 4, no. 2, pp. 224–233, Oct. 2018, doi: 10.21831/jipi.v4i2.21442.
[52] S. D. S. Pradana, P. Parno, and S. K. Handayanto, “Pengembangan tes kemampuan berpikir kritis pada materi Optik Geometri untuk mahasiswa Fisika,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 21, no. 1, pp. 51–64, Jun. 2017, doi: 10.21831/pep.v21i1.13139.
[53] R. H. Ennis, A Logical Basis for Measuring Critical Thinking Skills. 1985.
[54] E. Almanasreh, R. Moles, and T. F. Chen, “Evaluation of methods used for estimating content validity,” Research in Social and Administrative Pharmacy, vol. 15, no. 2, pp. 214–221, Feb. 2019, doi: 10.1016/J.SAPHARM.2018.03.066.
[55] A. H. Aminudin, D. Rusdiana, A. Samsudin, L. Hasanah, and J. Maknun, “Measuring critical thinking skills of 11th grade students on temperature and heat,” in Journal of Physics: Conference Series, Institute of Physics Publishing, Nov. 2019. doi: 10.1088/1742-6596/1280/5/052062.
[56] E. Avinç and F. Doğan, “Digital literacy scale: Validity and reliability study with the rasch model,” Educ. Inf. Technol. (Dordr)., vol. 29, no. 17, pp. 22895–22941, Dec. 2024, doi: 10.1007/s10639-024-12662-7.
License
Copyright (c) 2026 Elmerita Dwi Agustin, Hera Novia, Raden Giovanni Ariantara
This work is licensed under a Creative Commons Attribution 4.0 International License.
The following terms apply to authors who publish in this journal:
1. Authors retain copyright and grant the journal first publication rights, with the work simultaneously licensed under a Creative Commons Attribution License 4.0 International License (CC-BY License) that allows others to share the work with an acknowledgment of the work's authorship and first publication in this journal.
2. Authors may enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., posting it to an institutional repository or publishing it in a book), acknowledging its initial publication in this journal.
3. Before and during the submission process, authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website), as this can lead to productive exchanges as well as earlier and greater citation of published work (See The Effect of Open Access).
Downloads
How to Cite
