Development of a test instrument using multiple representations to assess students understanding: A Rasch Model Analysis
DOI:
10.29303/jpm.v18i2.4721Published:
2023-03-30Issue:
Vol. 18 No. 2 (2023): March 2023Keywords:
Instrument Test, Multiple Representation, Rates of Reaction, Rasch ModelArticles
Downloads
How to Cite
Downloads
Metrics
Abstract
Today's test instruments used in schools are still ineffective in assessing students' multi-representational understanding of the "rate of reaction" topic. Hence, teachers need to accurately and comprehensively know the depth of students' understanding. In this study, a test instrument was produced to assess the level of macroscopic, submicroscopic, and symbolic understanding of high school students in the rates of reaction topic. The method used is Research and Development (R&D) based on the Rasch modeling approach, which is modified in ten stages, i.e., (1) defining construct, (2) identifying question indicators, (3) compiling items, scoring rubrics, scoring guidelines, and the guidelines to analyze student's level of understanding, (4) conducting the pilot test, (5) analyzing data with the Rasch model, (6) reviewing the suitability of items, (7) reviewing the Wright map, (8) repeating steps 4-7 until all items fit, (9) claiming the instrument's quality, and (10) documenting the instrument. All items proved valid because they met the fit criteria of MNSQ, ZSTD, and PT Measure scores. Instrument reliability reaches the score of 0.89 (good). The instrument has a four-difficulty index, dominated by moderate difficulty (70.6%). This instrument is relatively easy. The instrument also has four discrimination indexes: very difficult, difficult, medium, and easy. It proves that this assessment instrument is of good quality and suitable for school use.
References
Fahriyah, A. R., & Wiyarsi, A. (2017). Multiple Representations Skill of High School Students on Reaction Rate Material. The 2nd International Seminar on Chemical Education 2017, February 2018, 192–210.
Sukmawati, W. (2019). Analisis level makroskopis , mikroskopis dan simbolik mahasiswa dalam memahami elektrokimia Analysis of macroscopic , microscopic and symbolic levels of students in understanding electrochemistry. Jurnal Inovasi Pendidikan IPA, 5(2), 195–204.
Fahmi, T. N., & Fikroh, R. A. (2022). Pengembangan Modul Bermuatan Multirepresentasi pada Materi Hidrokarbon untuk SMA/MA. Jurnal Inovasi Pendidikan Kimia, 16(1), 53–58.
Ni Made Ary Suparwati. (2022). Analisis Reduksi Miskonsepsi Kimia dengan Pendekatan Multi Level Representasi: Systematic Literature Review. Jurnal Pendidikan Mipa, 12(2), 341–348.
Jespersen, N. D., Hyslop, A., & Brady, J. E. (2015). Chemistry: The Molecular Nature of Matter. John Wiley & Sons, Inc.
Rahman, A. A., & Narsyah, C. E. (2019). Evaluasi Pembelajaran. Uwais Inspirasi Indonesia.
Simamora, H., Hartono, H., & Effendi, E. (2021). Analisis Kualitas Butir Soal Buatan Guru Kimia Pada Tes Ujian Tengah Semester Ganjil Kelas XII MIPA. Hydrogen: Jurnal Kependidikan Kimia, 9(1), 8.
Rahayu, W., Putra, M. D. K., Rahmawati, Y., Hayat, B., & Koul, R. B. (2021). Validating an indonesian version of the what is happening in this class? (wihic) questionnaire using a multidimensional rasch model. International Journal of Instruction, 14(2), 919–934.
Nur, L., Nurani, L. A., Suryana, D., & Ahmad, A. (2020). Rasch model application on character development instrument for elementary school students. International Journal of Learning, Teaching and Educational Research, 19(3), 437–459.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata Publishing Home.
Giguère, G., Brouillette-Alarie, S., & Bourassa, C. (2023). A Look at the Difficulty and Predictive Validity of LS/CMI Items With Rasch Modeling. Criminal Justice and Behavior, 50(1), 118–138.
Tesio, L., Caronni, A., Kumbhare, D., & Scarano, S. (2022). Interpreting results from Rasch analysis 1. The “most likely” measures coming from the model. Disability and Rehabilitation, Submitted(0), 1–13.
Wei, S., Liu, X., Wang, Z., & Wang, X. (2012). Using rasch measurement to develop a computer modeling-based instrument to assess students’ conceptual understanding of matter. Journal of Chemical Education, 89(3), 335–345.
Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch Analysis in the Human Sciences. In Rasch Analysis in the Human Sciences.
Indaryati, M Yusup, Nuraeni, Z., Novita Sari, & Meryansumayeka. (2022). Pelatihan dan Pendampingan Penyusunan IPK. Jurnal Anugerah, 3(2), 77–85.
Sunyono. (2015). Model Multi Representasi. Media Akademi.
Pikoli, M., Sukertini, K., & Isa, I. (2022). Analisis Model Mental Siswa dalam Mentransformasikan Konsep Laju Reaksi Melalui Multipel Representasi. Jambura Journal of Educational Chemistry, 4(1), 8–12. https://doi.org/10.34312/jjec.v4i1.13515
Jeklin, A. (2016). Tes Uraian (Essay) Pada Evaluasi Hasil Pembelajaran Matematika. July, 1–23.
Jayanti, E. (2020). Instrumen Tes Higher Order Thinking Skill Pada Materi Kimia Sma. Orbital: Jurnal Pendidikan Kimia, 4(2), 135–149.
Sujak, K. B., Gnanamalar, E., & Daniel, S. (2018). Understanding of Macroscopic, Microscopic and Symbolic Representations Among Form Four Students in Solving Stoichiometric Problems. MOJES: Malaysian Online Journal of Educational Sciences, 5(3), 83–96.
Wang, Z., Chi, S., Luo, M., Yang, Y., & Huang, M. (2017). Development of an instrument to evaluate high school students’ chemical symbol representation abilities. Chemistry Education Research and Practice, 18(4), 875–892.
Ihsan, H. (2016). Validitas Isi Alat Ukur Penelitian Konsep Dan Panduan Penilaiannya. PEDAGOGIA Jurnal Ilmu Pendidikan, 13(2), 266.
Puger, I. G. N. (2021). Pengujian Validitas Isi Tes Hasil Belajar Yang Dinilai Oleh Subject Matter Expert (Sme). Daiwi Widya, 8(3), 1–15. https://doi.org/10.37637/dw.v8i3.819
Oliva, J. M., & Blanco, Á. (2022). Rasch analysis and validity of the construct understanding of the nature of models in Spanish-speaking students. European Journal of Science and Mathematics Education, 11(2), 344–359.
Desnita, D., Yusmaita, E., Iswendi, I., & Iryani, I. (2021). Studi Tingkat Preferensi Panelis Terhadap Karakteristik Sensori Selai Kolang Kaling (Arenga Pinnata Fruits). LOGISTA - Jurnal Ilmiah Pengabdian Kepada Masyarakat, 5(2), 75.
Rizki, M., & Yusmaita, E. (2021). Pengembangan Butir Soal Literasi Kimia pada Materi Ikatan Kimia Menggunakan Model Rasch. 3(2).
Palimbong, J., Mujasam, M., & Allo, A. Y. T. (2019). Item Analysis Using Rasch Model in Semester Final Exam Evaluation Study Subject in Physics Class X TKJ SMK Negeri 2 Manokwari. Kasuari: Physics Education Journal (KPEJ), 1(1), 43–51.
Van der Linden, W. J. (2011). Applying the Rasch Model. International Journal of Testing, 1(3–4), 319–326.
Bond, T. G., & Fox, C. M. (2015). Applying the Rasch Model: Fundamental Measurements in the Human Sciences. Routledge.
Azizah, N., Suseno, M., & Hayat, B. (2022). Item analysis of the rasch model items in the final semester exam indonesian language lesson. World Journal of English Language, 12(1), 15–26.
Romdlon, N., Adi, M., Amaruddin, H., Maulana, H., Adi, M., & A, L. Q. (2022). Validity and Reliability Analysis Using the Rasch Model to Measure the Quality of Mathematics Test Items of Vocational High Schools. 11(117).
Ilfiandra, Nadhirah, N. A., Suryana, D., & binti Ahmad, A. (2022). Development and Validation Peaceful Classroom Scale: Rasch Model Analysis. International Journal of Instruction, 15(4), 497–514.
Purwana, U., Rusdiana, D., & Liliawati, W. (2020). Pengujian Kemampuan Menginterpretasikan Grafik Kinematika Calon Guru Fisika: the Polytomous Rasch Analysis. ORBITA: Jurnal Kajian, Inovasi Dan Aplikasi Pendidikan Fisika, 6(2), 259.
Yustiqvar, M., Hadisaputra, S., & Gunawan, G. (2019). Analisis penguasaan konsep siswa yang belajar kimia menggunakan multimedia interaktif berbasis green chemistry. Jurnal Pijar Mipa, 14(3), 135-140.
Irawan, J., Hadi, S., Zulandri, Z., Jamaluddin, J., Syukur, A., & Hadisaputra, S. (2021). Validating metacognitive awareness inventory (MAI) in chemistry learning for senior high school: A rasch model analysis. Jurnal Pijar Mipa, 16(4), 442-448.
Anggraini, N., & Yusmaita, E. (2021). Pemetaan Level Literasi Kimia Peserta Didik Kelas XI MIPA di SMAN 1 Lubuk Basung pada Materi Termokimia dengan Model Rasch. Edukimia, 3(3), 147–154.
Author Biographies
Yayang Andita Putri, Chemistry Education Study Program, Faculty of Mathematics and Natural Sciences, Universitas Negeri Padang
Faizah Qurrata Aini, Chemistry Education Study Program, Faculty of Mathematics and Natural Sciences, Universitas Negeri Padang
License
Copyright (c) 2023 Yayang Andita Putri, Faizah Qurrata Aini
This work is licensed under a Creative Commons Attribution 4.0 International License.
The following terms apply to authors who publish in this journal:
1. Authors retain copyright and grant the journal first publication rights, with the work simultaneously licensed under a Creative Commons Attribution License 4.0 International License (CC-BY License) that allows others to share the work with an acknowledgment of the work's authorship and first publication in this journal.
2. Authors may enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., posting it to an institutional repository or publishing it in a book), acknowledging its initial publication in this journal.
3. Before and during the submission process, authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website), as this can lead to productive exchanges as well as earlier and greater citation of published work (See The Effect of Open Access).
