Development of an assessment instrument to evaluate the concepts of chemical equilibrium at macroscopic, sub-microscopic, and symbolic representation levels using the rasch model
DOI:
10.29303/jpm.v18i2.4720Published:
2023-03-30Issue:
Vol. 18 No. 2 (2023): March 2023Keywords:
Test Instruments, Chemical Equilibrium, Multiple Representation, Rasch ModelsArticles
Downloads
How to Cite
Downloads
Metrics
Abstract
This study aims to develop a test instrument that can be used to evaluate the concept of chemical equilibrium at the macroscopic, submicroscopic, and symbolic levels of high school students who are declared valid, reliable, have a difficulty index, and have good item discrimination. This study was designed using the Rasch development model, which Wei has modified with ten research stages. The results of the research to test content validity were analyzed through the minifacets program with five validators consisting of four chemistry lecturers at Padang State University and one teacher at high school SMAN 3 Padang, obtaining fit analysis results seen from the exact agreement value of 89.1%, which is very close to the expected agreement value of 89.7%. The test results on 30 students of SMAN 3 Padang who were analyzed through the ministep program showed valid results for all items because they met the criteria for the MNSQ, ZSTD, and Pt Mean Corr outfit scores. The reliability value obtained for the item is 0.74, which meets the sufficient criteria, and Cronbach's alpha reliability value is 0.74, which meets the good criteria. All question items also do not have DIF based on gender. The analyzed index of difficulty and discriminating power fulfilled the good criteria with the classification of easy, medium, and difficult items.
References
Stojanovska, M., Petruševski, V. M., & Šoptrajanov, B. (2017). Study of the use of the three levels of thinking and representation. Contributions, Section of Natural, Mathematical and Biotechnical Sciences, 35(1). doi: 10.20903/csnmbs.masa.2014.35.1.52.
Akaygun, S. (2016). Is the oxygen atom static or dynamic? The effect of generating animations on students' mental models of atomic structure. Chemistry Education Research and Practice, 17(4), 788-807.
Harza, A. E. K. P., Wiji, W., & Mulyani, S. (2021, March). Potency to overcome misconceptions by using multiple representations on the concept of chemical equilibrium. In Journal of Physics: Conference Series (Vol. 1806, No. 1, p. 012197). IOP Publishing.
Sunyono, S., Yuanita, L., & Ibrahim, M. (2015). Mental models of students on stoichiometry concept in learning by method based on multiple representation. The Online Journal of New Horizons in Education (TOJNED), 5(2), 30-45.
Baig, M., Ali, S. K., Ali, S., & Huda, N. (2014). Evaluation of multiple choice and short essay question items in basic medical sciences. Pakistan journal of medical sciences, 30(1), 3.
Aristiawan, A. (2022). Profil Kemampuan Pemecahan Masalah Fisika Siswa SMA Menggunakan Soal Essay. Jurnal Tadris IPA Indonesia, 2(1), 45-55.
Son, A. L. (2019). Instrumentasi kemampuan pemecahan masalah matematis: analisis reliabilitas, validitas, tingkat kesukaran dan daya beda butir soal. Gema wiralodra, 10(1), 41-52.
Stolt, M., Kottorp, A., & Suhonen, R. (2022). The use and quality of reporting of Rasch analysis in nursing research: A methodological scoping review. International Journal of Nursing Studies, 104244.
Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan. Trim komunikata.
Wei, S., Liu, X., Wang, Z., & Wang, X. (2012). Using Rasch measurement to develop a computer modeling-based instrument to assess students’ conceptual understanding of matter. Journal of Chemical Education, 89(3), 335-345.
Wang, Z., Chi, S., Luo, M., Yang, Y., & Huang, M. (2017). Development of an instrument to evaluate high school students' chemical symbol representation abilities. Chemistry Education Research and Practice, 18(4), 875-892.
Utomo, B. (2022). Analisis validitas isi butir soal sebagai salah satu upaya peningkatan kualitas pembelajaran di madrasah berbasis nilai-nilai islam. Jurnal Pendidikan Matematika (Kudus), 1(2).
Fahmina, S. S., Masykuri, M., Ramadhani, D. G., & Yamtinah, S. (2019, December). Content validity uses Rasch model on computerized testlet instrument to measure chemical literacy capabilities. In AIP Conference Proceedings (Vol. 2194, No. 1, p. 020023). AIP Publishing LLC.
Nisa, D. Q., & Yusmaita, E. (2022). Development of Chemical Literacy Items in Electrolyte and Non Electrolyte Solution Topic for Class X SMA/MA. Entalpi Pendidikan Kimia, 3(1), 49-57.
Rahman, Y. A. (2023). Person and Item Validity and Reliability in Essay Writing Using Rasch Model. Konstruktivisme: Jurnal Pendidikan dan Pembelajaran, 15(1), 41-55.
Palimbong, J., Mujasam, M., & Allo, A. Y. T. (2018). Item Analysis Using Rasch Model in Semester Final Exam Evaluation Study Subject in Physics Class X TKJ SMK Negeri 2 Manokwari. Kasuari: Physics Education Journal (KPEJ), 1(1), 43-51.
Sumintono, B., & Widhiarso, W. (2014). Aplikasi model Rasch untuk penelitian ilmu-ilmu sosial (edisi revisi). Trim Komunikata Publishing House.
LA, N. (2021). Differential Item Functioning and Test Performance: a Comparison Between the Rasch Model, Logistic Regression and Mantel-Haenszel.
Khalaf, M. A., & Omara, E. M. N. (2022). Rasch analysis and differential item functioning of English language anxiety scale (ELAS) across sex in Egyptian context. BMC psychology, 10(1), 242.
Irawan, J., Hadi, S., Zulandri, Z., Jamaluddin, J., Syukur, A., & Hadisaputra, S. (2021). Validating metacognitive awareness inventory (MAI) in chemistry learning for senior high school: A rasch model analysis. Jurnal Pijar Mipa, 16(4), 442-448.
Kristyasari, M. L., Asmaningrum, H. P., & Hanif, R. F. Wright-Map to Analyze Students’ Abilities on Chemical Bond Test. In SHS Web of Conferences (Vol. 149, p. 01050). EDP Sciences.
Author Biographies
Difa Aulia Putri Rizal, Universitas Negeri Padang
Faizah Qurrata Aini, Chemistry Education Study Program, Faculty of Mathematics and Natural Sciences, Universitas Negeri Padang
License
Copyright (c) 2023 Difa Aulia Putri Rizal, Faizah Qurrata Aini
This work is licensed under a Creative Commons Attribution 4.0 International License.
The following terms apply to authors who publish in this journal:
1. Authors retain copyright and grant the journal first publication rights, with the work simultaneously licensed under a Creative Commons Attribution License 4.0 International License (CC-BY License) that allows others to share the work with an acknowledgment of the work's authorship and first publication in this journal.
2. Authors may enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., posting it to an institutional repository or publishing it in a book), acknowledging its initial publication in this journal.
3. Before and during the submission process, authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website), as this can lead to productive exchanges as well as earlier and greater citation of published work (See The Effect of Open Access).
