Development of Computer Vision-based Visual Feedback Assistive Technology for Fine Motor Improvement in Children with Cerebral Palsy
DOI:
10.29303/jpm.v20i1.8298Published:
2025-01-30Issue:
Vol. 20 No. 1 (2025): January 2025Keywords:
Assistive Technology; Cerebral Palsy; Fine MotorArticles
Downloads
How to Cite
Downloads
Metrics
Abstract
Cerebral Palsy (CP) is a neuromotor condition that affects fine motor development, causing barriers to daily activities such as writing and grasping. This research develops an assistive technology that utilizes motion sensors to provide real-time visual feedback, which helps children understand and correct movements more effectively. The technology improves movement precision and coordination in motor skills, learner engagement, and structured monitoring of skill improvement. The uniqueness of this research lies in integrating computer vision technology with an interactive design that allows CP children to perform motor exercises and engage them in a more personalized and adaptive learning process. The Research and Development (R&D) method was used in the development, involving validating material experts, media experts, and educational practitioners. The results of media development show that assistive technology is feasible to use in improving the fine motor skills of children with cerebral palsy. Material experts stated an average value of 3.92, which was accumulated in percentage to 98.21%; media experts obtained results of 3.71, which was collected in percentage to 92.85%; and expert practitioners stated an average value of 3.93, which was accumulated in percentage to 98.43%. The assistive technology developed is worth testing in improving the fine motor skills of cerebral palsy children. This technology is expected to solve motor and coordination training issues at school and home. With a more interactive and fun approach, CP children can be more motivated to practice so that their motor skills can develop better.
References
S. Jin, S. Lewis, S. Bakhtiari, X. Zeng, M. Sierant, S. Shetty, S. Nordlie, A. Elie, M. Corbett, B. Norton, and E. van, “Mutations disrupting neuritogenesis genes confer risk for cerebral palsy,” Nature Genetics, vol. 52, no. 10, pp. 046–56, 2020. https://doi.org/10.1038/s41588-020-0695-1
D A. Derouin, “The development and validation of a three-dimensional visual target acquisition system to assess the performance effects of head supported mass,” Ph.D. dissertation, Queen’s University Canada, 2020. https://doi.org/10.1016/j.apergo.2018.12.002
A. R. Anindita and N. C. Apsari, “Pelaksanaan support group pada orangtua anak dengan cerebral palsy,” Focus: Jurnal Pekerjaan Sosial, vol. 2, no. 2, pp. 208–218, 2019. https://doi.org/10.24198/focus.v2i2.26248
T. Rosita, E. Rochyadi, and S. Sunardi, “Teknologi Asistif dalam Pendidikan Inklusif,” COLLASE (Creative of Learning Students Elementary Education), vol. 3, no. 6, pp. 301–307, 2020. http://journal.ikipsiliwangi.ac.id/index.php/collase/article/view/6246
M. Mödinger, A. Woll, and I. Wagner, “Video-based visual feedback to enhance motor learning in physical education—a systematic review,” German Journal of Exercise and Sport Research, vol. 52, no. 3, pp. 447–460, 2022. https://doi.org/10.1007/s12662-021-00782-y
J. A. Saunders and D. C. Knill, “Visual feedback control of hand movements,” Journal of Neuroscience, vol. 24, no. 13, pp. 3223–3234, 2004. https://doi.org/10.1523/JNEUROSCI.4319-03.2004
M. C. Rhoads, G. B. Da Matta, N. Larson, and S. Pulos, “A meta-analysis of visual feedback for motor learning,” Athletic Insight, vol. 6, no. 1, p. 17, 2014.
R. Sigrist, G. Rauter, R. Riener, and P. Wolf, “Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review,” Psychonomic Bulletin & Review, vol. 20, no. 1, pp. 21–53, 2013. https://doi.org/10.3758/s13423-012-0333-8.
R. P. H. Sejati and R. Mardhiyyah, “Deteksi wajah berbasis facial landmark menggunakan OpenCV dan Dlib,” (JurTI) Jurnal Teknologi Informasi, vol. 5, no. 2, pp. 144–148, 2021. https://doi.org/10.36294/jurti.v5i2.2220
T. A. Dompeipen, S. R. Sompie, and M. E. Najoan, “Computer vision implementation for detection and counting the number of humans,” Jurnal Teknik Informatika, vol. 16, no. 1, pp. 65–76, 2021. https://doi.org/10.35793/jti.v16i1.31471
T. Sutisna, A. R. Raharja, S. Solihin, E. Hariyadi, and V. H. C. Putra, “Penggunaan computer vision untuk menghitung jumlah kendaraan dengan menggunakan metode SSD (Single Shoot Detector),” Innovative: Journal of Social Science Research, vol. 4, no. 2, p. 6060–6067, 2024. https://doi.org/10.31004/innovative.v4i2.10071
D. Bhatt et al., “CNN variants for computer vision: History, architecture, application, challenges and future scope,” Electronics, vol. 10, no. 20, p. 2470, 2021. https://doi.org/10.3390/electronics10202470
K. Lee, H. Oh, and G. Lee, “Fully immersive virtual reality game-based training for an adolescent with spastic diplegic cerebral palsy: A case report,” Children, vol. 9, no. 10, p. 1512, 2022. https://doi.org/10.3390/children9101512
Sugiono, Metode Penelitian Kuantitatif, Kualitatif, dan R&D, Bandung: Alfabeta, 2019.
Y. H. Rayanto, Penelitian Pengembangan Model Addie Dan R2d2: Teori & Praktek, Lembaga Academic & Research Institute, 2020.
W. Yuliani and N. Banjarnahor, “Metode penelitian pengembangan (R&D) dalam bimbingan dan konseling,” Quanta Journal, vol. 5, no. 3, pp. 111–118, 2021.
Riduwan, Skala Pengukuran Variabel-Variabel Penelitian, Bandung: Alfabeta, 2015.
S. Arikunto, Dasar-Dasar Evaluasi Pendidikan, Jakarta: Bumi Aksara, 2018.
Restian, A. R., Arifin, B., Deviana, T., Suwandayani, B. I., Kuncahyono, K., & Herviani, V. K. “Development of Sciber Applications (Screening with Special Needs) Funding for Learning Innovation and Assistive Technology (Assistive Technology) for Students with Special Needs in Higher Education”. Jurnal Pendidikan Kebutuhan Khusus, 7(2), 124-132. 2023 https://doi.org/10.24036/jpkk.v6i1.617
Susanti, S., Dewi, P. I. A., Saputra, N., Dewi, A. K., Wulandari, F., Kusumawardan, R. N., ... & Sholeh, M. “Desain media pembelajaran SD/MI.” Yayasan Penerbit Muhammad Zaini. 2022
A. L. Rothstein and R. K. Arnold, “Bridging the gap: Application of research on videotape feedback and bowling,” Motor Skills: Theory into Practice, vol. 1, p. 36–63, 1976.
A. A. M. Suradi, S. Alam, M. Mushaf, M. F. Rasyid, and I. Djafar, “Sistem deteksi kantuk pengemudi mobil berdasarkan analisis rasio mata menggunakan computer vision,” JUKI: Jurnal Komputer dan Informatika, vol. 5, no. 2, pp. 222–230, 2023.
D. A. Ayubi, D. A. Prasetya, and I. Mujahidin, “Pendeteksi wajah secara real time pada 2 degree of freedom (DOF) kepala robot menggunakan deep integral image cascade,” CYCLOTRON, vol. 3, no. 1, 2020. https://doi.org/10.30651/cl.v3i1.4306
G. B. Prananta, H. A. Azzikri, and C. Rozikin, “Real-time hand gesture detection and recognition using convolutional artificial neural networks,” METHODIKA: Jurnal Teknik Informatika dan Sistem Informasi, vol. 9, no. 2, pp. 30–34, 2023. https://doi.org/10.46880/mtk.v9i2,1911
B. W. Suwahyo, P. Setyosari, and H. Praherdhiono, “Pemanfaatan teknologi asistif dalam pendidikan inklusif,” Edcomtech, vol. 7, no. 1, pp. 51–63, 2022. http://dx.doi.org/10.17977/um039v7i12022p055
S. Marantika, F. Fatkhurohmah, I. Pratidina, and C. Widyasari, “Pendekatan inklusif pada anak berkebutuhan khusus di sekolah dasar untuk menghadapi tantangan abad 21,” Berkala Ilmiah Pendidikan, vol. 4, no. 3, pp. 450–460, 2024.
Author Biographies
Tarisya Mawaddah, Special Education Study Program, Universitas Negeri Surabaya
Endang Pudjiastuti Sartinah, Special Education Study Program, Universitas Negeri Surabaya
Wagino Wagino, Special Education Study Program, Universitas Negeri Surabaya
License
Copyright (c) 2025 Tarisya Mawaddah, Endang Pudjiastuti Sartinah, Wagino Wagino
This work is licensed under a Creative Commons Attribution 4.0 International License.
The following terms apply to authors who publish in this journal:
1. Authors retain copyright and grant the journal first publication rights, with the work simultaneously licensed under a Creative Commons Attribution License 4.0 International License (CC-BY License) that allows others to share the work with an acknowledgment of the work's authorship and first publication in this journal.
2. Authors may enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., posting it to an institutional repository or publishing it in a book), acknowledging its initial publication in this journal.
3. Before and during the submission process, authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website), as this can lead to productive exchanges as well as earlier and greater citation of published work (See The Effect of Open Access).
