The Application of Rasch Model to Analyse the Validity and Reliability of an Instrument for Reflective Thinking Skills on Topic of Wave-Particle Dualism
DOI:
https://doi.org/10.29408/kpj.v8i2.27049Keywords:
Berpikir Reflektif, Fisika Modern, Model Rasch, Reliabilitas, ValiditasAbstract
This study aims to analyse the validity and reliability of an instrument for assessing reflective thinking skills on the topic of wave-particle dualism in modern physics lectures using the Rasch model. The Rasch model was selected for its capability to provide a more in-depth analysis of item performance and respondent ability, as well as to identify misfitting or biased items. The research method employed is a descriptive quantitative approach, utilizing Winsteps software for data analysis. The sample consists of 36 students enrolled in modern physics lectures at a university in West Nusa Tenggara. The results indicate that the instrument has excellent item reliability (0.91) and excellent internal consistency (Cronbach's Alpha 0.86), although the respondent reliability falls into the weak category (0.62). The instrument's validity also meets the Rasch model's acceptance criteria, with infit MNSQ and outfit MNSQ values ranging from 0.5 to 1.5. Further analysis reveals that some items are misfitting and need revision to ensure fairness and consistency in measuring reflective thinking skills. These findings make a significant contribution to the development of more accurate and reliable assessment tools in physics education
References
Alves, E. G., and Santos, A. L. M. (2021). Photoelectric effect: development of a quantitative experiment. Revista Brasileira de Ensino de Fisica, 43, 1–9. https://doi.org/10.1590/1806-9126-RBEF-2021-0146
Andrich, D., and Marais, I. (2019). A Course in Rasch Measurement Theory: Measuring in the Educational, Social and Health Sciences. In Springer. https://doi.org/10.1007/978-981-13-7496-8
Anselmi, P., Colledani, D., and Robusto, E. (2019). A Comparison of Classical and Modern Measures of Internal Consistency. Frontiers in Psychology, 10(December), 1–12. https://doi.org/10.3389/fpsyg.2019.02714
Arabatzis, T. (2017). How Physica Became Physics. In Science & Education. Science & Education. https://doi.org/https://doi.org/10.1007/s11191-017-9946-7
Bond, T. ., and Fox, C. (2015). Applying the Rasch model fundamental measurement in the human sciences (3rd ed.). Routledge.
Boone, W. J., and Staver, J. R. (2020). Correction to: Advances in Rasch Analyses in the Human Sciences. In Springer. https://doi.org/10.1007/978-3-030-43420-5_21
Hadzhikolev, E., Hadzhikoleva, S., Yotov, K., and Orozova, D. (2020). Models for Multicomponent Fuzzy Evaluation, with a Focus on the Assessment of Higher-Order Thinking Skills. TEM Journal, 9(4), 1656–1662. https://doi.org/10.18421/TEM94-43
Handayani, Y., Rahmawati, R., and ... (2023). Using Rasch Model to Analyze Reliability and Validity of Concept Mastery Test on Electricity and Magnetism Topic. JIPF (Jurnal Ilmu …, 8(2), 226–239. https://doi.org/http://dx.doi.org/10.26737/jipf.v8i2.3877
Juandi, T., Kaniawati, I., Samsudin, A., and Riza, L. S. (2023). Implementing the rasch model to assess the level of students’ critical and reflective thinking skills on the photoelectric effect. Momentum: Physics Education Journal, 7(2). https://doi.org/https://doi.org/10.21067/mpej.v7i2.8252
Kanim, S. (2020). Demographics of physics education research. Physical Review Physics Education Research, 16(2), 20106. https://doi.org/10.1103/PhysRevPhysEducRes.16.020106
Laliyo, L. A. R., La Kilo, A., Paputungan, M., Kunusa, W. R., Dama, L., and Panigoro, C. (2022). Rasch Modelling To Evaluate Reasoning Difficulties, Changes of Responses, and Item Misconception Pattern of Hydrolysis. Journal of Baltic Science Education, 21(5), 817–835. https://doi.org/10.33225/jbse/22.21.817
Ling Lee, W., Chinna, K., and Sumintono, B. (2021). Psychometrics assessment of HeartQoL questionnaire: A Rasch analysis. European Journal of Preventive Cardiology, 28(12), E1–E5. https://doi.org/10.1177/2047487320902322
Maryani, I., Prasetyo, Z. K., Wilujeng, I., Purwanti, S., and Fitrianawati, M. (2021). HOTs Multiple Choice and Essay Questions: A Validated Instrument to Measure Higher-order Thinking Skills of Prospective Teachers. Journal of Turkish Science Education, 18(4), 674–690. https://doi.org/10.36681/tused.2021.97
Maryati, M., Prasetyo, K. un Z., Wilujeng, I., and Sumintoni, B. (2019). Measuring Teachers’ Pedagogical Content Knowledge Using Many-Facet Rasch Model. Cakrawala Pendidikan, 38(3), 452–464. https://doi.org/10.21831/cp.v38i3.26598
Nitriani, N., Darsikin, D., and Saehana, S. (2022). Kolb’s learning style analysis in solving HOTS questions for prospective physics teacher students. Momentum: Physics Education Journal, 6(1), 59–72. https://doi.org/10.21067/mpej.v6i1.5593
Planinic, M., Boone, W. J., Susac, A., and Ivanjek, L. (2019). Rasch analysis in physics education research : Why measurement matters. Physical Review Physics Education Research, 15(2), 20111. https://doi.org/10.1103/PhysRevPhysEducRes.15.020111
Purnami, W., Ashadi, Suranto, Sarwanto, Sumintono, B., and Wahyu, Y. (2021). Investigation of person ability and item fit instruments of eco critical thinking skills in basic science concept materials for elementary pre-service teachers. Jurnal Pendidikan IPA Indonesia, 10(1), 127–137. https://doi.org/10.15294/jpii.v10i1.25239
Rouquette, A., Hardouin, J., Vanhaesebrouck, A., Se´bille, V., and Coste, J. l. (2019). Differential Item Functioning ( DIF ) in composite health measurement scale : Recommendations for characterizing DIF with meaningful consequences within the Rasch model framework. Plos One, 1–16. https://doi.org/10.1371/journal. pone.0215073
Salido, A., and Dasari, D. (2019). The analysis of students’ reflective thinking ability viewed by students’ mathematical ability at senior high school. Journal of Physics: Conference Series, 1157(2). https://doi.org/10.1088/1742-6596/1157/2/022121
Samsudin, A., Rusdiana, D., Efendi, R., Fratiwi, N. J., Aminudin, A. H., and Adimayuda, R. (2021). Development of Predict-Observe-Explain (POE) Strategy Assisted by Rebuttal Texts on Newton’s Law Material with Rasch Analysis. Tadris: Jurnal Keguruan Dan Ilmu Tarbiyah, 6(1), 103–115. https://doi.org/10.24042/tadris.v6i1.7641
Setiawan, J., Sudrajat, A., Aman, and Kumalasari, D. (2021). Development of higher order thinking skill assessment instruments in learning Indonesian history. International Journal of Evaluation and Research in Education, 10(2), 545–552. https://doi.org/10.11591/ijere.v10i2.20796
Sumintono, B., and Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Asesmen Pendidikan. Bandung: Trim Komunikata.
Sun, Y., and Latora, V. (2020). The evolution of knowledge within and across fields in modern physics. Scientific Reports, 10(1), 1–9. https://doi.org/10.1038/s41598-020-68774-w
Syahidi, K., Jufri, A. W., Doyan, A., Rokhmat, J., and Sukarso, A. A. (2023). Penguatan Literasi Sains dan Pendidikan Karakter pada Pembelajaran IPA Abad 21. Kappa Journal, 7(3), 538–542. https://doi.org/https://doi.org/10.29408/kpj.v7i3.25036
Wei, S., Chee, C., Looi, K., and Sumintono, B. (2020). Assessing computational thinking abilities among Singapore secondary students : a Rasch model measurement analysis. Journal of Computers in Education, 0123456789. https://doi.org/10.1007/s40692-020-00177-2
Widhiarso, W., and Sumintono, B. (2016). Examining response aberrance as a cause of outliers in statistical analysis. PAID, 98, 11–15. https://doi.org/10.1016/j.paid.2016.03.099
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Kappa Journal
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Semua tulisan pada jurnal ini menjadi tanggungjawab penuh penulis. Jurnal Kappa memberikan akses terbuka terhadap siapapun agar informasi dan temuan pada artikel tersebut bermanfaat bagi semua orang. Jurnal Kappa dapat diakses dan diunduh secara gratis, tanpa dipungut biaya, sesuai dengan lisensi creative commons yang digunakan
