Assessing the item of final assessment mathematics test of junior high school using Rasch model

Atikah Atikah, Sudiyatno Sudiyatno, Abdul Rahim, Marlina Marlina

Abstract


The test is a tool to collect information about the achievement of learning objectives so that the test must have good quality in order to be able to measure students' abilities accurately. To determine the quality of the test, it is necessary to do an analysis, one of which is the Rasch model approach. This study aims to analyze the quality of the final semester test results in learning mathematics—sampling using a purposive sampling technique. The subjects of this study were 56 students of Junior High School (SMP) in Yogyakarta, consisting of 25 males and 31 females. The test instrument consists of 40 multiple choice questions with the correct answer given a score of 1 and the wrong answer being given a score of 0. Therefore, the data obtained is dichotomous. The test kits were analyzed by applying the Rasch model. The study results obtained an estimate of the validity of item fit, where the questions analyzed had an INFIT MNSQ value between 0.94 - 1.11 and all questions with an OUTFIT value t ≤ 2.00; thus, 40 items fit according to the Rasch model. The characteristics of the test questions based on the Rasch model have a very difficult difficulty level of 0 items by 0%. The difficult category is three items at 7,5%, the medium category is 20 items at 50%, the easy category is 17 items at 42.5%, and 0% for the very easy category. The reliability of the case estimate value is 0.00 in the medium category, and the reliability of the item estimate value is 0.85 in the very high category. The implication of this research is additional knowledge regarding the Rasch analysis of mathematical problem models as a graduation standard.

Keywords


final assessment; item response theory; Rasch model

Full Text:

PDF

References


Agustin, N., Susilogati, S., & Addiani, K. (2018). Desain Instrumen Tes Bermuatan Etnosains Untuk Mengukur Kemampuan Berpikir Kritis Siswa Sma. Jurnal Inovasi Pendidikan Kimia, 12(2).

Alfarisa, F., & Purnama, D. N. (2019). Analisis Butir Soal Ulangan Akhir Semester Mata Pelajaran Ekonomi SMA Menggunakan RASCH Model. 11(2). https://doi.org/http://dx.doi.org/10.23887/jjpe.v11i2.20878

Amiruddin, K., Mania, S., Ichiana, N. N., Majid, A. F., Tarbiyah, F., Islam, U., & Alauddin, N. (2020). Analisis Butir Soal Ujian Akhir Sekolah (UAS) Mata Pelajaran Matematika. Alauddin Journal of Mathematics Education, 2(2), 207–217.

Andayani, A., Purwanto, & Ramalis, T. R. (2019). Kajian implementasi teori respon butir dalam menganalisis instrumen tes materi fisika. Seminar Nasional Fisika, 1(1), 37–42.

Ardiyanti, D. (2016). Aplikasi Model Rasch pada Pengembangan Skala Efikasi Diri dalam Pengambilan Keputusan Karir Siswa [Application of the Rasch Model on the Development of Self-Efficiency Scale in Student Career Decision Making]. Jurnal Psikologi, 43(3), 248–263.

Azizah, & Wahyuningsih, S. (2020). Penggunaan Model Rasch Untuk Analisis Instrumen Tes Pada Mata Kuliah Matematika Aktuaria. JUPITEK: Jurnal Pendidikan Matematika, 3(1), 45–50. https://doi.org/10.30598/jupitekvol3iss1pp45-50

Dunn, L., Morgan, C., O’Reilly, M., & Parry, S. (2003). The student assessment handbook: New directions in traditional and online assessment. Routledge.

Embretson, E. & Reise, S. . (2000). Item response theory for psychologists (L. E. Associates (ed.)). NJ Publications.

Erfan, M., Maulyda, M. A., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Tes Klasik Dan Model Rasch. Indonesian Journal of Educational Research and Review, 3(1), 11–19.

Fauziana, A., & Wulansari, A. D. (2021). Analisis Kualitas Butir Soal Ulangan Harian di Sekolah Dasar dengan Model Rasch. Jurnal Kependidikan Dasar Islam Berbasis Sains, 6(1), 10–19. https://doi.org/https://doi.org/10.21154/ibriez.v6i1.112

Goldstein, H. and S. B. (1982). The Rasch Model Still Does Not Fit. British Educational Research Journal, 82, 167-170.

Hakiki, A. W., Fitri, A. R., & Agung, I. M. (2018). Analisis Properti Psikometri Subtes Merkaufgaben (ME) dengan Rasch Model. Jurnal Psikologi, 14(1), 40. https://doi.org/10.24014/jp.v14i1.4900

Halim, R. A., Zaharim, A., Rashid, R. a., & Masodi, M. S. (2001). Application of Logistic Regression Model in Rasch Measurement to establish a Performance Index: A case in Audits on Malaysian Institute of Higher Learning. The 12th WSEAS Int Conf. on Applied Mathematics, Cairo, Eygpt, 29-31 December, March 2014.

Hambleton, R. K. Swaminathan, H., & Rogers, H. J. (1985). Item Response Theory: Principles and Application. Kluwer Inc.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory (Vol.2). Sage publication.

Himelfarb, I. (2019). A primer on standardized testing: History, measurement, classical test theory, item response theory, and equating. Journal of Chiropractic Education, 33(2), 151–163. https://doi.org/10.7899/JCE-18-22

Imaroh, N., Susongko, P., & Isnani. (2020). Uji Validitas Tes Ulangan Akhir Semester Gasal Mata Pelajaran Matematika(Studi Deskriptif Analisis Dokumenter di SMP Negeri Slawi Tahun Pelajaran 2016/2017). Jurnal Pendidikan MIPA Pancasakti, 1(1), 80–89. https://doi.org/https://doi.org/10.24905/jpmp.v1i1.792

Iskandar, A., & Rizal, M. (2018). Analisis kualitas soal di perguruan tinggi berbasis aplikasi TAP. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(1), 12–23. https://doi.org/10.21831/pep.v22i1.15609

Kadir, A. (2015). MENYUSUN DAN MENGANALISIS TES HASIL BELAJAR. AL- TA’DIB. Jurnal Kajian Ilmu Kependidikan, 8(2), 70–81. https://doi.org/https://doi.org/10.31332/atdb.v8i2.411

Kones, N. I., & Rosnawati, R. (2021). Kualitas Butir dan Estimasi Kemampuan Matematika Siswa SMP pada Soal Ujian Sekolah. Jurnal Elemen, 7(2), 280–294. https://doi.org/10.29408/jel.v7i2.3054

Lord, M. L. (1980). pplication of item response theory to practical testing problems. Lawrence Erlbaum Associates, Publisher.

Mardapi, D. (2016). Pengukuran, penilaian dan evaluasi pendidikan (Edisi 2). Parama.

Nazaruddin. (2017). Kemampuan Guru dalam Menyusun Tes Hasil Belajar melalui Workshop di SD Negeri Lamteubee. Serambi Akademika, V(1), 32–42.

Nufus, S. H., Gani, A., & Suhendrayatna. (2017). Pengembangan Instrumen Penilaian Sikap Berbasis Kurikulum 2013 Pada Pembelajaran Kimia SMA. Jurnal Pendidikan Sains Indonesia, 05(01), 44–51.

Petrillo, J., Cano, S. J., McLeod, L. D., & Coon, C. D. (2015). Using classical test theory, item response theory, and rasch measurement theory to evaluate patient-reported outcome measures: A comparison of worked examples. Value in Health, 8(1), 95–104.

Pratama, D. (2020). Analisis Kualitas Tes Buatan Guru Melalui Pendekatan Item Response Theory (IRT) Model Rasch. Tarbawy : Jurnal Pendidikan Islam, 7(1), 61–70. https://doi.org/10.32923/tarbawy.v7i1.1187

Purba, S. E. D. (2018). Analisis model Rasch instrumen tes prestasi pada mata pelajaran dasar dan pengukuran listrik [Rasch model analysis of achievement test instruments on basic subjects and electrical measurements]. Wiyata Dharma: Jurnal Penelitian Dan Evaluasi Pendidikan, 6(2), 142.

Rahim, A., & Haryanto. (2021). Implementation of Item Response Theory (IRT) Rasch Model in Quality Analysis of Final Exam Tests in Mathematics. Journal of Educational Research and Evaluation, 10(2), 57–65. https://doi.org/https://doi.org/10.15294/jere.v10i2.51802

Retnawati, H. (2014). Respons Butir dan Penerapannya. Nuha Medika.

Saebani, B. A. (2015). Filsafat Ilmu dan Metode Penelitian. Pustaka Setia.

Santoso, A., Kartianom, K., & Kassymova, G. K. (2019). Kualitas butir bank soal statistika (Studi kasus: Instrumen ujian akhir mata kuliah statistika Universitas Terbuka). Jurnal Riset Pendidikan Matematika, 6(2), 165–176. https://doi.org/10.21831/jrpm.v6i2.28900

Setyawarno, D. (2017). Upaya peningkatan kualitas butir soal dengan analisis aplikasi quest. Fakultas Matematika dan Ilmu Pengetahuan Alam Universitas Negeri.

Setyawarno, Didik. (2016). Analisis Data Pengukuran Menggunakan Program Quest. November. http://staff.uny.ac.id/sites/default/files/pendidikan/didik-setyawarno-spdsi-mpd/analisis-butir-soal-panduan-singkat-penggunaan-quest.pdf

Smit, A., Kelderman, H., & Van Der Flier, H. (2000). The mixed Birnbaum model: Estimation using collateral information. MPR-Online, 5(January 2000), 31–43.

Stiggins, R., & Chappuis, J. (2012). Introduction to student invoved assessment for learning (6th ed.). Addison Wesley.

Sumintono, B., & Widhiarso, W. (2015). Aplikasi Pemodelan Rasch pada Assessment Pendidikan. Trim Komunikata.

Susdelina, Perdana, S. A., & Febrian. (2018). Analisis Kualitas Instrumen Pengukuran Pemahaman Konsep Persamaan Kuadrat Melalui Teori Tes Klasik Dan Rasch Model. Jurnal Kiprah, 6(1), 41–48. https://doi.org/10.31629/kiprah.v6i1.574

Thissen, D., Nelson, L., Rosa, K., et al. (2001). Item Response Theory for Items Scored in More than Two Categories. Lawrence Erlbaum Associates Publishers.

Wahyudi, W. (2012). Assesment Pembelajaran Berbasis Portofolio di Sekolah. Jurnal Visi Ilmu Pendidikan, 2(1), 288–297. https://doi.org/10.26418/jvip.v2i1.370

Widyaningsih, S. W., Yusuf, I., Prasetyo, Z. K., & Istiyono, E. (2021). The Development of the HOTS Test of Physics Based on Modern Test Theory; Question Modeling through E-learning of moodle LMS. International Journal of Instruction, 14(4), 51–68. https://doi.org/https://doi.org/10.29333/iji.2021.1444a




DOI: https://doi.org/10.29408/jel.v8i1.4482

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Atikah tika, Sudiyatno Sudiyatno, Abdul Rohim, Marlina Marlina

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 Creative Commons License
Jurnal Elemen is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

View My Stats