Development and Validation of a Science Literacy-Based Critical Thinking Assessment Instrument for Renewable Energy Content

Alifya Crystal Jasmine Zafira Zahra Budimansyah; Mukhayyarotin Niswati Rodliyatul Jauhariyah

doi:10.29408/kpj.v10i2.35297

Authors

Alifya Crystal Jasmine Zafira Zahra Budimansyah Universitas Negeri Surabaya
Mukhayyarotin Niswati Rodliyatul Jauhariyah Universitas Negeri Surabaya

DOI:

https://doi.org/10.29408/kpj.v10i2.35297

Keywords:

Critical Thinking, Science Literacy, Test Instrument, Renewable Energy, Validity

Abstract

This study aims to describe the theoretical and empirical validity of a science literacy-based critical thinking test instrument on the topic of renewable energy. The developed instrument integrates science literacy competencies to measure critical thinking skills while simultaneously fostering students’ science literacy within a single instrument. The instrument development followed the ADDIE model, focusing on three main stages: Analysis, Design, and Development. The instrument consists of 20 open-ended items based on Facione’s critical thinking indicators, integrated with science literacy competencies. Theoretical validity was obtained through a validation sheet reviewed by three expert validators in their respective fields, while empirical validity was obtained through a pilot test involving 34 students. The results of theoretical validity for the content, construct, and language aspects were 97%, 94%, and 90%, respectively, with an overall average of 94%, categorized as highly valid. Regarding empirical validity, all test items were deemed valid, with 14 items (70%) categorized as very high and 6 items (30%) categorized as high, and they exhibited a very high level of reliability. Based on difficulty level, 11 items (55%) were categorized as moderate and 9 items (45%) as easy. The discriminant validity analysis showed that 17 items (85%) were classified as adequate and 3 items (15%) as good. Overall, all items deemed valid can be used to measure students’ critical thinking skills in a comprehensive and structured manner.

Author Biography

Mukhayyarotin Niswati Rodliyatul Jauhariyah, Universitas Negeri Surabaya

Program Studi Pendidikan Fisika Universitas Negeri Surabaya

References

Ahzari, S., & Akmam, A. (2025). Analyzing students’ critical thinking as a basis for developing interactive physics multimedia with generative learning and cognitive conflict strategies. Jurnal Pendidikan Fisika, 13(2), 163–176. https://doi.org/10.26618/jpf.v13i2.17702

Ariadila, S. N., Silalahi, Y. F. N., Fadiyah, F. H., Jamaludin, U., & Setiawan, S. (2023). Analisis pentingnya keterampilan berpikir kritis terhadap pembelajaran bagi siswa. Jurnal Ilmiah Wahana Pendidikan, 9(20), 664–669. https://doi.org/10.5281/zenodo.8436970

Arifin, Z. (2016). Evaluasi pembelajaran. Bandung, Indonesia: PT Remaja Rosdakarya.

Arikunto, S. (2018). Dasar-dasar evaluasi pendidikan. Jakarta, Indonesia: Bumi Aksara.

Arikunto, S. (2021). Dasar-dasar evaluasi pendidikan. Jakarta, Indonesia: Bumi Aksara.

Cahyana, U., Paristiowati, M., Savitri, D. A., & Hasyrin, S. N. (2017). Developing and application of mobile game based learning (M-GBL) for high school students’ performance in chemistry. Eurasia Journal of Mathematics, Science and Technology Education, 13(10), 7037–7047. https://doi.org/10.12973/ejmste/78728

Calma, A., & Davies, M. (2026). Assessing students’ critical thinking abilities via a systematic evaluation of essays. Studies in Higher Education, 51(2), 422–437. https://doi.org/10.1080/03075079.2025.2470969

Fuad, N. M., Zubaidah, S., Mahanal, S., & Suarsini, E. (2017). Improving junior high schools’ critical thinking skills based on test three different models of learning. International Journal of Instruction, 10(1), 101–116. https://doi.org/10.12973/iji.2017.1017a

Hadiryanto, S., & Thaib, D. (2016). Peningkatan kemampuan berpikir kritis siswa SMP melalui pembelajaran berbasis masalah pada konsep respirasi. EduHumaniora: Jurnal Pendidikan Dasar, 8(1), 55–65. https://doi.org/10.17509/eh.v8i1.5122

Haryanti, H., Susongko, P., & Arfiani, Y. (2024). Pengembangan instrumen penilaian berpikir kritis menurut Facione pada pembelajaran IPA di sekolah menengah pertama berbasis model Rasch. PSEJ: Pancasakti Science Education Journal, 9(2), 78–87. https://doi.org/10.24905/psej.v9i2.207

Ikhsan, M., Atun, S., Agusta, F., Unayah, H., Buhera, R., Pamungkas, O., Sarip, M., & Sitorus, P. A. (2025). Development of critical thinking essay test instrument and prosocial intention questionnaire for environmental care in students. Journal Evaluation in Education, 6(1), 66–78. https://doi.org/10.37251/jee.v6i1.1273

Juliyantika, T., & Batubara, H. H. (2022). Tren penelitian keterampilan berpikir kritis pada jurnal pendidikan dasar di Indonesia. Jurnal Basicedu, 6(3), 4731–4744. https://doi.org/10.31004/basicedu.v6i3.2869

Kim, Y. H., Kim, B. H., Kim, J., Jung, B., & Bae, S. (2023). Item difficulty index, discrimination index, and reliability of the 26 health professions licensing examinations in 2022, Korea: A psychometric study. Journal of Educational Evaluation for Health Professions, 20, 31. https://doi.org/10.3352/jeehp.2023.20.31

Kusuma, A. S. H. M. (2023). Correlation in biological literacy and critical thinking skills of science students through problem-based learning model integrated by Macromedia Flash. Jurnal Pijar MIPA, 18(3), 369–375. https://doi.org/10.29303/jpm.v18i3.4928

Lase, D. (2019). Pendidikan di era revolusi industri 4.0. Sundermann: Jurnal Ilmiah Teologi, Pendidikan, Sains, Humaniora dan Kebudayaan, 12(2), 28–43. https://doi.org/10.36588/sundermann.v1i1.18

Lestari, P., & Widodo, A. (2021). Developing critical thinking skills through science literacy-based learning. Journal of Physics: Conference Series, 1806, 012106. https://doi.org/10.1088/1742-6596/1806/1/012106

Lina, Y. R., Helendra, H., & Arsih, F. (2018). Pengembangan instrumen asesmen berbasis literasi sains tentang materi sistem pencernaan makanan, zat aditif, dan zat adiktif untuk SMP. Bioeducation Journal, 2(2), 145–155. https://doi.org/10.24036/bioedu.v2i2.73

Listiani, I., Susilo, H., & Sueb, S. (2022). Relationship between scientific literacy and critical thinking of prospective teachers. AL-ISHLAH: Jurnal Pendidikan, 14(1), 721–730. https://doi.org/10.35445/alishlah.v14i1.1355

Mahrunnisya, D. (2023). Keterampilan pembelajar di abad ke-21. JUPENJI: Jurnal Pendidikan Jompa Indonesia, 2(1), 101–109. https://doi.org/10.57218/jupenji.Vol2.Iss1.598

Mardhiyah, R. H., Aldriani, S. N. F., Chitta, F., & Zulfikar, M. R. (2021). Pentingnya keterampilan belajar di abad 21 sebagai tuntutan dalam pengembangan sumber daya manusia. Lectura: Jurnal Pendidikan, 12(1), 29–40. https://doi.org/10.31849/lectura.v12i1.5813

Masithoh, N. D., & Jauhariyah, M. N. R. (2024). Analisis profil kompetensi literasi sains peserta didik yang diukur menggunakan instrumen berbasis kelas pada materi energi terbarukan. Inovasi Pendidikan Fisika, 13(3), 184–190. https://doi.org/10.26740/ipf.v13n3.p184-190

Mulyani, A. Y. (2022). Pengembangan critical thinking dalam peningkatan mutu pendidikan di Indonesia. DIAJAR: Jurnal Pendidikan dan Pembelajaran, 1(1), 100–105. https://doi.org/10.54259/diajar.v1i1.226

OECD. (2019). PISA 2018 results (Volume I): What students know and can do. Paris, France: OECD Publishing. https://doi.org/10.1787/5f07c754-en

OECD. (2023). PISA 2025 science framework. Retrieved from https://pisa-framework.oecd.org/science-2025/

Paul, R., & Elder, L. (2019). The miniature guide to critical thinking: Concepts and tools. Tomales, CA: Foundation for Critical Thinking.

Pertiwi, N. P., Saputro, S., Yamtinah, S., & Kamari, A. (2024). Enhancing critical thinking skills through STEM problem-based contextual learning: An integrated e-module education website with virtual experiments. Journal of Baltic Science Education, 23(4), 739–766. https://doi.org/10.33225/jbse/24.23.739

Pitorini, D. E., Suciati, S., & Harlita, H. (2024). Students’ critical thinking skills using an e-module based on problem-based learning combined with Socratic dialogue. Journal of Learning for Development, 11(1), 52–65. https://doi.org/10.56059/jl4d.v11i1.1014

Rahayuni, G. (2016). Hubungan keterampilan berpikir kritis dan literasi sains pada pembelajaran IPA terpadu dengan model PBM dan STM. Jurnal Penelitian dan Pembelajaran IPA, 2(2), 131–146. https://doi.org/10.30870/jppi.v2i2.926

Rajagukguk, M. J. T., & Naibaho, D. (2023). Mampu memilih soal berdasarkan tingkat kesukaran. Jurnal Pendidikan Sosial dan Humaniora, 2(4), 12736–12747.

Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The quality of test instruments constructed by teachers in Bima Regency, Indonesia: Document analysis. International Journal of Instruction, 13(2), 507–518. https://doi.org/10.29333/iji.2020.13235a

Ramadhani, F. A., & Nurita, T. (2022). The critical thinking skills of junior high school student on simple machines material. International Journal of Education and Teaching Zone, 1(2), 59–67. https://doi.org/10.57092/ijetz.v1i2.29

Rezigalla, A. A., Eleragi, A. M. S., Elhassan, A. M., & Isa, A. (2024). Item analysis: The impact of distractor efficiency on the difficulty index and discrimination power of multiple-choice items. BMC Medical Education, 24, 445. https://doi.org/10.1186/s12909-024-05433-y

Riduwan. (2013). Skala pengukuran variabel-variabel penelitian. Bandung, Indonesia: Alfabeta.

Rosmana, P. S., Iskandar, S., Fauziah, H., Azzifah, N., & Khamelia, W. (2022). Kebebasan dalam kurikulum prototype. AS-SABIQUN, 4(1), 115–131. https://doi.org/10.36088/assabiqun.v4i1.1683

Sarwanto, S., Fajari, L. E. W., & Chumdari, C. (2021). Open-ended questions to assess critical-thinking skills in Indonesian elementary school. International Journal of Instruction, 14(1), 615–630. https://doi.org/10.29333/iji.2021.14137a

Sugiyono. (2017). Metode penelitian dan pengembangan: Research and development. Bandung, Indonesia: Alfabeta.

Sugiyono. (2022). Metode penelitian kuantitatif, kualitatif, dan R&D. Bandung, Indonesia: Alfabeta.

Yusmar, F., & Fadilah, R. E. (2023). Analisis rendahnya literasi sains peserta didik Indonesia: Hasil PISA dan faktor penyebab. Lensa: Jurnal Kependidikan Fisika, 13(1), 11–19. https://doi.org/10.24929/lensa.v13i1.283

Zhao, C., Pandian, A., Kaur, M., & Singh, M. (2016). Instructional strategies for developing critical thinking in EFL classrooms. English Language Teaching, 9(10), 14–21. https://doi.org/10.5539/elt.v9n10p14