Measuring the impact of ChatGPT in enhancing number sense acquisition: A mixed-method study
DOI:
https://doi.org/10.29408/jel.v11i2.27842Keywords:
ChatGPT, learning outcomes, mathematics, studentsAbstract
The effectiveness of ChatGPT in enhancing mathematics learning outcomes for students remains a topic of debate despite its growing application in educational settings. This study seeks to assess the impact of ChatGPT on students' understanding of number concepts in mathematics, particularly for 7th-grade junior high school students, by employing a combination of classroom experiments and a control group while gathering students' perspectives on its use. In a mixed-method approach, the quantitative findings indicate that ChatGPT usage does not significantly improve students' academic performance in number concepts. However, qualitative insights from the classroom experiments reveal that students perceived several benefits, such as increased efficiency in studying, better comprehension of number-related problems, enhanced accuracy in solving problems, and assistance in overcoming learning challenges. While ChatGPT did not directly affect academic outcomes, it was found to be a valuable supplementary tool in the learning process. Based on these findings, this study recommends that educators consider incorporating ChatGPT to complement traditional teaching methods to enhance the overall learning experience of number concepts.
References
Abah, J. (2020). An appeal in the case involving conventional teaching: Emphasizing the transformation to enhanced conventional teaching in mathematics education. VillageMath Educational Review (VER), 1(1), 1–10. https://doi.org/10.5281/zenodo.3860320
Abdulla, S., Ismail, S., Fawzy, Y., & Elhaj, A. (2024). Using ChatGPT in teaching computer programming and studying its impact on students performance. Electronic Journal of E-Learning, 22(6), 66–81. https://doi.org/10.34190/EJEL.22.6.3380
Almulla, M., & Ali, S. I. (2024). The changing educational landscape for sustainable online experiences: Implications of ChatGPT in Arab Students’ learning experience. International Journal of Learning, Teaching and Educational Research, 23(9), 285–306. https://doi.org/10.26803/ijlter.23.9.15
Alneyadi, S., & Wardat, Y. (2023). ChatGPT: Revolutionizing student achievement in the electronic magnetism unit for eleventh-grade students in Emirates schools. Contemporary Educational Technology, 15(4), ep448. https://doi.org/10.30935/cedtech/13417
Bashir, S. (2023). Pedagogy of Mathematics. International Journal of Basic Sciences and Applied Computing, 10(2), 1–8. https://doi.org/10.35940/ijbsac.b1159.1010223
Bergman, M. M. (2008). Introduction: Whither mixed methods? Sage publications.
Campbell, D. T., & Stanley, J. C. (2015). Experimental and quasi-experimental designs for research. Ravenio books.
Cascella, M., Montomoli, J., Bellini, V., & Bignami, E. (2023). Evaluating the feasibility of ChatGPT in healthcare: An analysis of multiple clinical and research scenarios. Journal of Medical Systems, 47(1), 1-5. https://doi.org/10.1007/s10916-023-01925-4
Celik, I., Gedrimiene, E., Siklander, S., & Muukkonen, H. (2024). The affordances of artificial intelligence-based tools for supporting 21st-century skills: A systematic review of empirical research in higher education. Australasian Journal of Educational Technology, SE-Articles. https://doi.org/10.14742/ajet.9069
Charles, R. I., & Carmel, C. A. (2005). Big ideas and understandings as the foundation for elementary and middle school mathematics. Journal of Mathematics Education, 7(3), 9–24.
Creswell, J. W., Plano Clark, V. L., & Garrett, A. L. (2008). Methodological issues in conducting mixed methods research designs. Advances in Mixed Methods Research, 1(1), 66–83.
Forman, J., & Damschroder, L. (2007). Qualitative content analysis. In Empirical methods for bioethics: A primer (pp. 39–62). Emerald Group Publishing Limited.
Frieder, S., Pinchetti, L., Chevalier, A., Griffiths, R.-R., Salvatori, T., Lukasiewicz, T., Petersen, P. C., & Berner, J. (2023). Mathematical Capabilities of ChatGPT. http://arxiv.org/abs/2301.13867
Gómez Cano, C. A., & Colala Troya, A. L. (2023). Artificial Intelligence applied to teaching and learning processes. LatIA, 1, 2. https://doi.org/10.62486/latia20232
Goos, M., Vale, C., Stillman, G., Makar, K., Herbert, S., & Geiger, V. (2020). Teaching secondary school mathematics: Research and practice for the 21st century. Routledge.
Hemmi, K., Krzywacki, H., & Liljekvist, Y. (2019). Challenging traditional classroom practices: Swedish teachers’ interplay with Finnish curriculum materials. Journal of Curriculum Studies, 51(3), 342–361.
Lapan, R. T., Gysbers, N. C., & Petroski, G. F. (2001). Helping seventh graders be safe and successful: A statewide study of the impact of comprehensive guidance and counseling programs. Journal of Counseling & Development, 79(3), 320–330. https://doi.org/10.1002/j.1556-6676.2001.tb01977.x
Lee, J., & Paul, N. (2023). A review of pedagogical approaches for improved engagement and learning outcomes in mathematics. Journal of Student Research, 12(3), 1–9. https://doi.org/10.47611/jsrhs.v12i3.5021
Leelavathi, R., & Surendhranatha, R. C. (2024). ChatGPT in the classroom: navigating the generative AI wave in management education. Journal of Research in Innovative Teaching & Learning, ahead-of-p(ahead-of-print). https://doi.org/10.1108/JRIT-01-2024-0017
Mishra, P., Singh, U., Pandey, C. M., Mishra, P., & Pandey, G. (2019). Application of student’s t-test, analysis of variance, and covariance. Annals of Cardiac Anaesthesia, 22(4), 407.
Rane, N. (2023). Enhancing mathematical capabilities through ChatGPT and similar generative artificial intelligence: roles and challenges in solving Mathematical Problems. SSRN Electronic Journal, December. https://doi.org/10.2139/ssrn.4603237
Remoto, J. P. (2024). ChatGPT and other AIs: Personal relief and limitations among mathematics-oriented learners. Environment and Social Psychology, 9(1), 1–13. https://doi.org/10.54517/esp.v9i1.1911
Resnick, L. Β. (2020). From protoquantities to operators: Building mathematical competence on a foundation of everyday knowledge. In Analysis of arithmetic for mathematics teaching (pp. 373–429). Routledge.
Rudolph Jürgen, Tan Samson, Tan, S. (2023). Journal of Applied Learning & Teaching ChatGPT : Bullshit spewer or the end of traditional assessments in higher education ? Journal of Applied Learning & Teaching, 6(1), 242–263. https://doi.org/10.37074/jalt.2023.6.1.9
Sánchez-Ruiz, L. M., Moll-López, S., Nuñez-Pérez, A., Moraño-Fernández, J. A., & Vega-Fleitas, E. (2023). ChatGPT Challenges Blended Learning Methodologies in Engineering Education: A Case Study in Mathematics. Applied Sciences (Switzerland), 13(10). https://doi.org/10.3390/app13106039
Silitonga, L. M., Wiyaka, Suciati, S., & Prastikawati, E. F. (2024). The impact of integrating AI Chatbots and microlearning into flipped classrooms: enhancing students’ motivation and higher-order thinking skills BT - innovative technologies and learning (Y.-P. Cheng, M. Pedaste, E. Bardone, & Y.-M. Huang (eds.); pp. 184–193). Springer Nature Switzerland.
Sowder, J. T. (2020). Making sense of numbers in school mathematics. In Analysis of arithmetic for mathematics teaching (pp. 1–51). Routledge.
Tang, T., Sha, J., Zhao, Y., Wang, S., Wang, Z., & Shen, S. (2024). Unveiling the efficacy of ChatGPT in evaluating critical thinking skills through peer feedback analysis: Leveraging existing classification criteria. Thinking Skills and Creativity, 53, 101607. https://doi.org/10.1016/j.tsc.2024.101607
Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1), 15. https://doi.org/10.1186/s40561-023-00237-x
Wardat, Y., Tashtoush, M. A., AlAli, R., & Jarrah, A. M. (2023). ChatGPT: A revolutionary tool for teaching and learning mathematics. Eurasia Journal of Mathematics, Science and Technology Education, 19(7), em2286. https://doi.org/10.29333/ejmste/13272
Wijaya, A., van den Heuvel-Panhuizen, M., & Doorman, M. (2015). Opportunity-to-learn context-based tasks provided by mathematics textbooks. Educational Studies in Mathematics, 89, 41–65.
Xue, Y., Chen, H., Bai, G. R., Tairas, R., & Huang, Y. (2024). Does ChatGPT help with introductory programming? an experiment of students using ChatGPT in CS1. Proceedings - International Conference on Software Engineering, 331–341. https://doi.org/10.1145/3639474.3640076
Zalima, E. I., Njanji, F. P., Lasmiatik, L., Agustina, L., Dela, M., & Ambarawati, M. (2020). Analysis of students’ difficulties in solving word problems on arithmetic operations with mixed Fractions [in Bahasa]. Prismatika: Jurnal Pendidikan dan Riset Matematika, 2(2), 46–54.
Zhou, L., & Li, J. (2023). The impact of ChatGPT on learning motivation: A study based on self-determination theory. Education Science and Management, 1(1), 19–29. https://doi.org/10.56578/esm010103
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Kadir, Gita Fajrin Jafar, Benjamin B. Mangila
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with the Jurnal Elemen agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).
- Authors are able to enter into separate, additional contractual arrangements for the distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.
Jurnal Elemen is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License
