THE INFLUENCE OF ARTIFICIAL INTELLIGENCE (AI) CHATBOTS ON LEARNING INDEPENDENCE AND MATHEMATICAL CRITICAL THINKING SKILLS

DOI: https://doi.org/10.30605/a8w7vq59

Authors

AI Chatbot; Learning Independence; Mathematical Critical Thinking; Mathematics Education; Digital Learning

Abstract

The puprpose of this study to examine how students’ learning independence and mathematical critical thinking abilities are affected by artificial intelligence (AI) chatbots, particularly ChatGPT and Hemini AI though there is now little empirical data on AI’s dual efects on the affective and cognitive domains of mathematics its integration into education seems unavoidable. This study used a pretest-posttest control group in a quasi-experimental design. Purposive sampling was used to choose the 60 eleventh-grade students (30 in the experimental class and 30 in the control class) from a senior high school in Sorong, Indonesia. The tools included a 5-item mathematics critical thinking essay test based on Facione's indicators (validity 0.82, reliability 0.84) and a 20-item learning independence questionnaire (Likert scale, Cronbach's Alpha = 0.86). Using SPSS 26.0, the normality test (Shapiro-Wilk), homogeneity test (Levene), independent sample t-test, and N-Gain score were used to analyse the data. The experimental and control groups differed significantly, according to the data. With p <.001, the experimental class's learning independence posttest mean (M=85.40, SD=5.12) was higher than the control class's (M=72.15, SD=6.03). In a similar vein, the experimental class did better in mathematical critical thinking (M=82.67, SD=6.21) than the control class (M=68.90, SD=7.11). The experimental group's N-Gain score was 0.72 (high category), but the control group's score was 0.38 (middle category). This study offers empirical proof that, when combined with appropriate instructional design and ethical supervision, AI chatbots can be a useful pedagogical tool to promote self-directed learning and critical thinking. The results suggest that rather than using AI chatbots to replace critical thinking, math teachers should use them as a scaffolding tool.

Downloads

Download data is not yet available.

References

Facione, P. A. (2020). Critical thinking: What it is and why it counts. Insight Assessment. https://www.insightassessment.com

Firmansyah, E., et al. (2025). Comparative sensitivity of essay vs. multiple-choice tests in measuring critical thinking after AI intervention. Al-Jabar: Jurnal Pendidikan Matematika, 16(1), 77-92.

Hake, R. R. (1999). Analyzing change/gain scores. American Educational Research Association. https://doi.org/10.1119/1.18809

Hidayat, R., & Saputra, R. (2023). Self-regulated learning in mathematics education: A systematic literature review. Journal on Mathematics Education, 14(2), 321-340. https://doi.org/10.22342/jme.v14i2.pp321-340

Hwang, G. J., & Chang, C. Y. (2023). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615

Kasneci, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274

Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410

Lestari, P., et al. (2024). Assessment of critical thinking skills in Eastern Indonesia: Challenges and instrument development. Beta: Jurnal Tadris Matematika, 17(1), 56-72.

Nurjanah, S., et al. (2023). Development of a self-regulated learning questionnaire based on Zimmerman's theory for junior high school students. Jurnal Elemen, 9(2), 210-225.

Pratiwi, D., & Hidayah, N. (2024). Measuring learning independence in the AI era: Adaptation of Zimmerman indicators. International Journal of Instruction, 17(2), 112-130.

Putra, F. G., & Andriani, S. (2024). The effect of Socratic Chatbot on students' mathematical critical thinking. Al-Jabar: Jurnal Pendidikan Matematika, 15(1), 45-58. https://doi.org/10.24042/ajpm.v15i1.12345

Rahayu, L., & Setiawan, A. (2023). Validity and reliability of mathematical critical thinking essay test based on Facione framework. Jurnal Pendidikan Matematika Indonesia, 8(1), 34-46.

Sukmawati, R., et al. (2024). AI Chatbot for enhancing learning independence in Indonesian higher education. Jurnal Teknologi Pendidikan, 26(1), 12-25. https://doi.org/10.21009/jtp.v26i1.12345

Utami, R., et al. (2025). Psychometric evaluation of learning independence instruments in digital mathematics learning. Jurnal Riset Pendidikan Matematika, 12(1), 15-29.

Wardat, Y., et al. (2023). ChatGPT in mathematics education: An analysis of its capabilities and limitations. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2309. https://doi.org/10.29333/ejmste/13458

Zimmerman, B. J. (2015). Self-regulated learning: Theories, measures, and outcomes. In International Encyclopedia of the Social & Behavioral Sciences. Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.26060-1

Downloads

Published

2026-11-17

How to Cite

THE INFLUENCE OF ARTIFICIAL INTELLIGENCE (AI) CHATBOTS ON LEARNING INDEPENDENCE AND MATHEMATICAL CRITICAL THINKING SKILLS. (2026). Pedagogy: Jurnal Pendidikan Matematika, 11(4), 757-771. https://doi.org/10.30605/a8w7vq59