THE INFLUENCE OF ARTIFICIAL INTELLIGENCE (AI) CHATBOTS ON LEARNING INDEPENDENCE AND MATHEMATICAL CRITICAL THINKING SKILLS
DOI: https://doi.org/10.30605/a8w7vq59
AI Chatbot; Learning Independence; Mathematical Critical Thinking; Mathematics Education; Digital Learning
Abstract
The puprpose of this study to examine how students’ learning independence and mathematical critical thinking abilities are affected by artificial intelligence (AI) chatbots, particularly ChatGPT and Hemini AI though there is now little empirical data on AI’s dual efects on the affective and cognitive domains of mathematics its integration into education seems unavoidable. This study used a pretest-posttest control group in a quasi-experimental design. Purposive sampling was used to choose the 60 eleventh-grade students (30 in the experimental class and 30 in the control class) from a senior high school in Sorong, Indonesia. The tools included a 5-item mathematics critical thinking essay test based on Facione's indicators (validity 0.82, reliability 0.84) and a 20-item learning independence questionnaire (Likert scale, Cronbach's Alpha = 0.86). Using SPSS 26.0, the normality test (Shapiro-Wilk), homogeneity test (Levene), independent sample t-test, and N-Gain score were used to analyse the data. The experimental and control groups differed significantly, according to the data. With p <.001, the experimental class's learning independence posttest mean (M=85.40, SD=5.12) was higher than the control class's (M=72.15, SD=6.03). In a similar vein, the experimental class did better in mathematical critical thinking (M=82.67, SD=6.21) than the control class (M=68.90, SD=7.11). The experimental group's N-Gain score was 0.72 (high category), but the control group's score was 0.38 (middle category). This study offers empirical proof that, when combined with appropriate instructional design and ethical supervision, AI chatbots can be a useful pedagogical tool to promote self-directed learning and critical thinking. The results suggest that rather than using AI chatbots to replace critical thinking, math teachers should use them as a scaffolding tool.
Downloads
References
Facione, P. A. (2020). Critical thinking: What it is and why it counts. Insight Assessment. https://www.insightassessment.com
Firmansyah, E., et al. (2025). Comparative sensitivity of essay vs. multiple-choice tests in measuring critical thinking after AI intervention. Al-Jabar: Jurnal Pendidikan Matematika, 16(1), 77-92.
Hake, R. R. (1999). Analyzing change/gain scores. American Educational Research Association. https://doi.org/10.1119/1.18809
Hidayat, R., & Saputra, R. (2023). Self-regulated learning in mathematics education: A systematic literature review. Journal on Mathematics Education, 14(2), 321-340. https://doi.org/10.22342/jme.v14i2.pp321-340
Hwang, G. J., & Chang, C. Y. (2023). A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112. https://doi.org/10.1080/10494820.2021.1952615
Kasneci, E., et al. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/j.lindif.2023.102274
Lo, C. K. (2023). What is the impact of ChatGPT on education? A rapid review of the literature. Education Sciences, 13(4), 410. https://doi.org/10.3390/educsci13040410
Lestari, P., et al. (2024). Assessment of critical thinking skills in Eastern Indonesia: Challenges and instrument development. Beta: Jurnal Tadris Matematika, 17(1), 56-72.
Nurjanah, S., et al. (2023). Development of a self-regulated learning questionnaire based on Zimmerman's theory for junior high school students. Jurnal Elemen, 9(2), 210-225.
Pratiwi, D., & Hidayah, N. (2024). Measuring learning independence in the AI era: Adaptation of Zimmerman indicators. International Journal of Instruction, 17(2), 112-130.
Putra, F. G., & Andriani, S. (2024). The effect of Socratic Chatbot on students' mathematical critical thinking. Al-Jabar: Jurnal Pendidikan Matematika, 15(1), 45-58. https://doi.org/10.24042/ajpm.v15i1.12345
Rahayu, L., & Setiawan, A. (2023). Validity and reliability of mathematical critical thinking essay test based on Facione framework. Jurnal Pendidikan Matematika Indonesia, 8(1), 34-46.
Sukmawati, R., et al. (2024). AI Chatbot for enhancing learning independence in Indonesian higher education. Jurnal Teknologi Pendidikan, 26(1), 12-25. https://doi.org/10.21009/jtp.v26i1.12345
Utami, R., et al. (2025). Psychometric evaluation of learning independence instruments in digital mathematics learning. Jurnal Riset Pendidikan Matematika, 12(1), 15-29.
Wardat, Y., et al. (2023). ChatGPT in mathematics education: An analysis of its capabilities and limitations. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2309. https://doi.org/10.29333/ejmste/13458
Zimmerman, B. J. (2015). Self-regulated learning: Theories, measures, and outcomes. In International Encyclopedia of the Social & Behavioral Sciences. Elsevier. https://doi.org/10.1016/B978-0-08-097086-8.26060-1
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Muhamad Ruslan Layn, Jenro P Sijabat

This work is licensed under a Creative Commons Attribution 4.0 International License.
In submitting the manuscript to the journal, the authors certify that:
- They are authorized by their co-authors to enter into these arrangements.
- The work described has not been formally published before, except in the form of an abstract or as part of a published lecture, review, thesis, or overlay journal.
- That it is not under consideration for publication elsewhere,
- That its publication has been approved by all the author(s) and by the responsible authorities – tacitly or explicitly – of the institutes where the work has been carried out.
- They secure the right to reproduce any material that has already been published or copyrighted elsewhere.
- They agree to the following license and copyright agreement.
License and Copyright Agreement
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under Creative Commons Attribution License (CC BY 4.0) that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.













