Exploring ChatGPT's Role in Language Learning Assessment: A Two-Year Bibliometric Analysis

Authors

  • Gulnoza Sabirova

    Teaching Theory and Methodology Department, Tashkent Institute of Irrigation and Agricultural Mechanization Engineers, National Research University, Tashkent 101000, Uzbekistan
  • Lola Shasaidova

    Chinese Philology Department, The Uzbek State University of World Languages, Tashkent 100170, Uzbekistan
  • Madina Nazarova

    English Language Department, University of World Economy and Diplomacy, Tashkent 100007, Uzbekistan
  • Nodira Isamukhamedova

    Global Education Department, Westminster International University in Tashkent, Tashkent 100047, Uzbekistan

DOI:

https://doi.org/10.30564/fls.v7i8.10340
Received: 4 June 2025 | Revised: 19 June 2025 | Accepted: 25 June 2025 | Published Online: 25 August 2025

Abstract

ChatGPT is changing the way we test language more and more by using advanced deep learning models that mimic how people talk to each other. These models, especially large language models (LLMs), can understand, create, and evaluate natural language. This makes them very useful for educational evaluation. This report looks at how ChatGPT is changing the way we evaluate things by looking at academic articles from 2023 to 2024. We used the Web of Science database to carefully choose 350 peer-reviewed articles that looked at worldwide research trends. Bibliometric technologies like VOSviewer and Biblioshiny were used to find important changes in the field. These technologies made it possible to see how publication patterns, co-authorship networks, and the development of thematic trends relating to the function of ChatGPT in education have changed over time. The results showed a number of important things. First, the United States, China, and the United Kingdom were the top contributors to this sector. This shows that institutions and governments in these countries are very interested in using AI language models in education. Second, Elyoseph Z. and Levkovich I. were two of the most numerous writers who contributed to the discussion around AI-driven assessment. Some of the most well-known journals that published this research are JMIR Medical Education, Journal of Medical Internet Research, JMIR Formative Research, and Education Sciences. The keyword co-occurrence analysis showed that words like "Chatgpt," "assessment," and "artificial intelligence" are used a lot, which strengthens the connection between computational linguistics and educational evaluation.

Keywords:

ChatGPT; Bibliometric Analysis; Review; Artificial Intelligence in Education; Language Assessment; Formative and Summative Assessment; Multilingual Learning

References

[1] Mavropoulou, E., Arvanitis, P., 2024. Leveraging Artificial Intelligence to Enhance Oral Communicative Skills in French Language Education. EQR. 7(4). Available from: https://www.asianinstituteofresearch.org/EQRarchives/leveraging-artificial-intelligence-to-enhance-oral-communicative-skills-in-french-language-education

[2] Owan, V.J., Abang, K.B., Idika, D.O., et al., 2023. Exploring the potential of artificial intelligence tools in educational measurement and assessment. EURASIA Journal of Mathematics, Science and Technology Education. 19(8), em2307. DOI: https://doi.org/10.29333/ejmste/13428

[3] Yang, H., Gao, C., Shen, H.Z., 2024. Learner interaction with, and response to, AI-programmed automated writing evaluation feedback in EFL writing: An exploratory study. Education and Information Technologies. 29(4), 3837–3858. DOI: https://doi.org/10.1007/s10639-023-11991-3

[4] Lachini, K., 2025. Rethinking Language Assessment in the Age of AI: A Call for a Paradigm Shift. Available from: https://www.ssrn.com/abstract=5043405 (cited 9 June 2025).

[5] Neupane, B.P., Paudel, P., Dahal, N., et al., 2025. English Language Teaching in the Age of Artificial Intelligence: Tools, Techniques, and Methodologies. Advances in Mobile Learning Educational Research. 5(1), 1356–1369. DOI: https://doi.org/10.25082/AMLER.2025.01.011

[6] Zhai, C., Wibowo, S., Li, L.D., 2024. Evaluating the AI dialogue System's intercultural, humorous, and empathetic dimensions in English language learning: A case study. Computers and Education: Artificial Intelligence. 7, 100262. DOI: https://doi.org/10.1016/j.caeai.2024.100262

[7] Cotton, D.R.E., Cotton, P.A., Shipway, J.R., 2024. Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International. 61(2), 228–239. DOI: https://doi.org/10.1080/14703297.2023.2190148

[8] Zhao, Y., 2025. Artificial Intelligence and Education: End the Grammar of Schooling. ECNU Review of Education. 8(1), 3–20. DOI: https://doi.org/10.1177/20965311241265124

[9] Khan, M.A., Kurbonova, O., Abdullaev, D., et al., 2024. Is AI-assisted assessment liable to evaluate young learners? Parents support, teacher support, immunity, and resilience are in focus in testing vocabulary learning. Language Testing in Asia. 14(1), 48. DOI: https://doi.org/10.1186/s40468-024-00324-x

[10] Tian, Z., Wang, C., 2025. Rethinking Language Education in the Age of Generative AI, 1st ed. Routledge: New York, NY, USA. Available from: https://www.taylorfrancis.com/books/9781003426929

[11] Lavidas, K., Voulgari, I., Papadakis, S., et al., 2024. Determinants of Humanities and Social Sciences Students' Intentions to Use Artificial Intelligence Applications for Academic Purposes. Information. 15(6), 314. DOI: https://doi.org/10.3390/info15060314

[12] Aravantinos, S., Lavidas, K., Voulgari, I., et al., 2024. Educational Approaches with AI in Primary School Settings: A Systematic Review of the Literature Available in Scopus. Education Sciences. 14(7), 744. DOI: https://doi.org/10.3390/educsci14070744

[13] Uğraş, H., Uğraş, M., Papadakis, S., et al., 2025. Innovative Early Childhood STEM Education with ChatGPT: Teacher Perspectives. Tech Know Learn. 30(2), 809–831. DOI: https://doi.org/10.1007/s10758-024-09804-8

[14] Page, M.J., McKenzie, J.E., Bossuyt, P.M., et al., 2021. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews. BMJ. 372, n71. DOI: https://doi.org/10.1136/bmj.n71

[15] Mardieva, D., Bakiyeva, G., Kannazarova, Z., et al., 2024. A Bibliometric Review: Interventions for Enhancing Speaking Skills in Non-English-Speaking Contexts. XL. 17(4), 195–224. DOI: https://doi.org/10.30564/fls.v7i7.10284

[16] Elyoseph, Z., Hadar-Shoval, D., Asraf, K., et al., 2023. ChatGPT Outperforms Humans in Emotional Awareness Evaluations. Front Psychol. 14, 1199058. DOI: https://doi.org/10.3389/fpsyg.2023.1199058

[17] Elyoseph, Z., Levkovich, I., 2023. Beyond Human Expertise: The Promise and Limitations of ChatGPT in Suicide Risk Assessment. Front Psychiatry. 14, 1213141. DOI: https://doi.org/10.3389/fpsyt.2023.1213141

[18] Levkovich, I., Elyoseph, Z., 2023. Suicide Risk Assessments Through the Eyes of ChatGPT-3.5 Versus ChatGPT-4: Vignette Study. JMIR Ment Health. 10, e51232. DOI: https://doi.org/10.2196/51232

[19] Shinan-Altman, S., Elyoseph, Z., Levkovich, I., 2024. The Impact of History of Depression and Access to Weapons on Suicide Risk Assessment: A Comparison of ChatGPT-3.5 and ChatGPT-4. PeerJ. 12, e17468. DOI: https://doi.org/10.7717/peerj.17468

[20] Nouri, A., Cabrero-Daniel, B., Torner, F., et al., 2024. Welcome Your New AI Teammate: On Safety Analysis by Leashing Large Language Models. In Proceedings of the IEEE/ACM 3rd International Conference on AI Engineering - Software Engineering for AI, Lisbon, Portugal, 15–19 April 2024; pp. 172–177. DOI: https://doi.org/10.1145/3644815.3644953

[21] Nouri, A., Cabrero-Daniel, B., Törner, F., et al., 2024. Engineering Safety Requirements for Autonomous Driving with Large Language Models. In Proceedings of the 2024 IEEE 32nd International Requirements Engineering Conference (RE), Reykjavik, Iceland, 12–16 August 2024; pp. 218–228. Available from: https://ieeexplore.ieee.org/document/10628478/

[22] Strunga, M., Urban, R., Surovková, J., et al., 2023. Artificial Intelligence Systems Assisting in the Assessment of the Course and Retention of Orthodontic Treatment. Healthcare. 11(5), 683. DOI: https://doi.org/10.3390/healthcare11050683

[23] Surovková, J., Haluzová, S., Strunga, M., et al., 2023. The New Role of the Dental Assistant and Nurse in the Age of Advanced Artificial Intelligence in Telehealth Orthodontic Care with Dental Monitoring: Preliminary Report. Applied Sciences. 13(8), 5212. DOI: https://doi.org/10.3390/app13085212

[24] Rudolph, J., Tan, S., Tan, S., 2023. ChatGPT: Bullshit Spewer or the End of Traditional Assessments in Higher Education? Journal of Applied Learning and Teaching. 6, 342–363. DOI: https://doi.org/10.37074/jalt.2023.6.1.9

[25] Kung, T.H., Cheatham, M., Medenilla, A., et al., 2023. Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models. PLOS Digit Health. 2(2), e0000198. DOI: https://doi.org/10.1371/journal.pdig.0000198

[26] Kasneci, E., Sessler, K., Küchemann, S., et al., 2023. ChatGPT for good? On opportunities and challenges of large language models for education, Learning and Individual Differences. 103, 102274. DOI: https://doi.org/10.1016/j.lindif.2023.102274

[27] Sallam, M., 2023. ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns. Healthcare (Basel). 11(6), 887. DOI: https://doi.org/10.3390/healthcare11060887.

[28] Alkaissi, H., McFarlane, S.I., 2023. Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus. 15(2), e35179. DOI: https://doi.org/10.7759/cureus.35179

[29] Eltobgy, A.E., Abaza, W., Abd, Y., 2024. Evaluating the Effectiveness of ChatGPT in Enhancing Cognitive Learning Outcomes in Tourism Higher Education Based on Biggs's 3P Model. Journal of Association of Arab Universities for Tourism and Hospitality. 27(1), 256–276. DOI: https://doi.org/10.21608/jaauth.2024.320773.1608

[30] Cain, J., Rajan, A.S., 2024. Proof of Concept of ChatGPT as a Virtual Tutor. Am J Pharm Educ. 88(12), 101333. DOI: https://doi.org/10.1016/j.ajpe.2024.101333

[31] Al Shloul, T., Mazhar, T., Abbas, Q., et al., 2024. Role of activity-based learning and ChatGPT on students' performance in education. Computers and Education: Artificial Intelligence. 6, 100219. DOI: https://doi.org/10.1016/j.caeai.2024.100219

[32] Samala, A.D., Sokolova, E.V., Grassini, S., et al., 2024. ChatGPT: A Bibliometric Analysis and Visualization of Emerging Educational Trends, Challenges, and Applications. International Journal of Educational Research and Evaluation (IJERE). 13(4), 2374. DOI: http://doi.org/10.11591/ijere.v13i4.28119

[33] Von Garrel, J., Mayer, J., 2023. Artificial Intelligence in Studies—Use of ChatGPT and AI-Based Tools Among Students in Germany. Humanities and Social Sciences Communications. 10(1), 799. DOI: https://doi.org/10.1057/s41599-023-02304-7

[34] Borges, B., Foroutan, N., Bayazit, D., et al., 2024. Could ChatGPT Get an Engineering Degree? Evaluating Higher Education Vulnerability to AI Assistants. Proceedings of the National Academy of Sciences (PNAS). 121(49), e2414955121. DOI: https://doi.org/10.1073/pnas.2414955121

[35] Ganjavi, C., Eppler, M., O'Brien, D., et al., 2024. ChatGPT and Large Language Models (LLMs) Awareness and Use: A Prospective Cross-Sectional Survey of U.S. Medical Students. PLOS Digital Health. 3(9), e0000596. DOI: https://doi.org/10.1371/journal.pdig.0000596

Downloads

How to Cite

Sabirova, G., Shasaidova, L., Nazarova, M., & Isamukhamedova, N. (2025). Exploring ChatGPT’s Role in Language Learning Assessment: A Two-Year Bibliometric Analysis. Forum for Linguistic Studies, 7(8), 1151–1165. https://doi.org/10.30564/fls.v7i8.10340

Issue

Vol. 7 , Iss. 8 (August 2025)

Article Type

Review

License

Copyright © 2025 Gulnoza Sabirova, Lola Shasaidova, Madina Nazarova, Nodira Isamukhamedova

Creative Commons License

This is an open access article under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) License.