A Systematic Review of the Effects of Generative Artificial Intelligence Models (ChatGPT& Gemini) on English Language Teaching (ELT): Opportunities & Challenges

Document Type : research article

Authors

1 Department of English Language Teaching, Farhangian University,, Tehran, Iran.

2 Department of English Language Teaching, Farhangian University, Ardabil, Iran.

10.22059/jflr.2025.386926.1173

Abstract

Artificial intelligence has affected the field of education in many ways. The current research aimed to investigate the effects of generative artificial intelligence models (ChatGPT and Gemini) on English language teaching (ELT), and systematically reviewed 41 articles published in scientific journals that were published in 2023 and 2024 and the opportunities that these chatbots bring to teachers and language learners along with their challenges and limitations have been examined. By following the strict entry and selection criteria of articles and research standards, including inter-rater reliability (Cohen's Kappa coefficient = 0.81), articles were collected and analyzed from reliable international scientific research databases. The research findings showed that previous studies focused on four main themes: a) Effects and benefits of using generative artificial intelligence models in ELT, b) Challenges and limitations of using artificial intelligence models in ELT, c) The role of artificial intelligence models in evaluating and improving education in the field of ELT, and d) The necessity of training and support for the effective use of generative artificial intelligence models in ELT. Also, the results showed the benefits of using chatbots in teaching English and the challenges and limitations of using them. This systematic review can provide a clear perspective and practical recommendations on the integration of artificial intelligence in English language education and help policy makers and educational planners to make more informed decisions about the effects of generative artificial intelligence models in education. Meanwhile, this research can help design new teaching tools and methods that are specifically optimized for the needs of English language learners.

Keywords

Main Subjects


Alharbi, W. (2023). AI in the foreign language classroom: A pedagogical overview of automated writing assistance tools. Educational Research International,1–15. https://doi.org/10.1155/2023/4253331
Ali, D., Fatemi, Y., Boskabadi, E., Nikfar, M., Ugwuoke, J., & Ali, H. (2024). ChatGPT in Teaching and Learning: A Systematic Review. Education Sciences14(6), 643. https://doi.org/10.3390/educsci14060643
Ali, J. K. M. (2023). Benefits and challenges of using ChatGPT: An exploratory study on English language program. University of Bisha Journal for Humanities, 2(2). 629–641
Ali, J., Shamsan, M., A., A., Hezam, T. & Mohammed A. A. Q. (2023). Impact of ChatGPT on learning motivation: Teachers and students' voices. Journal of English Studies in Arabia Felix,2(1), 41–49. https://doi.org/10.56540/jesaf.v2i1.51
Al-Kaisi, A. N., Arkhangelskaya, A. L., & Rudenko-Morgun, O. I. (2019). Voice assistants as a training tool in a foreign language class. In INTED2019–13th international technology, education and development conference proceedings (pp. 1236–1246). https://doi.org/10.21125/inted.2019.0399.
Arefian, M. H., Çomoğlu, I., & Dikilitaş, K. (2024). Understanding EFL teachers’ experiences of ChatGPT-driven collaborative reflective practice through a community of practice lens. Innovation in Language Learning and Teaching, 1–16. https://doi.org/10.1080/17501229.2024.2412769
Aryal, Muna. (2024). Exploring the impact of ChatGPT in English language teaching-learning pedagogy. Journal of NELTA Gandaki. pp. 136–148. https://doi.org/10.3126/jong.v7i1-2.70236
Asgari Vaziri, Z. & Asgari Goudarzi, H. (2023). Application of AI in English language classes. The 15th National Conference on Law, Social and Human Sciences, Psychology and Counselling, Shirvan. (In Persian)
Badiah N. M. Alnasib, & Alharbi, N. S. (2024). Challenges and motivation: Assessing Gemini’s impact on undergraduate EFL students in classroom settings. World Journal of English Language, 14(5), 501–501. https://doi.org/10.5430/wjel.v14n5p501
Baleghizadeh, S. & Saeedi, M. (2024). The Impact of ChatGPT on Improving Feedback Process and Teaching English Writing Skill in Iran: An Innovative Approach. Journal of Foreign Language Research14(2), 327–343. https://doi.org/10.22059/jflr.2024.374891.1119
Bin, Y., & Mandal, D. (2019). English teaching practice based on artificial intelligence technology. Journal of Intelligent & Fuzzy Systems, 37(3), 3381–3391. https://doi.org/10.3233/JIFS-179141  
Castro, C.A. de (2023). A Discussion about the impact of ChatGPT in education: Benefits and concerns. Journal of Business Theory and Practice. 11(2), DOI: https://doi.org/10.22158/jbtp.v11n2p28
Chen, H. L., Vicki Widarso, G., & Sutrisno, H. (2020). A ChatBot for learning Chinese:  Learning achievement and technology acceptance. Journal of Educational Computing Research, 58(6), 1161–1189. https://doi.org/10.1177/0735633120929622
Chen, L., Chen, P., & Lin, A. (2020). Artificial Intelligence in Education: A Review. IEEE Access, 8, 75264–75278. https://doi.org/10.1109/access.2020.2988510
Ciechanowski, L., Przegalinska, A., Magnuski, M., & Gloor, P. (2019). “In the shades of the uncanny valley: An experimental study of human – chatbot interaction. Future Generation Computer Systems, 1–10. https://doi.org/10.1016/j.future.2018.01.055
Chiu, T. K. F. (2023). The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney. Interactive Learning Environments, 1–17. https://doi.org/10.1080/10494820.2023.2253861
Crompton, H., Edmett, A., Ichaporia, N., & Burke, D. (2024). AI and English language teaching: Affordances and challenges. British Journal of Educational Technology, 55, 2503–2529. https://doi.org/10.1111/bjet.13460
Derakhshan, A., & Ghiasvand, F. (2024). Is ChatGPT an evil or an angel for second language education and research? A phenomenographic study of research-active EFL teachers’ perceptions. International Journal of Applied Linguistics, 1–19. https://doi.org/10.1111/ijal.12561
Duy Anh, N. P. (2024). Gemini Google: A potential tool for english learning. Journal of Thu Dau Mot University, 6(03), 386–396. https://doi.org/10.37550/tdmu.ejs/2024.03.586
Ervani, M. H., Mir, A. & Sa’adatmand, D. (2023). A systematic review of the effects of AI in the world educational systems. New Advances in Psychology and Education, 16(74), 74–87. (In Persian)
Esfandiari, R., & Allaf-Akbary, O. (2024). The Role of ChatGPT-based instruction and Flipped language learning in metadiscourse use in EFL learners’ argumentative writing and their perceptions of the two instructional methods. Teaching English as a Second Language Quarterly (Formerly Journal of Teaching Language Skills), 43(3), 27–52. doi:https://doi.org/10.22099/tesl.2024.49975.3277
Faisal, E. (2024). Unlock the potential for Saudi Arabian higher education: A systematic review of the benefits of ChatGPT. Frontiers in Education, 9. doi: https://doi.org/10.3389/feduc.2024.1325601
Ferreiro-Santamaria, G. (2004). Exploring the role of ChatGPT in English teaching within higher education settings. International Journal of Trends and Developments in Education, 4(1), 445 DOI: https://doi.org/10.5281/zenodo.112047818
Gordani Y, Ejdehakosh A, & sedighi S. (2023). Integration of artificial intelligence chatbots in English language teaching and their impact on students' speaking skills and achievement motivation. Instutute of Educational Psychological and Social Research, 12 (46), 20–35. http://erj.khu.ac.ir/article-1-1379-en.html
Gough, D., Oliver, S., & Thomas, J. (2012). An introduction to systematic reviews. London: SAGE Publications.
Guan, C., Mou, J., & Jiang, Z. (2020). Artificial intelligence innovation in education: a twenty-year data-driven historical analysis. International Journal of Innovation Studies, 4(4), 134–147. https://doi.org/10.1016/j.ijis.2020.09.001
Guhan, M., & Chandramohan, S. (2023). A study on analyzing the role of ChatGPT in English acquisition among ESL learners during English language classroom. http://dx.doi.org/10.13140/RG.2.2.28252.56961
Guo, K., & Wang, D. (2024). To resist it or to embrace it? Examining ChatGPT’s potential to support teacher feedback in EFL writing. Education and Information Technologies, 29, 8435–8463. https://doi.org/10.1007/s10639-023-12146-0
Hani Omar, Hamza Abu Owida, Suhaila Abuowaida, Nawaf Alshdaifat, Raed Alazaidah, Esraa Elsoud, & Radwan Batyha. (2024). ChatGPT: A New AI Tool for English Language Teaching and Learning among Jordanian Students. Kurdish Studies, 12(1), 3628–3637. Retrieved from https://kurdishstudies.net/menuscript/index.php/KS/article/view/1647
Har, F. (2023). Teaching English as a second language in the midst of a paradigm shift: An exploration of students’ and teachers’ perception of ChatGPT. Educational Communications and Technology Yearbook, 21–35. https://doi.org/10.1007/978-981-99-7559-4_2
Haristiani, N. (2019). Artificial intelligence (AI) chatbot as language learning medium: An inquiry. Journal of Physics: Conference Series, 1387 012020. https://doi.org/10.1088/1742-6596/1387/1/012020
Hatwar, A., Patil, A., & Gondane, D. (2016). AI based chatbot. International Journal of Emerging Trends in Engineerig and Basic Sciences,3 (2), 85–87. https://ijeebs.com/wp-content/uploads/2020/09/NCRTCSIT16_IJEEBS_2016-V3-I2-015.pdf
Hou, Z. (2021). Research on adopting artificial intelligence technology to improve effectiveness of vocational college English learning. Journal of Physics: Conference Series, 1744 042122. https://doi.org/10.1088/1742-6596/1744/4/042122
Hsu, H. L., Chen, H. H. J., & Todd, A. G. (2023). Investigating the impact of the Amazon alexa on the development of L2 listening and speaking skills. Interactive Learning Environments, 31(9), 5732–5745.  https://doi.org/10.1080/10494820.2021.2016864
Hu, W.-C., & Škultéty, R. (2024). Unlocking the Learning Potential: ChatGPT as a Virtual Platform for Cross-Interaction in English Language, Learning. IEEE ICEIB 2024, 59. https://doi.org/10.3390/engproc2024074059
Huang, W. J., Hew, K. F., & Fryer, L. K. (2022). Chatbots for language learning—Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. https://doi.org/10. 1111/jcal.12610
Hwang, W.-Y., Nurtantyana, R., Purba, S. W. D., Hariyanti, U., Indrihapsari, Y., & Surjono, H. D. (2023). AI and recognition technologies to facilitate English as foreign language writing for supporting personalization and contextualization in authentic contexts. Journal of Educational Computing Research, 61(5), 1008–1035. https://doi.org/10.1177/07356331221137253.
Indah Werdiningsih, None Marzuki, Inda Indrawati, Diyenti Rusdin, Ivone, F. M., Yazid Basthomi, & None Zulfahreza. (2024). Revolutionizing EFL writing: unveiling the strategic use of ChatGPT by Indonesian master’s students. Cogent Education, 11(1). https://doi.org/10.1080/2331186x.2024.2399431
Jahan, M., Aram Azam, L., Ahmad, F. & Sadia, H. (2023). Reinforcement learning supplementing communicative language teaching: Examining the applications of ChatGPT in ELT classrooms. Journal of Namibian Studies: History Politics Culture, 33, 299–330. https://doi.org/10.59670/jns.v33i.5197
Jeon, J., Lee, S., & Choe, H. (2023a). Beyond ChatGPT: A conceptual framework and systematic review of speech-recognition chatbots for language learning. Computers & Education, 206, 104898. https://doi.org/10.1016/j.compedu.2023.104898
Ji, H., Han, I., & Ko, Y. (2023). A systematic review of conversational AI in language education: Focusing on the collaboration with human teachers. Journal of Research on Technology in Education, 55(1), 48–63. https://doi.org/10.1080/15391523.2022.2142873
Kohnke, L., Moorhouse, B. L., & Zou, D. (2023). ChatGPT for language teaching and learning. RELC Journal, 54(2), 537–550. https://doi.org/10.1177/00336882231162868
Koraishi, O. (2023). Teaching English in the age of AI: Embracing ChatGPT to optimize EFL materials and assessment. Language Education & Technology (LET Journal), 3(1), 55–72. https://langedutech.com/letjournal/index.php/let/article/view/48
Kostka, I., & Toncelli, R. (2023). Exploring applications of ChatGPT to English language teaching: Opportunities, challenges, and recommendations. TESL-EJ, 27(3). https://doi.org/10.55593/ej.27107int
Kusuma, I. P. I., Roni, M., Dewi, K. S., & Mahendrayana, G. (2024). Revealing the potential of ChatGPT for English language teaching: EFL preservice teachers’ teaching practicum experience. Studies in English Language and Education, 11(2), 650–670.https://doi.org/10.24815/siele.v11i2.34748
Liakin, D., Cardoso, W., & Liakina, N. (2014). Learning L2 pronunciation with a mobile speech recognizer: French /y/. CALICO Journal, 32(1), 1–25. https://doi.org/10.1558/cj.v32i1.25962
Li, Y., Zhou, X., & Chiu, T. K. F. (2024). Systematics review on artificial intelligence chatbots and ChatGPT for language learning and research from self-determination theory (SDT): what are the roles of teachers? Interactive Learning Environments, 1–15. https://doi.org/10.1080/10494820.2024.2400090
Lin, S., & Crosthwaite, P. (2024). The grass is not always greener: Teacher vs. GPT-assisted written corrective feedback. System, 127, 103529. https://doi.org/10.1016/j.system.2024.103529
 Liu, C.-C., Liao, M.-G., Chang, C.-H., & Lin, H.-M. (2022). An analysis of children’ interaction with an AI chatbot and its impact on their interest in reading. Computers & Education, 189, Article 104576. https://doi.org/10.1016/j.compedu.2022.104576.
Locky, L. (2024). Application of generative artificial intelligence (GenAI) in language teaching and learning: A scoping literature review, Computers and Education, 6. https://doi.org/10.1016/j.caeo.2024.100174.
Niedbał, R., Sokołowski, A., & Wrzalik, A. (2023). Students’ use of the artificial intelligence language model in their learning process. Procedia Computer Science, 225, 3059–3066. https://doi.org/10.1016/j.procs.2023.10.299
Mabuan, R.A. (2024). ChatGPT and ELT: Exploring teachers’ voices. International Journal of Technology in Education (IJTE), 7(1), 128–153. https://doi.org/10.46328/ijte.523
Marpaung, S. (2024). Boosting high school students’ speaking proficiency with Gemini AI. English Journal Antartika, 2 (1). https://doi.org/10.70052/eja.v2i1.543
Martineau, K. (2023). What is generative AI? IBM Research. Retrieved 26.6.2023 at https://research.ibm.com/blog/what-is-generative-AI
Marzuki, W., Rusdin, U., Darwin, D., & Indrawati, I. (2023). The impact of AI writing tools on the content and organization of students’ writing: EFL teachers’ perspective. Cogent Education, 10(2). https://doi.org/10.1080/2331186x.2023.2236469
Meniado, J. C., Huyen, D. T. T., Panyadilokpong, N., & Lertkomolwit, P. (2024). Using ChatGPT for second language writing: Experiences and perceptions of EFL learners in Thailand and Vietnam. Computers and Education: Artificial Intelligence, 7, 100313. https://doi.org/10.1016/j.caeai.2024.100313
Mohammad H. Al-khresheh (2024). Bridging technology and pedagogy from a global lens: Teachers’ perspectives on integrating ChatGPT in English language teaching, Computers and Education: Artificial Intelligence,6. https://doi.org/10.1016/j.caeai.2024.100218
Mousavi, S. S. (2023). Integration of AI in English education. The 6th National Conference on Professional Researches in Psychology and Counselling from the Techers’s Perspective, Minab. (In Persian)
Oka Agustini, N. P. (2023). Examining the role of ChatGPT as a learning tool in promoting students’ English language learning autonomy relevant to Kurikulum Merdeka Belajar. EDUKASIA: Jurnal Pendidikan Dan Pembelajaran, 4(2), 921–934. https://doi.org/10.62775/edukasia.v4i2.373
Rahimi. A., & Sevilla-Pavón, A. (2024). The Role of ChatGPT Readiness in Shaping Language Teachers’ Innovation and Meeting Accountability: A bisymmetric approach. Computers and Education Artificial Intelligence, 100258–100258. https://doi.org/10.1016/j.caeai.2024.100258
Ring, N., Ritchei, K., Jepson, R., & Mandava, L. (2011). A guide to synthesising qualitative research for researchers undertaking health technology assessments and systematic reviews. http://www.nhshealthquality.org/nhsqis/8837.html
Rizky Anandaa, D., & Salmiah, M. (2024). Students’ Perceptions on AI Technology: Gemini as a Writing Assistant Tool.Linguistics and English Language Teaching Journal, 2 (1).
Ruan, S., Jiang, L., Xu, Q., Liu, Z., Davis, G. M., Brunskill, E., & Landay, J. A. (2021).  EnglishBot: An AI-powered conversational system for second Language Learning. In 26th international conference on intelligent user interfaces, 434–444. https://doi.org/10.1145/3397481.3450648
Saifon Songsiengchai, Bang-on Sereerat, & Wirot Watananimitgul. (2023). Leveraging Artificial Intelligence (AI): ChatGPT for Effective English Language Learning among Thai Students. English Language Teaching, 16(11), 68–68.
Sandelowski, M., Barroso, J., & Voils, C. I. (2007). Using qualitative meta summary to synthesize qualitative and quantitative descriptive findings. Reseach in Nursing and Health, 30(1), 99–111. https://doi.org/10.1002/nur.20176
Sawangwan, S. (2024). ChatGPT VS Teacher’s Roles in Developing English Writing of Thai EFL Learners. https://doi.org/10.21203/rs.3.rs-4629708/v1
Seyyedkalan, S. & Mazharpour, D. (2024). A systematic review of Technological Pedagogical Content Knowledge (TPACK) of EFL teachers. Journal of Foreign Language Research14(1), 65–87. https://doi.org/10.22059/jflr.2024.372007.1097
Songsiengchai, S., Sereerat, B., & Watananimitgul, W. (2023). Leveraging artificial intelligence (AI): ChatGPT for effective English language learning among Thai students. English Language Teaching, 16(11), 68. https://doi.org/10.5539/elt.v16n11p68
Sharadgah, T. A., & Sa’di, R. A. (2022). A systematic review of research on the use of artificial intelligence in English language teaching and learning (2015-2021): What are the current effects? Journal of Information Technology Education: Research, 21, 337–377. https://doi.org/10.28945/4999
Stewart, J. (2016). Artificial intelligence and foreign language learning. Canadian International Journal of Social Science and Education, 9, 264–279.
Teng, M. F. (2024). “ChatGPT is the companion, not enemies”: EFL learners’ perceptions and experiences in using ChatGPT for feedback in writing. Computers and Education Artificial Intelligence, 7, 100270. https://doi.org/10.1016/j.caeai.2024.100270
TOBOULA, C. M. Z. (2023). Exploring the impact of AI-powered collaborative and interactive NLP apps on EFL teaching in the post-COVID-19 era. International Journal on Cybernetics & Informatics, 12(2), 171–193. https://doi.org/10.5121/ijci.2023.120213
Tolstykh, O. M., & Oshchepkova, T. (2024). Beyond ChatGPT: Roles that artificial intelligence tools can play in an English language classroom. Discover Artificial Intelligence, 4(1). https://doi.org/10.1007/s44163-024-00158-9
Ulla, M. B., Advincula, M. J. C., Mombay, C. D. S., Mercullo, H. M. A., Nacionales, J. P., & Entino-Señorita, A. D. (2024). How can GenAI foster an inclusive language classroom? A critical language pedagogy perspective from Philippine university teachers. Computers and Education: Artificial Intelligence, 7, 100314. https://doi.org/10.1016/j.caeai.2024.100314
Utami, N. P., Kembaren, F. R. & Daulay, S. H. (2024). Exploring higher education learners' experience of utilizing Gemini Chatbot in English language learning. Retorika: Jurnal Ilmu Bahasa, 10(2), 661–675. DOI: http://10.55637/jr.10.3.10244.661-675
Wang, Y. (2024). Cognitive and sociocultural dynamics of self-regulated use of machine translation and generative AI tools in academic EFL writing. System, 126, 103505. https://doi.org/10.1016/j.system.2024.103505
Xiao, Yangyu, and Yuying Zhi. 2023. An exploratory study of EFL learners’ use of ChatGPT for language learning tasks: Experience and perceptions. Languages, 8(3). https://doi.org/10.3390/languages8030212
Yuliani, S., Mukhibbah, T. L., & Agustina, E. (2024). Artificial intelligence usage in higher education:  EFL students’ view. ELTR Journal, 8(2), 119–129. https://doi.org/10.37147/eltr.v8i2.198
Zaiarna, I., Zhyhadlo, O., & Dunaievska, O. (2024). CHATGPT in foreign language teaching and assessment: exploring EFL instructors’ experience. Information Technologies and Learning Tools, 102(4), 176–191. https://doi.org/10.33407/itlt.v102i4.5716
Zhai, C., & Wibowo, S. (2023). A systematic review on artificial intelligence dialogue systems for enhancing English as foreign language students’ interactional competence in the university. Computers and Education: Artificial Intelligence, 4, 100134. https://doi.org/10.1016/j.caeai.2023.100134
Zhang, Z., & Huang, X. (2024). The impact of chatbots based on large language models on second language vocabulary acquisition. Heliyon, 10(3), e25370. https://doi.org/10.1016/j.heliyon.2024.e25370