Impact of ChatGPT on Vocabulary Development: A Comparison Study

Abstract

This pilot study examines the efficacy of ChatGPT when compared to traditional online language learning platforms such as Google Translate on vocabulary learning among undergraduate students learning elementary Korean at the American University of Sharjah (AUS). While numerous studies have investigated ChatGPT’s effectiveness in improving students’ vocabulary development, few studies have focused on the impact of ChatGPT in enhancing learners’ linguistic abilities in a language other than English. In this regard, the current study employs empirical methods to analyze the efficacy of ChatGPT on vocabulary development when compared to Google Translate. The target words included in the pre-test and post-test were some basic but frequently used concrete Korean nouns. The intervention involved participants reading two short Korean passages with embedded target words while using either ChatGPT or Google Translate to interpret any unknown words. Results showed that the ChatGPT group had a greater mean test score than the Google Translate group. The relative difference in the performance could be attributed to greater levels of involvement while using a chatbot as compared to a translation tool. By also taking into consideration the students’ perspectives on the effectiveness of online tools for language learning, the study recommends how instructors can use AI for language teaching.