| تعداد نشریات | 44 |
| تعداد شمارهها | 1,853 |
| تعداد مقالات | 14,986 |
| تعداد مشاهده مقاله | 41,805,903 |
| تعداد دریافت فایل اصل مقاله | 16,380,669 |
Enhancing Listening Comprehension in Non-English Majors through AI-Integrated Gamified Formative Assessment | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Applied Research on English Language | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| مقاله 2، دوره 14، شماره 3، مهر 2025، صفحه 1-26 اصل مقاله (841.15 K) | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| نوع مقاله: Research Article | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| شناسه دیجیتال (DOI): 10.22108/are.2025.144695.2475 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| نویسندگان | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Lita Erdiana1؛ Ardiansyan Nauval Adaz Dziqy2؛ Ardiansyah Al Farouq3؛ Joko Slamet* 4 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 1Universitas PGRI Delta Sidoarjo, Sidoarjo, Indonesia | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 2Politeknik Elektronika Negeri Surabaya, Surabaya, Indonesia | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 3Institut Teknologi Telkom Surabaya, Surabaya, Indonesia | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| 4Universitas Negeri Malang, Malang, Indonesia | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| چکیده | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Listening comprehension remains a persistent challenge for non-English major students, often due to passive learning approaches, limited interactive engagement, and ineffective assessment methods. Traditional formative assessment lacks real-time feedback and adaptive mechanisms, hindering students’ ability to monitor progress and develop effective listening strategies. To address these drawbacks, the current study examines the implementation of an AI-integrated gamified formative assessment in enhancing listening comprehension among the 38 first-semester students at Universitas PGRI Delta Sidoarjo, a private university in East Java, Indonesia. Employing a sequential mixed-methods approach, data were collected from a closed-ended questionnaire measuring dimensions of engagement, motivation, and self-regulation, alongside structured interviews with six selected students to gain deeper insights. The findings reveal that the AI-integrated gamified platform fosters a more interactive and engaging learning experience, with students demonstrating increased autonomy and strategic listening behaviors. The instant feedback and adaptive challenges contributed to improved comprehension, particularly in recognizing key information and inferring meaning from context. However, some participants expressed difficulties in adapting to the dynamic nature of the platform, citing cognitive overload and challenges in managing time constraints within the game-based environment. Additionally, variations in AI-generated feedback quality occasionally led to confusion in interpreting certain listening tasks. These findings suggest that while AI-integrated gamification enhances listening comprehension, further refinements in feedback accuracy and cognitive load management are essential to optimize its pedagogical impact. The study provides critical insights for educators and developers in designing AI-driven gamified assessment tools that effectively support listening comprehension development for non-English majors. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| کلیدواژهها | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| AI integration؛ Formative assessment؛ Gamification؛ Listening comprehension؛ Non-English Majors | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| اصل مقاله | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Introduction Listening comprehension is a critical component of language acquisition, serving as the foundation for effective communication and cognitive processing in English as a Foreign Language (EFL) learning. Unlike productive skills such as speaking and writing, listening is often perceived as a passive process, leading to its underemphasis in instructional settings (Pérez-Segura et al., 2022; Rukthong, 2021). This marginalization has resulted in traditional listening instruction that prioritizes exposure over strategic development (Alimorad & Saleki, 2022; Ramli et al., 2019), leaving non-English major students struggling to extract meaning from spoken discourse, especially in academic and professional contexts. Research has demonstrated that ineffective listening instruction stems from the predominant use of teacher-centered approaches that focus on comprehension questions rather than fostering interactive, process-oriented strategies (Mulyadi et al., 2021; Ngo, 2019). Consequently, students often fail to develop essential listening skills, such as identifying main ideas, inferring meaning from context, and distinguishing relevant details from extraneous information. This gap underscores the necessity of re-evaluating pedagogical practices and assessment methods in university-level EFL listening instruction, particularly for non-English major students who require English proficiency as a supplementary yet essential skill in their academic and professional endeavors. Formative assessment has been widely recognized as an effective tool for improving language skills, particularly by offering continuous feedback, promoting self-regulation, and encouraging active engagement in learning (Stanja et al., 2023). In the context of listening comprehension, formative assessment provides learners with opportunities to monitor their progress, reflect on their listening strategies, and adjust their approaches accordingly (Slamet & Mukminatien, 2024). However, conventional formative assessment practices in university EFL classrooms tend to be paper-based or teacher-directed, limiting opportunities for personalized feedback and autonomous learning (Estrada-Araoz et al., 2023; Yang et al., 2022). Studies have shown that static assessment methods, such as multiple-choice listening tests, fail to capture the complexity of real-world listening situations, where meaning is co-constructed through context, speaker intention, and discourse structures (Rahman & Suryati, 2018; Yaniafari et al., 2020). Moreover, traditional feedback mechanisms in formative assessment often suffer from delayed responses, preventing students from making immediate adjustments to their listening strategies (Jia & Hew, 2022). These limitations suggest the need for a more interactive, adaptive, and learner-centered approach to formative assessment in listening comprehension, particularly for non-English major students who may not receive intensive language training in their respective disciplines. Gamification has emerged as a promising pedagogical innovation to enhance engagement and motivation in EFL learning (Romsi et al., 2024; Slamet & Basthomi, 2024), including listening comprehension. By integrating game-based elements such as point systems, challenges, and progress tracking, gamified learning environments have been shown to increase learner motivation, foster persistence, and enhance overall language acquisition (Landers, 2014; Slamet et al., 2024a, 2024b). In listening instruction, gamification can provide structured yet dynamic learning experiences that encourage students to actively participate, apply strategic listening techniques, and receive immediate formative feedback (Zainuddin et al., 2020). Studies have reported that gamified learning fosters a more immersive and interactive environment, reducing anxiety and promoting sustained engagement in listening tasks (Hutson et al., 2024; Zhang & Crawford, 2024). However, despite these benefits, research has also identified potential drawbacks, including cognitive overload, excessive competition, and the risk of learners prioritizing game mechanics over actual skill development (Al-Aosail et al., 2024; Zhang & Watson, 2025). While previous studies have explored gamification in EFL instruction, there remains a lack of research examining its role in formative listening assessment, particularly for non-English major university students who require English skills for general academic and professional purposes rather than deep linguistic mastery. The integration of Artificial Intelligence (AI) into gamified learning environments presents new possibilities for optimizing formative assessment in listening comprehension. AI-driven educational platforms offer adaptive feedback, real-time error detection, and personalized learning trajectories based on individual learner performance (Leong et al., 2023; Qiao & Zhao, 2023; Slamet, 2024). In listening comprehension, AI has the potential to analyze student responses, detect comprehension gaps, and provide targeted support to enhance listening strategies (Parveen & Alkudsi, 2024; Villarino, 2025). Research on Given these considerations, this study explores AI-integrated gamified formative assessment to enhance listening comprehension in non-English major undergraduates. Traditional listening instruction remains ineffective due to its passive nature, while formative assessment lacks immediacy and personalization. Although gamification boosts engagement, its role in listening assessment is underexamined. AI offers adaptive solutions but faces challenges in feedback accuracy and learner adaptability. This study bridges these gaps by investigating how AI-driven gamification optimizes formative assessment, fosters learner autonomy, and addresses instructional and technological limitations in university EFL contexts. This study is guided by the following research question: How does AI-integrated gamified formative assessment influence the listening comprehension development of
Literature Review The effectiveness of formative assessment in enhancing listening comprehension has been widely recognized in language education. Formative assessment provides continuous feedback, facilitates self-regulation, and helps learners monitor their progress in developing listening strategies (Köroğlu, 2021; Stanja et al., 2023). Listening instruction enables students to identify comprehension gaps, refine their approaches, and adjust strategies based on feedback (Slamet & Mukminatien, 2024). However, conventional formative assessment methods in EFL listening, particularly in university settings, remain limited in their ability to provide immediate and personalized feedback. Paper-based and teacher-directed assessments often result in delayed responses, preventing students from making real-time adjustments to their listening strategies (Köroğlu, 2021; Zhang & Crawford, 2024). Additionally, standard comprehension tasks, such as multiple-choice listening tests, fail to capture the complexity of real-world listening, where meaning is shaped by discourse structures, speaker intentions, and contextual nuances (Alimorad & Saleki, 2022; Yang et al., 2022; Zainuddin et al., 2020). Despite advancements in digital learning, there is still a lack of dynamic, technology-enhanced formative assessment models tailored to listening comprehension, particularly for non-English major undergraduates who require English proficiency for academic and professional communication rather than in-depth linguistic mastery. This gap underscores the need for a more adaptive, interactive, and technology-integrated approach to formative assessment in listening instruction. Gamification has gained increasing attention as a means of improving engagement and motivation in language learning. According to Landers (2014), gamification refers to the use of game elements in non-game contexts to influence user behavior and learning outcomes. His theory emphasizes that gamification is most effective when it is grounded in instructional design principles, where game elements serve as mediators that enhance learning through increased motivation and engagement (Slamet et al., 2025). By integrating game-based elements such as points, levels, rewards, and challenges, gamified learning environments can encourage learners to engage with content actively and persist in skill development (Romsi The integration of AI in language learning has introduced new possibilities for adaptive assessment and personalized feedback. AI-driven educational tools can analyze student performance, identify specific comprehension difficulties, and provide tailored recommendations to improve learning outcomes (Leong et al., 2023; Qiao & Zhao, 2023).
Methodology Research Design and the Participants This study employs a sequential mixed-methods research design to explore how The participants in this study consisted of 38 first-semester students from Universitas PGRI Delta Sidoarjo, a private university in East Java, Indonesia. These students were enrolled in an English for General Purposes Course, which is a mandatory subject for non-English major undergraduates. The selection of first-semester students was intentional, as they are at an early stage of developing their listening comprehension skills in academic settings. The study’s participants were chosen using purposive sampling to ensure that the sample included students with varying levels of English proficiency, reflecting the diverse linguistic backgrounds typical of non-English majors. In the quantitative phase, all 38 students participated in a closed-ended questionnaire designed to assess their engagement, motivation, and self-regulated learning strategies within the AI-integrated gamified formative assessment environment. For the qualitative phase, six students were selected for structured interviews based on their responses to the questionnaire, ensuring a range of perspectives from students who demonstrated differing levels of engagement and perceived effectiveness of the platform. This approach allowed for a more detailed examination of individual experiences and challenges faced during the learning process. The demographic profile of participants, including gender, age, and self-reported English proficiency levels, is presented in Table 1.
Table 1. Demographic Profile of Participants (n = 38)
Instruments The study employed a closed-ended questionnaire to quantitatively assess students' engagement, motivation, and self-regulation in the AI-integrated gamified formative assessment environment. The questionnaire was adapted from validated instruments previously utilized in digital learning engagement and self-regulation research (Slamet et al., 2024a; Slamet & Basthomi, 2024) to ensure theoretical and empirical grounding. It consisted of 24 Likert-scale items, evenly distributed across three dimensions: engagement (8 items), motivation (8 items), and self-regulation (8 items). The engagement dimension measured students’ active participation in gamified activities and their interaction with AI-driven feedback, while the motivation dimension evaluated their interest, intrinsic drive, and perceived usefulness of the AI-integrated platform. The self-regulation dimension assessed students’ ability to plan, monitor, and adapt their listening comprehension strategies while using the platform. Each item was rated on a five-point Likert scale (1 = strongly disagree to 5 = strongly agree). To ensure the validity and reliability of the questionnaire, expert validation was conducted with three specialists in language assessment and educational technology. The experts provided feedback on content clarity, relevance, and alignment with the research objectives, leading to minor revisions in item wording to improve comprehensibility.
Data Collection Procedures Data collection was conducted over one academic semester (14 weeks, two credits) within the AI-integrated gamified formative assessment platform, embedded in the English for General Purposes Course. The platform provided an interactive and structured learning environment where students engaged in diverse formative listening comprehension tasks, quizzes, and AI-driven feedback mechanisms. The primary medium of instruction was English, with no translation provided to ensure linguistic immersion. The students interacted with the platform for approximately 90 minutes per session in a week, engaging with various gamified activities that incorporated real-time AI feedback. The AI system analyzed students’ listening comprehension performance and provided adaptive feedback, allowing learners to track their progress. The formative assessment framework was structured to reinforce listening skills progressively, integrating multimodal resources such as transcripts, audio annotations, and interactive exercises. Students’ participation, time spent on activities, and engagement with AI-generated feedback were systematically recorded to monitor learning behaviors. The course design and assessment activities are detailed in Table 2, outlining the formative assessment structure and AI integration features.
Table 2. Formative Assessment Features and Activities
Data Analysis Data analysis was conducted using both quantitative and qualitative approaches to provide a comprehensive understanding of how AI-integrated gamified formative assessment influenced listening comprehension. Quantitative data from the closed-ended questionnaire were analyzed using SPSS 27. Descriptive statistics were generated to determine means, standard deviations, and frequency distributions across the engagement, motivation, and self-regulation dimensions. Internal consistency was measured using Cronbach’s alpha, yielding an overall reliability coefficient of 0.826, indicating a high level of reliability. Subscale reliability was also calculated, with engagement (α = 0.812), motivation (α = 0.834), and self-regulation
Ethical Considerations Ethical considerations were carefully observed throughout the research process. Ethical approval was obtained from the Ethics Committee of Universitas PGRI Delta Sidoarjo, ensuring that all procedures adhered to ethical guidelines for research involving human participants. Informed consent was obtained from all students before their participation, with assurances of anonymity and confidentiality in data handling. Participants were given the option to withdraw at any stage without consequences, and data security measures were implemented to protect personal information. Additionally, the AI-integrated platform complied with data privacy regulations, ensuring that student interactions and performance analytics were used solely for research and pedagogical purposes.
Results The study aimed to investigate the influence of AI-integrated gamified formative assessment on listening comprehension development among non-English major undergraduate students. The findings were derived from a quantitative analysis of a closed-ended questionnaire and qualitative insights from structured interviews. Table 3. Questionnaire Results (n = 38)
The questionnaire results provide valuable insights into the impact of AI-integrated gamified formative assessment on students’ engagement, motivation, and self-regulation in listening comprehension. The engagement dimension revealed that the majority of students actively participated in gamified listening tasks (M = 4.11, SD = 0.87) and interacted with AI-generated feedback for improvement (M = 4.11, SD = 0.77). The leaderboard rankings and gamified elements encouraged participation, with over 70% of students agreeing or strongly agreeing that they engaged more in listening tasks due to gamification (M = 3.87, SD = 0.94). However, some students expressed a neutral stance (15.8%) or disagreement (21.1%) on whether leaderboard rankings significantly influenced their focus (M = 3.53, The sense of reward and achievement was also reflected in responses, as students reported feeling motivated when they earned high scores (M = 3.82, SD = 1.03). However, some students expressed mild uncertainty (13.2%) about whether gamified learning was preferable to traditional listening assessments (M = 3.74, SD = 1.10), suggesting that personal learning preferences may influence motivation levels. Regarding self-regulation, students demonstrated a strong inclination toward planning and adjusting learning strategies based on AI feedback. The highest-rated item in this category indicated that 84.2% of students adjusted their listening strategies after receiving AI feedback (M = 4.05, SD = 0.79). Students also monitored their listening progress using AI analytics (M = 3.76, SD = 1.00) and self-evaluated their listening comprehension skills (M = 3.76, SD = 1.03). However, a relatively lower mean score (M = 3.66, SD = 1.13) for practicing listening outside class due to AI feedback suggests that external factors such as time constraints or individual motivation may have influenced engagement beyond the structured course activities. These results suggest that the AI-integrated gamified formative assessment positively influenced student engagement, motivation, and self-regulation, though individual differences in response to gamification elements were evident. To complement the quantitative findings, structured interviews were conducted with six selected students (P1–P6) to gain deeper insights into their experiences with AI-integrated gamified formative assessment in listening comprehension. The thematic analysis identified three primary themes: (1) Perceptions of AI-Generated Feedback, (2) Impact of Gamification Elements on Learning, and (3) Challenges in AI-Integrated Listening Assessments.
Students generally perceived AI-generated feedback as beneficial in helping them identify errors, refine listening strategies, and track progress. However, some participants noted that AI feedback was occasionally too general or insufficient in explaining complex listening errors. Interview Question: How did AI-generated feedback impact your listening comprehension skills?
Table 4. Coding for Perceptions of AI-Generated Feedback
The findings indicate that AI-generated feedback was instrumental in enhancing students' listening comprehension skills by providing immediate correction and allowing self-monitoring of progress. The ability to recognize misheard words and adjust listening strategies was frequently highlighted as a strength of the AI system. However, some students found the feedback insufficient for more complex errors, preferring teacher explanations in such cases. Additionally, some participants expressed concern about becoming too reliant on AI-generated corrections. This suggests that while AI feedback can effectively support learning, a hybrid approach integrating both AI and instructor-led guidance may be necessary to address more nuanced listening difficulties.
Students generally responded positively to gamification elements such as leaderboards, points, and progress tracking. These elements enhanced motivation and engagement by fostering a sense of achievement and competition. However, some students expressed indifference toward competitive aspects, while others found certain gamified rewards frustrating when they failed to achieve the desired progress. Interview Question: How did gamification elements influence your learning experience?
Table 5. Coding for the Impact of Gamification Elements on Learning
The findings suggest that gamification elements generally enhanced motivation and engagement, with students responding positively to rewards, leaderboards, and progress tracking. Many participants reported that these elements encouraged them to invest more effort in listening tasks. However, some students felt indifferent toward competitive features, indicating that motivation levels varied depending on individual preferences. Additionally, a few participants noted that the emphasis on competition sometimes created unnecessary pressure. These results highlight the need for a balanced gamification approach that encourages learning engagement without inducing stress or discouragement.
Despite the benefits, some challenges were reported regarding AI-integrated assessments. Students mentioned technical issues, difficulty adapting to AI-generated questions, and occasional misinterpretations by the AI system. Interview Question: What challenges did you face when using AI-integrated assessments?
Table 6. Coding for Challenges in AI-Integrated Listening Assessments
While AI-integrated listening assessments provided benefits such as instant feedback and adaptive testing, they also posed challenges, particularly in cases where The findings from both the quantitative and qualitative analyses highlight the effectiveness of AI-integrated gamified formative assessment in enhancing students' listening comprehension skills, motivation, and engagement. AI-generated feedback was particularly beneficial in providing immediate error correction and enabling self-monitoring, though some students expressed concerns about its limitations in explaining complex mistakes. Gamification elements, such as leaderboards, points, and badges, significantly boosted motivation, yet individual preferences varied, with some students experiencing frustration due to competitive pressures. Despite the overall positive reception, challenges such as technical issues, AI misinterpretations, and the need for additional human support in assessments were evident. These results underscore the importance of a balanced approach that integrates AI-driven features with human instruction, ensuring both engagement and pedagogical effectiveness while mitigating potential drawbacks. Future implementations should focus on refining AI feedback mechanisms, enhancing the adaptability of
Discussion The findings of this study reveal that AI-integrated gamified formative assessment significantly enhances students’ engagement, motivation, and self-regulated learning in listening comprehension. These results align with previous studies emphasizing the potential of AI-driven feedback and gamification to foster active learning (Hutson et al., 2024; Qiao & Zhao, 2023). AI-generated feedback provided students with immediate and personalized guidance, reinforcing previous research highlighting the role of real-time corrective feedback in improving listening accuracy and comprehension strategies (Alimorad & Saleki, 2022; Yang et al., 2022). However, while the feedback proved effective for identifying misheard words and refining listening strategies, some students perceived it as insufficiently detailed in addressing complex comprehension difficulties. This result echoes concerns in earlier studies that AI feedback, though immediate, often lacks the depth of human explanations, leading to potential misunderstandings in nuanced listening tasks (Ngo, 2019; Rukthong, 2021). Thus, while AI-generated feedback enhances self-monitoring, its limitations indicate the need for hybrid feedback mechanisms that integrate AI precision with human instructional support. Gamification elements embedded within the AI-integrated assessment further reinforced student motivation and engagement. Consistent with prior research, game-based features such as leaderboards, points, and badges increased learners’ willingness to participate in listening tasks and fostered a sense of achievement (Slamet & Mukminatien, 2024; Yaniafari et al., 2020). The present study confirms findings from Pérez-Segura et al. (2022), who reported that competition-driven gamification enhances motivation, particularly among students with high achievement orientation. However, as observed in this study, not all students responded positively to competitive elements, as some felt pressured or discouraged by their ranking positions. This finding aligns with research by Romsi et al. (2024) and Slamet and Basthomi (2024), which cautioned that while gamification fosters engagement, excessive competition can create anxiety and diminish intrinsic motivation for learners who prioritize mastery over performance. These insights suggest that a more personalized gamification approach, incorporating adaptive challenges and self-paced rewards, may better cater to diverse learner preferences. Furthermore, this study highlights the role of AI-integrated gamified assessment in supporting self-regulated learning, particularly in planning, monitoring, and adjusting listening strategies. This is consistent with previous studies demonstrating that AI-enhanced platforms encourage students to take ownership of their learning through personalized scaffolding and real-time progress tracking (Slamet, 2024; Villarino, 2025). The gamified Despite the overall benefits of AI-driven gamification, this study also identified technical and pedagogical challenges that require attention. Students reported occasional system errors, slow responses, and internet connectivity issues, which disrupted their engagement, consistent with previous studies indicating that digital learning platforms are often constrained by technological limitations (Slamet et al., 2024b). Additionally, while Taken together, the findings of this study contribute to the growing body of literature on AI-integrated gamified assessment in EFL listening comprehension by addressing critical gaps identified in previous research. While prior studies have explored AI-driven feedback and gamification separately, this study provides empirical evidence on their combined impact, demonstrating that AI and gamification can work synergistically to enhance engagement, motivation, and self-regulation. However, it also reveals that AI’s limitations in interpretive accuracy and gamification’s varied motivational impact necessitate a more balanced and adaptive instructional design. Future implementations should focus on refining AI-driven feedback, offering a wider range of gamified incentives beyond competition-based elements, and incorporating human mediation to address AI-related challenges. These insights underscore the need for a pedagogical framework that optimally integrates AI’s analytical capabilities with the nuanced instructional support of educators, ensuring that technology-enhanced formative assessment is both effective and inclusive in diverse EFL learning contexts.
Conclusion The findings of this study underscore the transformative potential of AI-integrated gamified formative assessment in enhancing engagement, motivation, and self-regulated learning in listening comprehension. The integration of AI-generated feedback enabled students to receive immediate and personalized guidance, allowing them to refine their listening strategies and monitor their progress. Gamification elements further contributed to an interactive learning experience, fostering a sense of achievement and sustained participation. However, while AI-driven assessment and game-based features proved beneficial, variations in student responses highlight the complexity of individual learning preferences. While some learners thrived in a competitive environment, others experienced anxiety or frustration when rewards and rankings did not align with their expectations. Similarly, while AI-generated feedback effectively addresses surface-level listening errors, its limitations in handling complex linguistic nuances suggest the need for human mediation to enhance interpretive accuracy. These insights hold important implications for instructional design, emphasizing the need for adaptive gamification models that cater to diverse motivational drivers and Additionally, technological constraints, including system errors and internet dependency, indicate that infrastructure readiness must be considered in AI-based implementations. The study’s findings suggest that future developments should focus on hybrid feedback models, where AI-generated insights are complemented by human intervention to enhance pedagogical effectiveness. A more personalized gamification approach, integrating adaptive challenges and self-paced rewards, may further optimize learner engagement. While this study contributes valuable empirical evidence, its findings are limited by sample size and contextual specificity, warranting further research across diverse EFL settings. Longitudinal investigations could also provide deeper insights into the long-term effects of AI-integrated gamified assessment on listening skill development. These considerations highlight the necessity for continuous refinement in AI-enhanced language learning frameworks to ensure both effectiveness and inclusivity in diverse educational contexts.
Acknowledgments We sincerely thank all participants who contributed invaluable insights to this study. Special gratitude goes to the editor and the anonymous reviewers for their valuable feedback. This research was conducted without external funding.
Declaration of Conflicting Interests The authors declare no conflicts of interest pertaining to this study. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| مراجع | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Afshar, H. S., & Jamshidi, B. (2022). EFL learners’ language learning strategy use, instrumental motivation, self-efficacy, self-regulation, autonomy, and L2 achievement: A SEM analysis. Applied Research on English Language, 11(4), 133–160. https://doi.org/10.22108/are.2022.133123.1880 Alimorad, Z., & Saleki, A. (2022). Challenges and opportunities of web-based assessment in EFL courses as perceived by different stakeholders. Applied Research on English Language, 11(2), 125–154. https://doi.org/10.22108/are.2022.132413.1843 Al-Aosail, A. B. F., Lamouchi, A., Ibrahim, S. A., Gafar, M. G., & Hafez, W. E. (2024). Digital games for learning vocabulary: The effects on foreign language anxiety, buoyancy, online engagement, and vocabulary learning. Computer-Assisted Language Learning Electronic Journal, 25(4), 27–50. An, X., Chai, C. S., Li, Y., Zhou, Y., & Yang, B. (2023). Modeling students’ perceptions of artificial intelligence assisted language learning. Computer Assisted Language Learning, 1–22. https://doi.org/10.1080/09588221.2023.2246519 Bashori, M., van Hout, R., Strik, H., & Cucchiarini, C. (2022). ‘Look, I can speak correctly’: learning vocabulary and pronunciation through websites equipped with automatic speech recognition technology. Computer Assisted Language Learning, 1–29. https://doi.org/10.1080/09588221.2022.2080230 Chang, W.-L., & Sun, J. C.-Y. (2024). Evaluating AI’s impact on self-regulated language learning: A systematic review. System, 126, 103484. https://doi.org/10.1016/ j.system.2024.103484 Cooper, G. (2023). Examining science education in ChatGPT: An exploratory study of generative artificial intelligence. Journal of Science Education and Technology, 32(3), 444–452. https://doi.org/10.1007/s10956-023-10039-y Dai, Y., & Wu, Z. (2023). Mobile-assisted pronunciation learning with feedback from peers and/or automatic speech recognition: a mixed-methods study. Computer Assisted Language Learning, 36(5–6), 861–884. https://doi.org/10.1080/09588221. 2021.1952272 Estrada-Araoz, E. G., Sayed, B. T., Niyazova, G. G., & Lami, D. (2023). Comparing the effects of computerized formative assessment vs. computerized dynamic assessment on developing EFL learners’ reading motivation, reading self-concept, autonomy, and self-regulation. Language Testing in Asia, 13(1), 39. https://doi.org/10.1186/s40468-023-00253-1 Hutson, J., Fulcher, B., & Ratican, J. (2024). Enhancing assessment and feedback in game design programs. IJERI: International Journal of Educational Research and Innovation, 22, 1–20. https://doi.org/10.46661/ijeri.11038 Ivankova, N. V., Creswell, J. W., & Stick, S. L. (2006). Using mixed-methods sequential explanatory design: From theory to practice. Field Methods, 18(1), 3–20. https://doi.org/10.1177/1525822X05282260 Jia, C., & Hew, K. F. T. (2022). Supporting lower-level processes in EFL listening: The effect on learners’ listening proficiency of a dictation program supported by a mobile instant messaging app. Computer Assisted Language Learning, 35(1–2), 141–168. https://doi.org/10.1080/09588221.2019.1671462 Köroğlu, Z. Ç. (2021). Using digital formative assessment to evaluate EFL learners’ English speaking skills. GIST – Education and Learning Research Journal, 22, 103–123. https://doi.org/10.26817/16925777.1001 Landers, R. N. (2014). Developing a theory of gamified learning: Linking serious games and gamification of learning. Simulation and Gaming, 45(6), 752–768. https://doi.org/ 10.1177/1046878114563660 Leong, K., Sung, A., & Jones, L. (2023). Core technology behind and beyond ChatGPT. IJERI: International Journal of Educational Research and Innovation, 20, 1–21. https://doi.org/10.46661/ijeri.8449 Memarian, B., & Doleck, T. (2024). A review of assessment for learning with artificial intelligence. Computers in Human Behavior: Artificial Humans, 2(1), 100040. https://doi.org/10.1016/j.chbah.2023.100040 Mulyadi, D., Wijayatiningsih, T. D., Swaran Singh, C. K., & Prastikawati, E. F. (2021). Effects of technology enhanced task-based language teaching on learners’ listening comprehension and speaking performance. International Journal of Instruction, 14(3), 717–736. https://doi.org/10.29333/iji.2021.14342a Ngo, N. (2019). Understanding the impact of listening strategy instruction on listening strategy use from a socio-cultural perspective. System, 81, 63–77. https://doi.org/ 10.1016/j.system.2019.01.002 Parveen, M., & Alkudsi, Y. M. (2024). Graduates’ perspectives on AI integration. IJERI: International Journal of Educational Research and Innovation, 22, 1–17. https://doi.org/10.46661/ijeri.10651 Pérez-Segura, J. J., Ruiz, R. S., González-Calero, J. A., & Cózar-Gutiérrez, R. (2022). The effect of personalized feedback on listening and reading skills in the learning of EFL. Computer Assisted Language Learning, 35(3), 469–491. https://doi.org/ 10.1080/09588221.2019.1705354 Qiao, H., & Zhao, A. (2023). Artificial intelligence-based language learning: Illuminating the impact on speaking skills and self-regulation in Chinese EFL context. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1255594 Rahman, H., & Suryati, N. (2018). Authentic texts used by EFL vocational teachers in listening classes: Are they suitable with learners’ needs? http://journal.um.ac.id/ index.php/jptpp/ Ramli, Mukminatien, N., Saukah, A., & Prayogo, J. A. (2019). Word recognition from speech, syntactic knowledge, metacognitive awareness, self-efficacy as determination for l2 listening comprehension. International Journal of Instruction, 12(3), 89–104. https://doi.org/10.29333/iji.2019.1236a Romsi, A., Widodo, J. P., & Slamet, J. (2024). Empowering slow learners: Gamification’s impact on students’ engagement and academic performance in an LMS for undergraduate students. International Journal of Information and Education Technology, 14(2), 193–203. https://doi.org/10.18178/ijiet.2024.14.2.2040 Rukthong, A. (2021). MC listening questions vs. integrated listening-to-summarize tasks: What listening abilities do they assess? System, 97, 102439. https://doi.org/ 10.1016/j.system.2020.102439 Sailer, M., & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77-112. https://doi.org/10.1007/s10648-019-09498-w Slamet, J. (2024). Potential of ChatGPT as a digital language learning assistant: EFL teachers’ and students’ perceptions. Discover Artificial Intelligence, 4(1), 46. https://doi.org/10.1007/s44163-024-00143-2 Slamet, J., & Basthomi, Y. (2024). Assessing gamification-based LMS for EFL students: Slamet, J., Basthomi, Y., Ivone, F. M., & Eliyanah, E. (2024a). Unlocking the potential in a gamification-based MOOC: Assessing autonomous learning and self-directed learning behaviors. Teaching and Learning Inquiry, 12, 1–20. https://doi.org/10.20343/ teachlearninqu.12.19 Slamet, J., Basthomi, Y., Ivone, F. M., & Eliyanah, E. (2024b). Utilizing an SDL approach in designing a gamification-based MOOC to enhance autonomous learning. Journal of Information Technology Education: Research, 23, 010. https://doi.org/10.28945/5278 Slamet, J., Basthomi, Y., Ivone, F. M., & Eliyanah, E. (2025). A needs analysis for designing a gamification-based MOOC in English for specific purposes. Studies in Linguistics, Culture, and FLT, 13(1), 120-139. https://doi.org/10.46687/ULRS1031 Slamet, J., & Mukminatien, N. (2024). Developing an online formative assessment instrument for listening skill through LMS. LEARN Journal: Language Education and Acquisition Research Network, 17(1), 188–211. https://so04.tci-thaijo.org/index.php/ LEARN/index Stanja, J., Gritz, W., Krugel, J., Hoppe, A., & Dannemann, S. (2023). Formative assessment strategies for students’ conceptions—The potential of learning analytics. British Journal of Educational Technology, 54(1), 58–75. https://doi.org/10.1111/bjet.13288 Villarino, R. T. (2025). Artificial Intelligence (AI) integration in rural Philippine higher education. IJERI: International Journal of Educational Research and Innovation, 23, 1–25. https://doi.org/10.46661/ijeri.10909 Yang, A. C. M., Flanagan, B., & Ogata, H. (2022). Adaptive formative assessment system based on computerized adaptive testing and the learning memory cycle for personalized learning. Computers and Education: Artificial Intelligence, 3, 100104. https://doi.org/ 10.1016/j.caeai.2022.100104 Yaniafari, R. P., Mukminatien, N., & Basthomi, Y. (2020). Integrating Islamic knowledge into multimedia-based supplementary listening materials. International Journal of Emerging Technologies in Learning, 15(7), 43–60. https://doi.org/10.3991/ IJET.V15I07.13225 Zainuddin, Z., Shujahat, M., Haruna, H., & Chu, S. K. W. (2020). The role of gamified e-quizzes on student learning and engagement: An interactive gamification solution for a formative assessment system. Computers & Education, 145, 103729. https://doi.org/ 10.1016/j.compedu.2019.103729 Zhang, Y., & Watson, S. L. (2025). Impacts of gamified project-based learning on students’ achievement motivation in rural China. TechTrends. https://doi.org/10.1007/s11528-025-01051-7 Zhang, Z., & Crawford, J. (2024). EFL learners’ motivation in a gamified formative assessment: The case of Quizizz. Education and Information Technologies, 29(5), 6217–6239. https://doi.org/10.1007/s10639-023-12034-7 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
آمار تعداد مشاهده مقاله: 1,450 تعداد دریافت فایل اصل مقاله: 640 |
|||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||