ARTIFICIAL INTELLIGENCE (AI)-BASED ASSESSMENT: A TRANSFORMATIVE ENGLISH EDUCATION CURRICULUM
DOI:
https://doi.org/10.47701/s16xpm86Keywords:
Artificial Intelligence, Assessment, Curriculum, EnglishAbstract
Artificial Intelligence (AI) has been developing at a fast pace and is increasingly embedded in everyday human activities. In the realm of education AI serves as a transformative force, reshaping both teaching practices and learning processes. A key contribution of AI in this context lies in its capacity to deliver individualized and adaptive learning experiences. This study aims to develop an Artificial Intelligence (AI)-based English learning assessment system in the English Education program at the State Islamic University of North Sumatra, Medan. The study also seeks to measure the extent to which the AI-based assessment curriculum has effectively achieved the program's vision, mission, objectives, and graduate profile. A qualitative case study within purposive sampling approach was employed to select participants who had relevant experience and knowledge in English teaching and learning. The data collection methods included Focused Group Discussions (FGDs) with 20 lecturers and 100 students, as well as in-depth interviews with lecturers. The data from questionnaire were analyzed to identify patterns, trends, and differences in the responses of the respondents. The findings of this study indicate that the use of AI in assessing English proficiency among students has proven to be effective and efficient, not only in individual assessment but also in supporting the evaluation of academic program curricula. However, the findings also highlight the need for adequate technological readiness and training for both lecturer and student to optimize AI utilization.
Downloads
References
Albiladi, W. S., & Alshareef, K. K. (2019). Blended learning in english teaching and learning: A review of the current literature. Journal of Language Teaching and Research, 10(2), 232–238. https://doi.org/10.17507/jltr.1002.03
An, X., Ching, ·, Chai, S., Li, Y., Zhou, Y., Shen, · Xi, Zheng, C., & Chen, · Mengyuan. (2023). Modeling English teachers’ behavioral intention to use artificial intelligence in middle schools. Education and Information Technologies, 28, 5187–5208.
Bahman, L., & Adrian, P. (2022). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford University Press.
Balakumar, P., Al-Qahtani, A., Shanmugam, K., Srividhya, P. ., & Sundram, K. (2023). In The Quintessence of Basic and Clinical Research and Scientific Publishing. In How to Efficiently Write a Persuasive Discussion Section (pp. 755–760).
Baxter, P., & Jack, S. (2008). Qualitative Case Study Methodology: Study Design and Implementation for Novice Researchers. The Qualitative Report, 13(4), 544–559. https://doi.org/10.46743/2160-3715/2008.1573
Bin, Y., & Mandal, D. (2019). English teaching practice based on artificial intelligence technology. Journal of Intelligent & Fuzzy Systems, 3(37), 3381–3391.
Chen, X., Zou, D., Xie, H., Cheng, G., & Liu, C. (2022). Two Decades of Artificial Intelligence in Education: Contributors, Collaborations, Research Topics, Challenges, and Future Directions. Educational Technology and Society, 25(1), 28–47.
Chiu, T. K. F., Meng, H., Chai, C. S., King, I., Wong, S., & Yam, Y. (2022). Creation and Evaluation of a Pretertiary Artificial Intelligence (AI) Curriculum. IEEE Transactions on Education, 65(1), 30–39. https://doi.org/10.1109/TE.2021.3085878
Delgado, H. O. K., de Azevedo Fay, A., Sebastiany, M. J., & Silva, A. D. C. (2020). Artificial intelligence adaptive learning tools: the teaching of English in focus. Brazilian English Language Teaching Journal, 11(2), 1–19. https://doi.org/10.15448/2178-3640.2020.2.38749
El Shazly, R. (2021). Effects of artificial intelligence on English speaking anxiety and speaking performance: A case study. Expert Systems, 38(3). https://doi.org/10.1111/exsy.12667
Evanini, K., Hauck, M. C., & Hakuta, K. (2017). Approaches to automated scoring of speaking for K–12 English language proficiency assessments. 1, 1–11.
Fernandez, C. J. (2018). Behind a spoken performance: test takers’ strategic reactions in a simulated part 3 of the IELTS speaking test. Language Testing in Asia, 8(1). https://doi.org/10.1186/s40468-018-0073-4
Frost, K., Clothier, J., Huisman, A., & Wigglesworth, G. (2020). Responding to a TOEFL iBT integrated speaking task: Mapping task demands and test takers’ use of stimulus content. Language Testing, 1(37), 133–155.
Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041
Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing Assistant’s impact on English language learners. Computers and Education: Artificial Intelligence, 3(February), 100055. https://doi.org/10.1016/j.caeai.2022.100055
Huang, B. H., & Flores, B. B. (2018). The English Language Proficiency Assessment for the 21st Century (ELPA21). Language Assessment Quarterly, 15(4), 433–442. https://doi.org/10.1080/15434303.2018.1549241
Kabudi, T., Pappas, I., & Olsen, D. H. (2021). AI-enabled adaptive learning systems: A systematic mapping of the literature. Computers and Education: Artificial Intelligence, 2(March), 100017. https://doi.org/10.1016/j.caeai.2021.100017
Koraishi, O. (2023). Teaching English in the Age of AI: Embracing ChatGPT to Optimize EFL Materials and Assessment. Language Education & Technology Journal, 3(1), 55–72.
Kyle, K., Crossley, S. A., & McNamara, D. S. (2016). Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing. Language Testing, 3(33), 319–340.
Manongga, D., Rahardja, U., Sembiring, I., Lutfiani, N., & Yadila, A. B. (2022). RETRACTED (Di Tarik) : Dampak Kecerdasan Buatan Bagi Pendidikan. ADI Bisnis Digital Interdisiplin Jurnal, 3(2), 10-124-. https://doi.org/https://doi.org/10.34306/abdi.v3i2.792
Martínez-Comesaña, M., Rigueira-Díaz, X., Larrañaga-Janeiro, A., Martínez-Torres, J., Ocarranza-Prado, I., & Kreibel, D. (2023). Impact of artificial intelligence on assessment methods in primary and secondary education: Systematic literature review. Revista de Psicodidáctica (English Ed.), 28(2), 93–103. https://doi.org/10.1016/j.psicoe.2023.06.002
Mikalef, P., & Gupta, M. (2021). Artificial intelligence capability: Conceptualization, measurement calibration, and empirical study on its impact on organizational creativity and firm performance. Information and Management, 58(3), 103434. https://doi.org/10.1016/j.im.2021.103434
Muhammad Yahya, Wahyudi, & Akmal Hidayat. (2023). Implementasi Artificial Intelligence (AI) di Bidang Pendidikan Kejuruan Pada Era Revolusi Industri 4.0. Seminar Nasional Dies Natalis 62, 1, 190–199. https://doi.org/10.59562/semnasdies.v1i1.794
Nazari, N., Shabbir, M. S., & Setiawan, R. (2021). Application of Artificial Intelligence powered digital writing assistant in higher education: randomized controlled trial. Heliyon, 7(5), e07014. https://doi.org/10.1016/j.heliyon.2021.e07014
Owen, N., Shrestha, P. N., & Hultgren, A. K. (2021). Researching Academic Reading in Two Contrasting English as a Medium of Instruction Contexts at a University Level. ETS Research Report Series, 2021(1), 1–28. https://doi.org/10.1002/ets2.12317
Rukiati, E., Wicaksono, J. A., Taufan, G. T., & Suharsono, D. D. (2023). AI on Learning English: Application, Benefit, and Threat. Journal of Language, Communication, and Tourism, 1(2), 32–40. https://doi.org/10.25047/jlct.v1i2.3967
Schepman, A., & Rodway, P. (2023). The General Attitudes towards Artificial Intelligence Scale (GAAIS): Confirmatory Validation and Associations with Personality, Corporate Distrust, and General Trust. International Journal of Human-Computer Interaction, 39(13), 2724–2741. https://doi.org/10.1080/10447318.2022.2085400
Swiecki, Z., Khosravi, H., Chen, G., Martinez-Maldonado, R., Lodge, J. M., Milligan, S., Selwyn, N., & Gašević, D. (2022). Assessment in the age of artificial intelligence. Computers and Education: Artificial Intelligence, 3(August 2021). https://doi.org/10.1016/j.caeai.2022.100075
Tang, K. Y., Chang, C. Y., & Hwang, G. J. (2023). Trends in artificial intelligence-supported e-learning: a systematic review and co-citation network analysis (1998–2019). Interactive Learning Environments, 31(4), 2134–2152. https://doi.org/10.1080/10494820.2021.1875001
Wang, B., Rau, P. L. P., & Yuan, T. (2023). Measuring user competence in using artificial intelligence: validity and reliability of artificial intelligence literacy scale. Behaviour and Information Technology, 42(9), 1324–1337. https://doi.org/10.1080/0144929X.2022.2072768
Xu, Y., Liu, X., Cao, X., Huang, C., Liu, E., Qian, S., Liu, X., Wu, Y., Dong, F., Qiu, C. W., Qiu, J., Hua, K., Su, W., Wu, J., Xu, H., Han, Y., Fu, C., Yin, Z., Liu, M., … Zhang, J. (2021). Artificial intelligence: A powerful paradigm for scientific research. Innovation, 2(4). https://doi.org/10.1016/j.xinn.2021.100179
Yang, Y., Wang, Q., Woo, L. H., & Quek, C. L. (2011). Using Facebook for teaching and learning: a review of the literature. International Journal of Continuing Engineering Education and Life Long Learning, 1(21), 72–86.
Zahedi, K., & Shamsaee, S. (2012). Viability of construct validity of the speaking modules of international language examinations (IELTS vs. TOEFL iBT): Evidence from Iranian test-takers. Educational Assessment, Evaluation and Accountability, 24(3), 263–277. https://doi.org/10.1007/s11092-011-9137-z
Zahedkazemi, E. (2015). Construct Validation of TOEFL-iBT (as a Conventional Test) and IELTS (as a Task-based Test) among Iranian EFL Test-takers’ Performance on Speaking Modules. Theory and Practice in Language Studies, 5(7), 1513. https://doi.org/10.17507/tpls.0507.27
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Educational Technology in Higher Education, 16(1). https://doi.org/10.1186/s41239-019-0171-0
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Benni Ichsanda Rahman Hz, Ammamiarihta Ammamiarihta
This work is licensed under a Creative Commons Attribution 4.0 International License.
