STUDENTS' PERCEPTION OF USING PAPERPAL AI AS AN AUTOMATED WRITING EVALUATION (AWE) TOOL ON WRITING GRAMMATICAL FEEDBACK
DOI:
https://doi.org/10.47701/frasa.v6i2.5009Keywords:
Academic Writing, Automated Writing Evaluation, Grammatical Feedback, Paperpal AI, Student ExperienceAbstract
This study aims to explore university students’ perceptions of using Paperpal AI as an Automated Writing Evaluation (AWE) tool in providing grammatical feedback during the academic writing process. Grounded in the Technology Acceptance Model and Self- Regulated Learning Theory, this research addresses the gap in understanding how students critically engage with AI-driven feedback in English as a Foreign Language (EFL) contexts. A qualitative case study design was employed, involving 30 EFL university students majoring in English Education who had prior experience using Paperpal AI. Data were gathered through questionnaires and in-depth interviews. Questionnaire responses were analyzed descriptively using percentage analysis, while interview data were examined through Thematic Content Analysis (TCA). Findings revealed that students perceived Paperpal AI as beneficial for improving grammatical accuracy, sentence clarity, and editing efficiency. They appreciated the tool’s user-friendly interface and real-time feedback, particularly for grammar and transitions. However, concerns were raised regarding the general nature of suggestions, occasional contextual inaccuracy, and limited support for creativity. These insights suggest that while Paperpal AI enhances surface-level writing skills, it should be complemented with human feedback and critical reflection to support deeper writing development in academic settings.
Downloads
References
Al-Zahrani, A. M. (2024). Balancing Act: Exploring the Interplay Between Human Judgment and Artificial Intelligence in Problem-Solving, Creativity, and Decision-Making. Igmin Research, 2(3), 145–158. https://doi.org/10.61927/igmin158
Aljuaid, H. (2024). The Impact of Artificial Intelligence Tools on Academic Writing Instruction in Higher Education: A Systematic Review. Arab World English Journal (AWEJ) Special Issue on ChatGPT, 26–55. https://doi.org/10.24093/awej/ChatGPT.2
Ariyanto, M. S. A., Mukminatien, N., & Tresnadewi, S. (2021). College Students’ Perceptions of An Automated Writing Evaluation as A Supplementary Feedback Tool in A Writing Class. Jurnal Ilmu Pendidikan, 27(1), 41–51. https://doi.org/10.17977/um048v27i1p41-51
Bensalem, E., Harizi, R., & Boujlida, A. (2024). Exploring Undergraduate Students’ Usage and Perceptions of AI Writing Tools. Global Journal of Foreign Language Teaching, 14(2), 53–65. https://doi.org/10.18844/gjflt.v14i2.9344
Braun, V., & Clarke, V. (2006). Using Thematic Analysis in Psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706QP063OA
Burstein, J., Chodorow, M., & Leacock, C. (2004). Automated Essay Evaluation: The Criterion Online Writing Service. Ai Magazine, 25(3), 27–36. https://doi.org/10.1609/aimag.v25i3.1774
Chen, M., & Cui, Y. (2022). The Effects of AWE And Peer Feedback on Cohesion and Coherence in Continuation Writing. Journal of Second Language Writing, 57(100915). https://doi.org/10.1016/j.jslw.2022.100915
Collins, A., Brown, J. S., & Newman, S. E. (2018). Cognitive Apprenticeship: Teaching the Crafts of Reading, Writing, and Mathematics. In Knowing, Learning, and Instruction (pp. 453–494). Routledge.
Davis, F. D. (1989). Perceived Usefulness, Perceived Ease of Use, And User Acceptance of Information Technology. MIS Quarterly, 13(3), 319–340. https://doi.org/10.2307/249008
Dewi, U. (2022). Grammarly As Automated Writing Evaluation: Its Effectiveness from EFL Students’ Perceptions. Lingua Cultura, 16(2), 155–161. https://doi.org/10.21512/lc.v16i2.8315
Dodigovic, M., & Tovmasyan, A. (2021). Automated Writing Evaluation: The Accuracy of Grammarly’s Feedback on Form. International Journal of TESOL Studies, 3(2), 71–87. https://doi.org/10.46451/ijts.2021.06.06
Fitria, T. N. (2024). Using Wordtune as An AI-Powered Writing Tool How is The Performance in Rewrite and Rephrase English Writing? Jurnal Pendidikan Bahasa Inggris Proficiency, 6(1), 117–149. https://doi.org/10.32503/proficiency.v6i1.4135
Flower, L., & Hayes, J. R. (1981). A Cognitive Process Theory of Writing. College Composition & Communication, 32(4), 365–387. https://doi.org/10.3389/fpsyg.2023.1260843
Giglio, A. Del, & Costa, M. U. P. da. (2023). The Use of Artificial Intelligence to Improve the Scientific Writing of Non-Native English Speakers. Revista Da Associacao Medica Brasileira, 69(9), 1–5. https://doi.org/10.1590/1806-9282.20230560
Halliday, M. A. K., & Hasan, R. (2014). Cohesion in English. Routledge.
Hye-Kyung, K., & Han, S. (2021). College Students’ Perceptions of AI-Based Writing Learning Tools: with A Focus on Google Translate, Naver Papago, and Grammarly. Modern English Education, 22(4), 90–100. https://doi.org/10.18095/meeso.2021.22.4.90
Hyett, N., Kenny, A., & Dickson-Swift, V. (2014). Methodology or Method? A Critical Review of Qualitative Case Study Reports. International Journal of Qualitative Studies on Health and Well-Being, 9(23606), 1–12. https://doi.org/10.3402/qhw.v9.23606
Kaleci, D., & Türel, Z. K. (2024). Investigation of Artificial Intelligence Tools in Office Applications. International Journal of Research in Teacher Education (IJRTE), 15(4), 78–91. https://doi.org/10.29329/ijrte.2024.1104.05
Khalifa, M., & Albadawy, M. (2024). Using Artificial Intelligence in Academic Writing and Research: An Essential Productivity Tool. Computer Methods and Programs in Biomedicine Update, 5(100145), 1–11. https://doi.org/10.1016/j.cmpbup.2024.100145
Krajka, J., & Olszak, I. (2024). Artificial Intelligence Tools in Academic Writing Instruction: Exploring the Potential of On-Demand AI Assistance in the Writing Process. Roczniki Humanistyczne, 72(6), 123–140. https://doi.org/10.18290/rh247206.8
Marzuki, Widiati, U., Rusdin, D., Darwin, & Indrawati, I. (2023). The Impact of AI Writing Tools on The Content and Organization of Students’ Writing: EFL Teachers’ Perspective. Cogent Education, 10(2236469), 1–17. https://doi.org/10.1080/2331186X.2023.2236469
Miranty, D., & Widiati, U. (2021). An Automated Writing Evaluation (AWE) In Higher Education. Pegem Journal of Education and Instruction, 11(4), 126–137. https://doi.org/10.47750/pegegog.11.04.12
Quratulain, Maqbool, S., & Bilal, S. (2025). The Effectiveness of AI-Powered Writing Assistants in Enhancing Essay Writing Skills at Undergraduate Level. Journal for Social Science Archives, 3(1), 845–855. https://doi.org/10.59075/jssa.v3i1.166
Setiawan, F., & Alkhowarizmi, A. (2025). Exploring an Artificial Intelligence as Automated Feedback Program in EFL Writing. ETERNAL (English Teaching Journal), 16(1), 202–224. https://doi.org/10.26877/eternal.v16i1.1206
Tanjung, S. R., & Dewi, U. (2024). Enhancing Students’ Writing Ability Through Quillbot: Teachers’ Perspective. Scope: Journal of English Language Teaching, 9(1), 458–463. https://doi.org/10.30998/scope.v9i1.24862
Usher, M. (2025). Generative AI Vs. Instructor Vs. Peer Assessments: A Comparison of Grading and Feedback in Higher Education. Assessment & Evaluation in Higher Education, 1–16. https://doi.org/10.1080/02602938.2025.2487495
Vygotsky, L. S. (1978). Mind in Society: Development of Higher Psychological Processes. Cambridge : Harvard University Press.
Wang, P. (2015). Effects of an Automated Writing Evaluation Program: Student Experiences and Perceptions. Electronic Journal of Foreign Language Teaching, 12(1), 79–100.
Zimmerman, B. J. (2002). Becoming A Self-Regulated Learner: An Overview. Theory Into Practice, 41(2), 64–70. https://doi.org/10.1207/s15430421tip4102_2
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Nabila Yun Afifah, Utami Dewi
This work is licensed under a Creative Commons Attribution 4.0 International License.
