The impact of AI-Assisted writing tools on L2 academic writing performance in an Indonesian context

Sara Yasnalia; Nanda Sigit Ariyanto; Dimas Alberto Roman Vasquez

doi:10.51574/hamka.v5i2.129

Authors

Sara Yasnalia
sarayas77@gmail.com
Program Studi Bahasa Inggris, Fakultas Keguruan dan Ilmu Pendidikan, Universitas Jambi, Jambi, Indonesia
Nanda Sigit Ariyanto Program Studi Bahasa Inggris, Fakultas Keguruan dan Ilmu Pendidikan, Universitas Jambi, Jambi, Indonesia
Dimas Alberto Roman Vasquez Program Educational Department, Universidad Simón Bolívar, Caracas 1080-A, Venezuela

Keywords:

AI-assisted learning, L2 academic writing, EFL instruction, Prompt Engineering, Higher Education

Abstract

Purpose: This study evaluates the empirical impact of artificial intelligence-assisted writing tools on academic writing performance, drafting dynamics, and feedback interactions among undergraduate second-language learners in Indonesian higher education.

Method: An explanatory sequential mixed-methods design was conducted during an instructional module at a public university in West Java. Data were gathered through pre- and post-intervention argumentative essays scored via the standardized ESL Composition Profile, screen-recorded writing logs, and semi-structured interviews.

Findings: Results demonstrate statistically significant improvements in overall academic writing performance, with the most pronounced gains observed in linguistic accuracy and lexical richness. Qualitatively, participants exhibited recursive prompt refinement, strategically positioning generative technology as an interactive dialogue partner to scaffold composition rather than relying on passive text generation.

Practical implications: The findings provide actionable frameworks for language educators to implement prompt-literacy instruction and hybrid feedback workshops, effectively reducing mechanical writing anxiety while encouraging higher-order rhetorical development.

Originality/value: This research fills a critical empirical void in second-language writing scholarship by demonstrating how structured prompt engineering fosters metacognitive awareness, enhances learner autonomy, and safeguards authorial agency in digital learning environments.

Downloads

Download data is not yet available.

References

Banihashem, S. K., Kerman, N. T., Noroozi, O., Moon, J., & Drachsler, H. (2024). Feedback sources in essay writing: peer-generated or AI-generated feedback? International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00455-4

Crossref DOI: https://doi.org/10.1186/s41239-024-00455-4

Chen, C., & Gong, Y. (2025). The Role of AI-Assisted Learning in Academic Writing: A Mixed-Methods Study on Chinese as a Second Language Students. Education Sciences, 15(2), 141. https://doi.org/10.3390/educsci15020141

Crossref DOI: https://doi.org/10.3390/educsci15020141

Chen, S., Shi, P., Guo, J., Xu, S., & Tian, J. (2023). From process to product: writing engagement and performance of EFL learners under computer-generated feedback instruction. Frontiers in Psychology, 14, 1258286. https://doi.org/10.3389/fpsyg.2023.1258286

Crossref DOI: https://doi.org/10.3389/fpsyg.2023.1258286

Darwin, D., Rusdin, D., Mukminatien, N., Suryati, N., Laksmi, E. D., & Marzuki, M. (2023). Critical thinking in the AI era: An exploration of EFL students’ perceptions, benefits, and limitations. Cogent Education, 11(1). https://doi.org/10.1080/2331186x.2023.2290342

Crossref DOI: https://doi.org/10.1080/2331186X.2023.2290342

Delcker, J., Heil, J., Ifenthaler, D., Seufert, S., & Spirgi, L. (2024). First-year students AI-competence as a predictor for intended and de facto use of AI-tools for supporting learning processes in higher education. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00452-7

Crossref DOI: https://doi.org/10.1186/s41239-024-00452-7

Evmenova, A. S., Regan, K., Mergen, R., & Hrisseh, R. (2024). Improving Writing Feedback for Struggling Writers: Generative AI to the Rescue? TechTrends, 68(4), 790–802. https://doi.org/10.1007/s11528-024-00965-y

Crossref DOI: https://doi.org/10.1007/s11528-024-00965-y

Gayed, J. M., Carlon, M. K. J., Oriola, A. M., & Cross, J. S. (2022). Exploring an AI-based writing Assistant’s impact on English language learners. Computers and Education Artificial Intelligence, 3, 100055. https://doi.org/10.1016/j.caeai.2022.100055

Crossref DOI: https://doi.org/10.1016/j.caeai.2022.100055

Kohnke, L., Zou, D., & Su, F. (2025). Exploring the potential of GenAI for personalised English teaching: Learners’ experiences and perceptions. Computers and Education Artificial Intelligence, 8, 100371. https://doi.org/10.1016/j.caeai.2025.100371

Crossref DOI: https://doi.org/10.1016/j.caeai.2025.100371

Koltovskaia, S. (2022). Postsecondary L2 writing teachers’ use and perceptions of Grammarly as a complement to their feedback. ReCALL, 35(3), 290–304. https://doi.org/10.1017/s0958344022000179

Crossref DOI: https://doi.org/10.1017/S0958344022000179

Lee, Y., Davis, R. O., & Lee, S. O. (2024). University students’ perceptions of artificial intelligence-based tools for English writing courses. Online Journal of Communication and Media Technologies, 14(1). https://doi.org/10.30935/ojcmt/14195

Crossref DOI: https://doi.org/10.30935/ojcmt/14195

Long, L., & Kim, M. (2024). It is like a friend to me: Critical usage of automated feedback systems by self-regulating English learners in higher education. Australasian Journal of Educational Technology. https://doi.org/10.14742/ajet.8821

Crossref DOI: https://doi.org/10.14742/ajet.8821

Mahapatra, S. (2024). Impact of ChatGPT on ESL students’ academic writing skills: a mixed methods intervention study. Smart Learning Environments, 11(1). https://doi.org/10.1186/s40561-024-00295-9

Crossref DOI: https://doi.org/10.1186/s40561-024-00295-9

Maphoto, K. B., Sevnarayan, K., Mohale, N. E., Suliman, Z., Ntsopi, T. J., & Mokoena, D. (2024). Advancing Students’ Academic Excellence in Distance Education: Exploring the Potential of Generative AI Integration to Improve Academic Writing Skills. Open Praxis, 16(2), 142–159. https://doi.org/10.55982/openpraxis.16.2.649

Crossref DOI: https://doi.org/10.55982/openpraxis.16.2.649

Mohammed, S. J., & Khalid, M. (2025). Under the world of AI-generated feedback on writing: mirroring motivation, foreign language peace of mind, trait emotional intelligence, and writing development. Language Testing in Asia, 15(1). https://doi.org/10.1186/s40468-025-00343-2

Crossref DOI: https://doi.org/10.1186/s40468-025-00343-2

Ngo, T. N., & Hastie, D. B. (2024). Artificial Intelligence for Academic Purposes (AIAP): Integrating AI literacy into an EAP module. English for Specific Purposes, 77, 20–38. https://doi.org/10.1016/j.esp.2024.09.001

Crossref DOI: https://doi.org/10.1016/j.esp.2024.09.001

Özfidan, B., El‐Dakhs, D. A. S., & Alsalim, L. A. (2024). The use of AI tools in English academic writing by Saudi undergraduates. Contemporary Educational Technology, 16(4). https://doi.org/10.30935/cedtech/15013

Crossref DOI: https://doi.org/10.30935/cedtech/15013

Rad, H. S., Alipour, R., & Jafarpour, A. (2023). Using artificial intelligence to foster students’ writing feedback literacy, engagement, and outcome: a case of Wordtune application. Interactive Learning Environments, 32(9), 5020–5040. https://doi.org/10.1080/10494820.2023.2208170

Crossref DOI: https://doi.org/10.1080/10494820.2023.2208170

Rahimi, M., Fathi, J., & Zou, D. (2024). Exploring the impact of automated written corrective feedback on the academic writing skills of EFL learners: An activity theory perspective. Education and Information Technologies, 30(3), 2691–2735. https://doi.org/10.1007/s10639-024-12896-5

Crossref DOI: https://doi.org/10.1007/s10639-024-12896-5

Sarıcaoğlu, A., & Bilki, Z. (2021). Voluntary use of automated writing evaluation by content course students. ReCALL, 33(3), 265–277. https://doi.org/10.1017/s0958344021000021

Crossref DOI: https://doi.org/10.1017/S0958344021000021

Shin, D., Kwon, S. K., & Lee, Y. (2021). The effect of using online language-support resources on L2 writing performance. Language Testing in Asia, 11(1). https://doi.org/10.1186/s40468-021-00119-4

Crossref DOI: https://doi.org/10.1186/s40468-021-00119-4

Smerdon, D. (2024). AI in essay-based assessment: Student adoption, usage, and performance. Computers and Education Artificial Intelligence, 7, 100288. https://doi.org/10.1016/j.caeai.2024.100288

Crossref DOI: https://doi.org/10.1016/j.caeai.2024.100288

Tan, X., Wang, C., & Xu, W. (2025). To disclose or not to disclose: Exploring the risk of being transparent about GenAI use in second language writing. Applied Linguistics. https://doi.org/10.1093/applin/amae092

Crossref DOI: https://doi.org/10.1093/applin/amae092

Trần, T. T. H. (2024). AI Tools in Teaching and Learning English Academic Writing Skills. Proceedings of the AsiaCALL International Conference, 4, 170–187. https://doi.org/10.54855/paic.23413

Crossref DOI: https://doi.org/10.54855/paic.23413

Utami, S. P. T., Andayani, A., Winarni, R., & Sumarwati, S. (2023). Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive? Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13419

Crossref DOI: https://doi.org/10.30935/cedtech/13419

Wang, C. (2024). Exploring Students’ Generative AI-Assisted Writing Processes: Perceptions and Experiences from Native and Nonnative English Speakers. Technology Knowledge and Learning, 30(3), 1825–1846. https://doi.org/10.1007/s10758-024-09744-3

Crossref DOI: https://doi.org/10.1007/s10758-024-09744-3

Wang, Y. (2024). Cognitive and sociocultural dynamics of self-regulated use of machine translation and generative AI tools in academic EFL writing. System, 126, 103505. https://doi.org/10.1016/j.system.2024.103505

Crossref DOI: https://doi.org/10.1016/j.system.2024.103505

Wei, P., Wang, X., & Dong, H. (2023). The impact of automated writing evaluation on second language writing skills of Chinese EFL learners: a randomized controlled trial. Frontiers in Psychology, 14, 1249991. https://doi.org/10.3389/fpsyg.2023.1249991

Crossref DOI: https://doi.org/10.3389/fpsyg.2023.1249991

Woo, D. J., Guo, K., & Susanto, H. (2024). Exploring EFL students’ prompt engineering in human–AI story writing: an activity theory perspective. Interactive Learning Environments, 33(1), 863–882. https://doi.org/10.1080/10494820.2024.2361381

Crossref DOI: https://doi.org/10.1080/10494820.2024.2361381

Xia, Q., Weng, X., Ouyang, F., Lin, T., & Chiu, T. K. F. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21(1). https://doi.org/10.1186/s41239-024-00468-z

Crossref DOI: https://doi.org/10.1186/s41239-024-00468-z

Yang, H., Gao, C., & Shen, H. (2023). Learner interaction with, and response to, AI-programmed automated writing evaluation feedback in EFL writing: An exploratory study. Education and Information Technologies, 29(4), 3837–3858. https://doi.org/10.1007/s10639-023-11991-3

Crossref DOI: https://doi.org/10.1007/s10639-023-11991-3

Yang-xi, H., Zhao, S., & Ng, L. L. (2021). How Technology Tools Impact Writing Performance, Lexical Complexity, and Perceived Self-Regulated Learning Strategies in EFL Academic Writing: A Comparative Study. Frontiers in Psychology, 12, 752793. https://doi.org/10.3389/fpsyg.2021.752793

Crossref DOI: https://doi.org/10.3389/fpsyg.2021.752793

Zhao, X. (2022). Leveraging Artificial Intelligence (AI) Technology for English Writing: Introducing Wordtune as a Digital Writing Assistant for EFL Writers. RELC Journal, 54(3), 890–894. https://doi.org/10.1177/00336882221094089

Crossref DOI: https://doi.org/10.1177/00336882221094089