Using ChatGPT as an AWE tool
The emergence of generative pretrained transformer (GPT) large language models (LLMs) like ChatGPT has prompted speculation about their potential to serve as reliable Automated writing evaluation (AWE) tools and provide corrective feedback to second language (L2) writers. Given the novelty of this t...
| Autor: | |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2025 |
| País: | España |
| Institución: | Universitat Autònoma de Barcelona |
| Repositorio: | Dipòsit Digital de Documents de la UAB |
| Idioma: | inglés |
| OAI Identifier: | oai:ddd.uab.cat:319901 |
| Acceso en línea: | https://ddd.uab.cat/record/319901 https://dx.doi.org/urn:doi:10.5565/rev/jtl3.1338 |
| Access Level: | acceso abierto |
| Palabra clave: | Habilitats d'escriptura a l2 Chatgpt Avaluació automatitzada de l'escriptura Detecció d'errors Feedback correctiu L2 writing skills AWE Error detection Corrective feedback Habilidades de escritura en l2 Evaluación automatizada de la escritura Detección de errores Feedback correctivo Compétences d'écriture en l2 Évaluation automatisée de l'écriture Détection des erreurs Feedback correctif |
| Sumario: | The emergence of generative pretrained transformer (GPT) large language models (LLMs) like ChatGPT has prompted speculation about their potential to serve as reliable Automated writing evaluation (AWE) tools and provide corrective feedback to second language (L2) writers. Given the novelty of this tool, research on this topic is scarce. Therefore, it is imperative to assess its appropriateness as an AWE tool before its implementation in real learning settings. To help fill this research gap, the current study employs both quantitative and qualitative methods to evaluate the quality, precision, and accuracy of the feedback generated by a customized GPT functioning as an AWE tool for 30 compositions in English. The results indicate that while the general accuracy rate is high and the tool can provide feedback on both form and content, there are occasional instances of erroneous feedback or fabricated mistakes. The educational implications of these findings are discussed. |
|---|