Influence of prompts structure on the perception and enhancement of learning through LLMs in online educational contexts

This research examines how the structure of prompts impacts the perceived depth and accuracy of responses generated by generative Large Language Models (LLMs) in educational settings. It specifically investigates how prompt design influences students’ learning experiences. The study involved an expe...

ver descrição completa

Detalhes bibliográficos
Autor: Rodríguez Donaire, Silvia|||0000-0002-1991-8204
Formato: capítulo de livro
Fecha de publicación:2024
País:España
Recursos:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/425168
Acesso em linha:https://hdl.handle.net/2117/425168
https://dx.doi.org/10.5772/intechopen.1006481
Access Level:acceso abierto
Palavra-chave:Generative AI
GenAI
Engineering prompts
Large Language Model
LLMs
Formative assessment
Online higher education
Prompt structure
Educational environment
Students’ perception
Learning process
Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial
Àrees temàtiques de la UPC::Ensenyament i aprenentatge::Innovació i Investigació educativa
Descrição
Resumo:This research examines how the structure of prompts impacts the perceived depth and accuracy of responses generated by generative Large Language Models (LLMs) in educational settings. It specifically investigates how prompt design influences students’ learning experiences. The study involved an experiment with 183 students enrolled in a mandatory Business Administration course at the Universitat Oberta de Catalunya (UOC). Data from the experiment were analyzed using both qualitative and quantitative methods. The results show that well-structured prompts significantly improve students’ perception of the depth and accuracy of GenAI-generated responses, leading to a more effective learning process. This underscores the crucial role of prompt design in maximizing the educational effectiveness of GenAI. The findings suggest that thoughtful prompt design can enhance educational outcomes, although the study’s limited sample size and context-specific nature may restrict the generalizability of the results. This research contributes to the field by highlighting the importance of prompt structure in harnessing GenAI tools for educational improvement.