Enhancing Intent Classifier Training with Large Language Model-generated Data

Intent classification is essential in Natural Language Processing, serving applications like virtual assistants and customer service by categorizing user inputs into predefined classes. Despite its importance, the effectiveness of intent classifiers is often constrained by the scarcity of labeled da...

Descripción completa

Detalles Bibliográficos
Autores: Benayas Alamos, Alberto José, Sicilia Urbán, Miguel Ángel|||0000-0003-3067-4180, Mora Cantallops, Marçal|||0000-0002-2480-1078
Tipo de recurso: artículo
Fecha de publicación:2024
País:España
Institución:Universidad de Alcalá (UAH)
Repositorio:e_Buah Biblioteca Digital Universidad de Alcalá
Idioma:inglés
OAI Identifier:oai:ebuah.uah.es:10017/68228
Acceso en línea:http://hdl.handle.net/10017/68228
https://dx.doi.org/10.1080/08839514.2024.2414483
Access Level:acceso abierto
Palabra clave:Informática
Computer science
Descripción
Sumario:Intent classification is essential in Natural Language Processing, serving applications like virtual assistants and customer service by categorizing user inputs into predefined classes. Despite its importance, the effectiveness of intent classifiers is often constrained by the scarcity of labeled data, as acquiring substantial, annotated datasets is costly and impractical. Data augmentation addresses this by expanding datasets with modified or synthetic examples, a common practice in computer vision but more complex in NLP due to the discrete nature of language. Traditional NLP data augmentation methods have been explored but exhibit limitations. This paper investigates the use of Large Language Models for generating labeled data to enhance intent classification. We explore whether LLM-generated data can effectively augment training sets, comparing its impact on intent classifier performance against traditional augmentation methods. Our study reveals that LLMs can generate diverse and realistic data, potentially improving classifier accuracy in low-data scenarios, thereby providing valuable insights into leveraging generative AI for NLP tasks in real-world applications.