A methodology for synthetic corpus engineering
[EN] This article describes a methodological framework for developing synthetic corpora with a small language model from a prompt engineering perspective. Instead of the typical approach in text mining, which prioritises corpus size in model training, this study applies a corpus linguistics methodol...
| Autor: | |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2025 |
| País: | España |
| Institución: | Universitat Politècnica de València (UPV) |
| Repositorio: | RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia |
| Idioma: | inglés |
| OAI Identifier: | oai:dnet:riunet______::1728597df94a0f713475192a29fa89ff |
| Acceso en línea: | https://riunet.upv.es/handle/10251/235287 |
| Access Level: | acceso abierto |
| Palabra clave: | Synthetic corpus engineering Corpus linguistics Language model Text classification Social problem |
| Sumario: | [EN] This article describes a methodological framework for developing synthetic corpora with a small language model from a prompt engineering perspective. Instead of the typical approach in text mining, which prioritises corpus size in model training, this study applies a corpus linguistics methodology that accounts for corpus domain and distribution considerations to generate diverse and realistic texts. These synthetic corpora were evaluated through their integration into a text classification system to detect social problems. Therefore, the objective is to demonstrate whether using a theoretically sound methodology based on corpus linguistics can improve the performance of systems trained with such synthetic corpora. The study concludes that factors such as stratification and proportionality in the sampling method have even more impact than corpus size. |
|---|