Design, development, and deployment of real-time drum accompaniment systems

This dissertation examines the generation of real-time symbolic drum accompaniments, with a particular focus on live improvisation contexts. While the research does occasionally focus on the audio domain, the majority of the research is centered on symbolic-to-symbolic systems. This dissertation add...

Descripción completa

Detalles Bibliográficos
Autor: Haki, Behzad
Tipo de recurso: tesis doctoral
Estado:Versión publicada
Fecha de publicación:2024
País:España
Institución:CBUC, CESCA
Repositorio:TDR. Tesis Doctorales en Red
OAI Identifier:oai:www.tdx.cat:10803/693304
Acceso en línea:http://hdl.handle.net/10803/693304
Access Level:acceso abierto
Palabra clave:Real-time music generation
Symbolic music generation
Rhythm generation
Drum accompaniment systems
Live improvisation
Transformers
Neural networks in VSTs
Generació de música en temps real
Generació de música simbòlica
Generació de ritmes
Sistemes d’acompanyament de bateria
Improvisació en directe
Xarxes Neuronals en VSTs
Generación de música en tiempo real
Generación de música simbólica
Generación de ritmos
Sistemas de acompañamiento de batería
Improvisación en vivo
Redes Neurales en VSTs
62
Descripción
Sumario:This dissertation examines the generation of real-time symbolic drum accompaniments, with a particular focus on live improvisation contexts. While the research does occasionally focus on the audio domain, the majority of the research is centered on symbolic-to-symbolic systems. This dissertation addresses real-time drum accompaniment from multiple perspectives: (1) conceptual, where a target application is designed based on a set of specified requirements, (2) architectural, where specific generative models are designed and developed for the selected conceptual design, and (3) from a deployment aspect, where the conceptual design is realized and evaluated. Throughout this work, three accompaniment systems were developed and refined. As a secondary outcome, this research also produced NeuralMidiFx, a toolkit designed to streamline the integration of generative neural networks into \acrshort{vst} plugins. Furthermore, two novel datasets, TapTamDrum and El Bongosero, were collected to support future research in areas ranging from rhythm perception to music generation.