SPRING: a next-generation compressor for FASTQ data

Motivation: High-Throughput Sequencing technologies produce huge amounts of data in the form of short genomic reads, associated quality values and read identifiers. Because of the significant structure present in these FASTQ datasets, general-purpose compressors are unable to completely exploit much...

Descripción completa

Detalles Bibliográficos
Autores: Hernaez-Arrazola, M. (Mikel)|||/items/954a4ee7-b04c-4dc5-9bfc-7a48332c7e5a, Chandak, S. (Shubham)|||/items/91f398f6-4d5a-481c-bf11-29703e5e1067, Tatwawadi, K. (Kedar)|||/items/1d601279-fb63-46d2-b2bf-e2bac95beb3c, Ochoa-Álvarez, I. (Idoia)|||/items/6326dacc-419f-4156-a9c3-9e79cfcc6a3c, Weissman, T. (Tsachy)|||/items/a0d863e4-764e-4234-90c7-37fb482a34c5
Tipo de recurso: artículo
Fecha de publicación:2019
País:España
Institución:Universidad de Navarra
Repositorio:Dadun. Depósito Académico Digital de la Universidad de Navarra
Idioma:inglés
OAI Identifier:oai:dadun.unav.edu:10171/113612
Acceso en línea:https://hdl.handle.net/10171/113612
Access Level:acceso abierto
Palabra clave:SPRING:
Compressor
FASTQ data
Descripción
Sumario:Motivation: High-Throughput Sequencing technologies produce huge amounts of data in the form of short genomic reads, associated quality values and read identifiers. Because of the significant structure present in these FASTQ datasets, general-purpose compressors are unable to completely exploit much of the inherent redundancy. Although there has been a lot of work on designing FASTQ compressors, most of them lack in support of one or more crucial properties, such as support for variable length reads, scalability to high coverage datasets, pairing-preserving compression and lossless compression. Results: In this work, we propose SPRING, a reference-free compressor for FASTQ files. SPRING supports a wide variety of compression modes and features, including lossless compression, pairing-preserving compression, lossy compression of quality values, long read compression and random access. SPRING achieves substantially better compression than existing tools, for example, SPRING compresses 195 GB of 25× whole genome human FASTQ from Illumina's NovaSeq sequencer to less than 7 GB, around 1.6× smaller than previous state-of-the-art FASTQ compressors. SPRING achieves this improvement while using comparable computational resources.