Expurgated random-coding ensembles: exponents, refinements and connections

This paper studies expurgated random-coding bounds and exponents for channel coding with a given (possibly suboptimal) decoding rule. Variations of Gallager's analysis are presented, yielding several asymptotic and nonasymptotic bounds on the error probability for an arbitrary codeword dist...

Descripción completa

Detalles Bibliográficos
Autores: Scarlett, Jonathan, Peng, Li, Merhav, Neri, Martínez, Alfonso, 1973-, Guillén i Fábregas, A. (Albert)
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2014
País:España
Institución:Universitat Pompeu Fabra
Repositorio:Repositorio Digital de la UPF
OAI Identifier:oai:repositori.upf.edu:10230/36016
Acceso en línea:http://hdl.handle.net/10230/36016
http://dx.doi.org/10.1109/TIT.2014.2322033
Access Level:acceso abierto
Palabra clave:Expurgated error exponents
Reliability function
Random coding
Mismatched decoding
Maximum-likelihood decoding
Type class enumeration
Descripción
Sumario:This paper studies expurgated random-coding bounds and exponents for channel coding with a given (possibly suboptimal) decoding rule. Variations of Gallager's analysis are presented, yielding several asymptotic and nonasymptotic bounds on the error probability for an arbitrary codeword distribution. A simple nonasymptotic bound is shown to attain an exponent of Csiszár and Körner under constant-composition coding. Using Lagrange duality, this exponent is expressed in several forms, one of which is shown to permit a direct derivation via cost-constrained coding that extends to infinite and continuous alphabets. The method of type class enumeration is studied, and it is shown that this approach can yield improved exponents and better tightness guarantees for some codeword distributions. A generalization of this approach is shown to provide a multiletter exponent that extends immediately to channels with memory.