Some results about randomized binary Markov chains: Theory, computing and applications

[EN] This paper is addressed to give a generalization of the classical Markov methodology allowing the treatment of the entries of the transition matrix and initial condition as random variables instead of deterministic values lying in the interval [0,1]. This permits the computation of the first pr...

Descripción completa

Detalles Bibliográficos
Autores: Cortés, J.-C.|||0000-0002-6528-2155, Romero, José-Vicente|||0000-0003-3366-6557, Roselló, María-Dolores|||0000-0002-5724-7683, Navarro-Quiles, A.
Tipo de recurso: artículo
Fecha de publicación:2020
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/160812
Acceso en línea:https://riunet.upv.es/handle/10251/160812
Access Level:acceso abierto
Palabra clave:Randomized binary Markov chain
Random variable transformation technique
First probability density function
Statistical moments
Mathematical modelling
MATEMATICA APLICADA
Descripción
Sumario:[EN] This paper is addressed to give a generalization of the classical Markov methodology allowing the treatment of the entries of the transition matrix and initial condition as random variables instead of deterministic values lying in the interval [0,1]. This permits the computation of the first probability density function (1-PDF) of the solution stochastic process taking advantage of the so-called Random Variable Transformation technique. From the 1-PDF relevant probabilistic information about the evolution of Markov models can be calculated including all one-dimensional statistical moments. We are also interested in determining the computation of distribution of some important quantities related to randomized Markov chains (steady state, hitting times, etc.). All theoretical results are established under general assumptions and they are illustrated by modelling the spread of a technology using real data.