Some results about randomized binary Markov chains: Theory, computing and applications

[EN] This paper is addressed to give a generalization of the classical Markov methodology allowing the treatment of the entries of the transition matrix and initial condition as random variables instead of deterministic values lying in the interval [0,1]. This permits the computation of the first pr...

ver descrição completa

Detalhes bibliográficos
Autores: Cortés, J.-C.|||0000-0002-6528-2155, Romero, José-Vicente|||0000-0003-3366-6557, Roselló, María-Dolores|||0000-0002-5724-7683, Navarro-Quiles, A.
Formato: artículo
Fecha de publicación:2020
País:España
Recursos:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:riunet.upv.es:10251/160812
Acesso em linha:https://riunet.upv.es/handle/10251/160812
Access Level:acceso abierto
Palavra-chave:Randomized binary Markov chain
Random variable transformation technique
First probability density function
Statistical moments
Mathematical modelling
MATEMATICA APLICADA
Descrição
Resumo:[EN] This paper is addressed to give a generalization of the classical Markov methodology allowing the treatment of the entries of the transition matrix and initial condition as random variables instead of deterministic values lying in the interval [0,1]. This permits the computation of the first probability density function (1-PDF) of the solution stochastic process taking advantage of the so-called Random Variable Transformation technique. From the 1-PDF relevant probabilistic information about the evolution of Markov models can be calculated including all one-dimensional statistical moments. We are also interested in determining the computation of distribution of some important quantities related to randomized Markov chains (steady state, hitting times, etc.). All theoretical results are established under general assumptions and they are illustrated by modelling the spread of a technology using real data.