Applied Semi-Markov Processes

Applied Semi-Markov Processes PDF Author: Jacques Janssen
Publisher: Springer Science & Business Media
ISBN: 0387295488
Category : Mathematics
Languages : en
Pages : 315

Get Book Here

Book Description
Aims to give to the reader the tools necessary to apply semi-Markov processes in real-life problems. The book is self-contained and, starting from a low level of probability concepts, gradually brings the reader to a deep knowledge of semi-Markov processes. Presents homogeneous and non-homogeneous semi-Markov processes, as well as Markov and semi-Markov rewards processes. The concepts are fundamental for many applications, but they are not as thoroughly presented in other books on the subject as they are here.

Applied Semi-Markov Processes

Applied Semi-Markov Processes PDF Author: Jacques Janssen
Publisher: Springer Science & Business Media
ISBN: 0387295488
Category : Mathematics
Languages : en
Pages : 315

Get Book Here

Book Description
Aims to give to the reader the tools necessary to apply semi-Markov processes in real-life problems. The book is self-contained and, starting from a low level of probability concepts, gradually brings the reader to a deep knowledge of semi-Markov processes. Presents homogeneous and non-homogeneous semi-Markov processes, as well as Markov and semi-Markov rewards processes. The concepts are fundamental for many applications, but they are not as thoroughly presented in other books on the subject as they are here.

Semi-Markov Models

Semi-Markov Models PDF Author: Jacques Janssen
Publisher: Springer Science & Business Media
ISBN: 148990574X
Category : Mathematics
Languages : en
Pages : 572

Get Book Here

Book Description
This book is the result of the International Symposium on Semi Markov Processes and their Applications held on June 4-7, 1984 at the Universite Libre de Bruxelles with the help of the FNRS (Fonds National de la Recherche Scientifique, Belgium), the Ministere de l'Education Nationale (Belgium) and the Bernoulli Society for Mathe matical Statistics and Probability. This international meeting was planned to make a state of the art for the area of semi-Markov theory and its applications, to bring together researchers in this field and to create a platform for open and thorough discussion. Main themes of the Symposium are the first ten sections of this book. The last section presented here gives an exhaustive biblio graphy on semi-Markov processes for the last ten years. Papers selected for this book are all invited papers and in addition some contributed papers retained after strong refereeing. Sections are I. Markov additive processes and regenerative systems II. Semi-Markov decision processes III. Algorithmic and computer-oriented approach IV. Semi-Markov models in economy and insurance V. Semi-Markov processes and reliability theory VI. Simulation and statistics for semi-Markov processes VII. Semi-Markov processes and queueing theory VIII. Branching IX. Applications in medicine X. Applications in other fields v PREFACE XI. A second bibliography on semi-Markov processes It is interesting to quote that sections IV to X represent a good sample of the main applications of semi-Markov processes i. e.

Semi-Markov Models and Applications

Semi-Markov Models and Applications PDF Author: Jacques Janssen
Publisher: Springer Science & Business Media
ISBN: 1461332885
Category : Mathematics
Languages : en
Pages : 403

Get Book Here

Book Description
This book presents a selection of papers presented to the Second Inter national Symposium on Semi-Markov Models: Theory and Applications held in Compiegne (France) in December 1998. This international meeting had the same aim as the first one held in Brussels in 1984 : to make, fourteen years later, the state of the art in the field of semi-Markov processes and their applications, bring together researchers in this field and also to stimulate fruitful discussions. The set of the subjects of the papers presented in Compiegne has a lot of similarities with the preceding Symposium; this shows that the main fields of semi-Markov processes are now well established particularly for basic applications in Reliability and Maintenance, Biomedicine, Queue ing, Control processes and production. A growing field is the one of insurance and finance but this is not really a surprising fact as the problem of pricing derivative products represents now a crucial problem in economics and finance. For example, stochastic models can be applied to financial and insur ance models as we have to evaluate the uncertainty of the future market behavior in order, firstly, to propose different measures for important risks such as the interest risk, the risk of default or the risk of catas trophe and secondly, to describe how to act in order to optimize the situation in time. Recently, the concept of VaR (Value at Risk) was "discovered" in portfolio theory enlarging so the fundamental model of Markowitz.

Semi-Markov Chains and Hidden Semi-Markov Models toward Applications

Semi-Markov Chains and Hidden Semi-Markov Models toward Applications PDF Author: Vlad Stefan Barbu
Publisher: Springer Science & Business Media
ISBN: 0387731733
Category : Mathematics
Languages : en
Pages : 233

Get Book Here

Book Description
Here is a work that adds much to the sum of our knowledge in a key area of science today. It is concerned with the estimation of discrete-time semi-Markov and hidden semi-Markov processes. A unique feature of the book is the use of discrete time, especially useful in some specific applications where the time scale is intrinsically discrete. The models presented in the book are specifically adapted to reliability studies and DNA analysis. The book is mainly intended for applied probabilists and statisticians interested in semi-Markov chains theory, reliability and DNA analysis, and for theoretical oriented reliability and bioinformatics engineers.

Semi-Markov Processes and Reliability

Semi-Markov Processes and Reliability PDF Author: N. Limnios
Publisher: Springer Science & Business Media
ISBN: 1461201616
Category : Technology & Engineering
Languages : en
Pages : 226

Get Book Here

Book Description
At first there was the Markov property. The theory of stochastic processes, which can be considered as an exten sion of probability theory, allows the modeling of the evolution of systems through the time. It cannot be properly understood just as pure mathemat ics, separated from the body of experience and examples that have brought it to life. The theory of stochastic processes entered a period of intensive develop ment, which is not finished yet, when the idea of the Markov property was brought in. Not even a serious study of the renewal processes is possible without using the strong tool of Markov processes. The modern theory of Markov processes has its origins in the studies by A. A: Markov (1856-1922) of sequences of experiments "connected in a chain" and in the attempts to describe mathematically the physical phenomenon known as Brownian mo tion. Later, many generalizations (in fact all kinds of weakenings of the Markov property) of Markov type stochastic processes were proposed. Some of them have led to new classes of stochastic processes and useful applications. Let us mention some of them: systems with complete connections [90, 91, 45, 86]; K-dependent Markov processes [44]; semi-Markov processes, and so forth. The semi-Markov processes generalize the renewal processes as well as the Markov jump processes and have numerous applications, especially in relia bility.

Discrete-Time Semi-Markov Random Evolutions and Their Applications

Discrete-Time Semi-Markov Random Evolutions and Their Applications PDF Author: Nikolaos Limnios
Publisher: Springer Nature
ISBN: 3031334299
Category : Mathematics
Languages : en
Pages : 206

Get Book Here

Book Description
This book extends the theory and applications of random evolutions to semi-Markov random media in discrete time, essentially focusing on semi-Markov chains as switching or driving processes. After giving the definitions of discrete-time semi-Markov chains and random evolutions, it presents the asymptotic theory in a functional setting, including weak convergence results in the series scheme, and their extensions in some additional directions, including reduced random media, controlled processes, and optimal stopping. Finally, applications of discrete-time semi-Markov random evolutions in epidemiology and financial mathematics are discussed. This book will be of interest to researchers and graduate students in applied mathematics and statistics, and other disciplines, including engineering, epidemiology, finance and economics, who are concerned with stochastic models of systems.

Nonlinearly Perturbed Semi-Markov Processes

Nonlinearly Perturbed Semi-Markov Processes PDF Author: Dmitrii Silvestrov
Publisher: Springer
ISBN: 3319609882
Category : Mathematics
Languages : en
Pages : 151

Get Book Here

Book Description
The book presents new methods of asymptotic analysis for nonlinearly perturbed semi-Markov processes with a finite phase space. These methods are based on special time-space screening procedures for sequential phase space reduction of semi-Markov processes combined with the systematical use of operational calculus for Laurent asymptotic expansions. Effective recurrent algorithms are composed for getting asymptotic expansions, without and with explicit upper bounds for remainders, for power moments of hitting times, stationary and conditional quasi-stationary distributions for nonlinearly perturbed semi-Markov processes. These results are illustrated by asymptotic expansions for birth-death-type semi-Markov processes, which play an important role in various applications. The book will be a useful contribution to the continuing intensive studies in the area. It is an essential reference for theoretical and applied researchers in the field of stochastic processes and their applications that will contribute to continuing extensive studies in the area and remain relevant for years to come.

Semi-Markov Risk Models for Finance, Insurance and Reliability

Semi-Markov Risk Models for Finance, Insurance and Reliability PDF Author: Jacques Janssen
Publisher: Springer Science & Business Media
ISBN: 0387707301
Category : Mathematics
Languages : en
Pages : 441

Get Book Here

Book Description
Everyone working in related fields from applied mathematicians to statisticians to actuaries and operations researchers will find this a brilliantly useful practical text. The book presents applications of semi-Markov processes in finance, insurance and reliability, using real-life problems as examples. After a presentation of the main probabilistic tools necessary for understanding of the book, the authors show how to apply semi-Markov processes in finance, starting from the axiomatic definition and continuing eventually to the most advanced financial tools.

Continuous Semi-Markov Processes

Continuous Semi-Markov Processes PDF Author: Boris Harlamov
Publisher: John Wiley & Sons
ISBN: 111862405X
Category : Mathematics
Languages : en
Pages : 313

Get Book Here

Book Description
This title considers the special of random processes known as semi-Markov processes. These possess the Markov property with respect to any intrinsic Markov time such as the first exit time from an open set or a finite iteration of these times. The class of semi-Markov processes includes strong Markov processes, Lévy and Smith stepped semi-Markov processes, and some other subclasses. Extensive coverage is devoted to non-Markovian semi-Markov processes with continuous trajectories and, in particular, to semi-Markov diffusion processes. Readers looking to enrich their knowledge on Markov processes will find this book a valuable resource.

Markov Decision Processes with Their Applications

Markov Decision Processes with Their Applications PDF Author: Qiying Hu
Publisher: Springer Science & Business Media
ISBN: 0387369511
Category : Business & Economics
Languages : en
Pages : 305

Get Book Here

Book Description
Put together by two top researchers in the Far East, this text examines Markov Decision Processes - also called stochastic dynamic programming - and their applications in the optimal control of discrete event systems, optimal replacement, and optimal allocations in sequential online auctions. This dynamic new book offers fresh applications of MDPs in areas such as the control of discrete event systems and the optimal allocations in sequential online auctions.