Statistical Inference for Piecewise-deterministic Markov Processes

Statistical Inference for Piecewise-deterministic Markov Processes PDF Author: Romain Azais
Publisher: John Wiley & Sons
ISBN: 1119544092
Category : Mathematics
Languages : en
Pages : 300

Get Book Here

Book Description
Piecewise-deterministic Markov processes form a class of stochastic models with a sizeable scope of applications: biology, insurance, neuroscience, networks, finance... Such processes are defined by a deterministic motion punctuated by random jumps at random times, and offer simple yet challenging models to study. Nevertheless, the issue of statistical estimation of the parameters ruling the jump mechanism is far from trivial. Responding to new developments in the field as well as to current research interests and needs, Statistical inference for piecewise-deterministic Markov processes offers a detailed and comprehensive survey of state-of-the-art results. It covers a wide range of general processes as well as applied models. The present book also dwells on statistics in the context of Markov chains, since piecewise-deterministic Markov processes are characterized by an embedded Markov chain corresponding to the position of the process right after the jumps.

Statistical Inference for Piecewise-deterministic Markov Processes

Statistical Inference for Piecewise-deterministic Markov Processes PDF Author: Romain Azais
Publisher: John Wiley & Sons
ISBN: 1119544092
Category : Mathematics
Languages : en
Pages : 300

Get Book Here

Book Description
Piecewise-deterministic Markov processes form a class of stochastic models with a sizeable scope of applications: biology, insurance, neuroscience, networks, finance... Such processes are defined by a deterministic motion punctuated by random jumps at random times, and offer simple yet challenging models to study. Nevertheless, the issue of statistical estimation of the parameters ruling the jump mechanism is far from trivial. Responding to new developments in the field as well as to current research interests and needs, Statistical inference for piecewise-deterministic Markov processes offers a detailed and comprehensive survey of state-of-the-art results. It covers a wide range of general processes as well as applied models. The present book also dwells on statistics in the context of Markov chains, since piecewise-deterministic Markov processes are characterized by an embedded Markov chain corresponding to the position of the process right after the jumps.

Statistical Inference for Markov Processes

Statistical Inference for Markov Processes PDF Author: Patrick Billingsley
Publisher:
ISBN:
Category : Mathematics
Languages : en
Pages : 100

Get Book Here

Book Description


Numerical Methods for Simulation and Optimization of Piecewise Deterministic Markov Processes

Numerical Methods for Simulation and Optimization of Piecewise Deterministic Markov Processes PDF Author: Benoîte de Saporta
Publisher: John Wiley & Sons
ISBN: 1848218397
Category : Mathematics
Languages : en
Pages : 298

Get Book Here

Book Description
Mark H.A. Davis introduced the Piecewise-Deterministic Markov Process (PDMP) class of stochastic hybrid models in an article in 1984. Today it is used to model a variety of complex systems in the fields of engineering, economics, management sciences, biology, Internet traffic, networks and many more. Yet, despite this, there is very little in the way of literature devoted to the development of numerical methods for PDMDs to solve problems of practical importance, or the computational control of PDMPs. This book therefore presents a collection of mathematical tools that have been recently developed to tackle such problems. It begins by doing so through examples in several application domains such as reliability. The second part is devoted to the study and simulation of expectations of functionals of PDMPs. Finally, the third part introduces the development of numerical techniques for optimal control problems such as stopping and impulse control problems.

Piecewise-deterministic Markov Processes

Piecewise-deterministic Markov Processes PDF Author: M. H. A. Davis
Publisher:
ISBN:
Category :
Languages : en
Pages : 388

Get Book Here

Book Description


Markov Models & Optimization

Markov Models & Optimization PDF Author: M.H.A. Davis
Publisher: Routledge
ISBN: 1351433482
Category : Mathematics
Languages : en
Pages : 144

Get Book Here

Book Description
This book presents a radically new approach to problems of evaluating and optimizing the performance of continuous-time stochastic systems. This approach is based on the use of a family of Markov processes called Piecewise-Deterministic Processes (PDPs) as a general class of stochastic system models. A PDP is a Markov process that follows deterministic trajectories between random jumps, the latter occurring either spontaneously, in a Poisson-like fashion, or when the process hits the boundary of its state space. This formulation includes an enormous variety of applied problems in engineering, operations research, management science and economics as special cases; examples include queueing systems, stochastic scheduling, inventory control, resource allocation problems, optimal planning of production or exploitation of renewable or non-renewable resources, insurance analysis, fault detection in process systems, and tracking of maneuvering targets, among many others. The first part of the book shows how these applications lead to the PDP as a system model, and the main properties of PDPs are derived. There is particular emphasis on the so-called extended generator of the process, which gives a general method for calculating expectations and distributions of system performance functions. The second half of the book is devoted to control theory for PDPs, with a view to controlling PDP models for optimal performance: characterizations are obtained of optimal strategies both for continuously-acting controllers and for control by intervention (impulse control). Throughout the book, modern methods of stochastic analysis are used, but all the necessary theory is developed from scratch and presented in a self-contained way. The book will be useful to engineers and scientists in the application areas as well as to mathematicians interested in applications of stochastic analysis.

Statistical Inference for Markov Processes

Statistical Inference for Markov Processes PDF Author: Walter F. Johnson
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description


Statistical Topics and Stochastic Models for Dependent Data with Applications

Statistical Topics and Stochastic Models for Dependent Data with Applications PDF Author: Vlad Stefan Barbu
Publisher: John Wiley & Sons
ISBN: 1786306034
Category : Mathematics
Languages : en
Pages : 288

Get Book Here

Book Description
This book is a collective volume authored by leading scientists in the field of stochastic modelling, associated statistical topics and corresponding applications. The main classes of stochastic processes for dependent data investigated throughout this book are Markov, semi-Markov, autoregressive and piecewise deterministic Markov models. The material is divided into three parts corresponding to: (i) Markov and semi-Markov processes, (ii) autoregressive processes and (iii) techniques based on divergence measures and entropies. A special attention is payed to applications in reliability, survival analysis and related fields.

Statistical Inference for Markov Processes, Reprinted

Statistical Inference for Markov Processes, Reprinted PDF Author: Patrick Billingsley
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description


Markov Chain Monte Carlo

Markov Chain Monte Carlo PDF Author: Dani Gamerman
Publisher: CRC Press
ISBN: 9781584885870
Category : Mathematics
Languages : en
Pages : 352

Get Book Here

Book Description
While there have been few theoretical contributions on the Markov Chain Monte Carlo (MCMC) methods in the past decade, current understanding and application of MCMC to the solution of inference problems has increased by leaps and bounds. Incorporating changes in theory and highlighting new applications, Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference, Second Edition presents a concise, accessible, and comprehensive introduction to the methods of this valuable simulation technique. The second edition includes access to an internet site that provides the code, written in R and WinBUGS, used in many of the previously existing and new examples and exercises. More importantly, the self-explanatory nature of the codes will enable modification of the inputs to the codes and variation on many directions will be available for further exploration. Major changes from the previous edition: · More examples with discussion of computational details in chapters on Gibbs sampling and Metropolis-Hastings algorithms · Recent developments in MCMC, including reversible jump, slice sampling, bridge sampling, path sampling, multiple-try, and delayed rejection · Discussion of computation using both R and WinBUGS · Additional exercises and selected solutions within the text, with all data sets and software available for download from the Web · Sections on spatial models and model adequacy The self-contained text units make MCMC accessible to scientists in other disciplines as well as statisticians. The book will appeal to everyone working with MCMC techniques, especially research and graduate statisticians and biostatisticians, and scientists handling data and formulating models. The book has been substantially reinforced as a first reading of material on MCMC and, consequently, as a textbook for modern Bayesian computation and Bayesian inference courses.

Markov Chain Monte Carlo

Markov Chain Monte Carlo PDF Author: Dani Gamerman
Publisher: CRC Press
ISBN: 9780412818202
Category : Mathematics
Languages : en
Pages : 264

Get Book Here

Book Description
Bridging the gap between research and application, Markov Chain Monte Carlo: Stochastic Simulation for Bayesian Inference provides a concise, and integrated account of Markov chain Monte Carlo (MCMC) for performing Bayesian inference. This volume, which was developed from a short course taught by the author at a meeting of Brazilian statisticians and probabilists, retains the didactic character of the original course text. The self-contained text units make MCMC accessible to scientists in other disciplines as well as statisticians. It describes each component of the theory in detail and outlines related software, which is of particular benefit to applied scientists.