Discretization and MCMC Convergence Assessment

Discretization and MCMC Convergence Assessment PDF Author: Christian P. Robert
Publisher: Springer Science & Business Media
ISBN: 1461217164
Category : Mathematics
Languages : en
Pages : 201

Get Book Here

Book Description
The exponential increase in the use of MCMC methods and the corre sponding applications in domains of even higher complexity have caused a growing concern about the available convergence assessment methods and the realization that some of these methods were not reliable enough for all-purpose analyses. Some researchers have mainly focussed on the con vergence to stationarity and the estimation of rates of convergence, in rela tion with the eigenvalues of the transition kernel. This monograph adopts a different perspective by developing (supposedly) practical devices to assess the mixing behaviour of the chain under study and, more particularly, it proposes methods based on finite (state space) Markov chains which are obtained either through a discretization of the original Markov chain or through a duality principle relating a continuous state space Markov chain to another finite Markov chain, as in missing data or latent variable models. The motivation for the choice of finite state spaces is that, although the resulting control is cruder, in the sense that it can often monitor con vergence for the discretized version alone, it is also much stricter than alternative methods, since the tools available for finite Markov chains are universal and the resulting transition matrix can be estimated more accu rately. Moreover, while some setups impose a fixed finite state space, other allow for possible refinements in the discretization level and for consecutive improvements in the convergence monitoring.

Discretization and MCMC Convergence Assessment

Discretization and MCMC Convergence Assessment PDF Author: Christian P. Robert
Publisher: Springer Science & Business Media
ISBN: 9780387985916
Category : Mathematics
Languages : en
Pages : 212

Get Book Here

Book Description
This monograph proposes several approaches to convergence monitoring for MCMC algorithms which are centered on the theme of discrete Markov chains. After a short introduction to MCMC methods, including recent developments like perfect simulation and Langevin Metropolis-Hastings algorithms, and to the current convergence diagnostics, the contributors present the theoretical basis for a study of MCMC convergence using discrete Markov chains and their specificities. The contributors stress in particular that this study applies in a wide generality, starting with latent variable models like mixtures, then extending the scope to chains with renewal properties, and concluding with a general Markov chain. They then relate the different connections with discrete or finite Markov chains with practical convergence diagnostics which are either graphical plots (allocation map, divergence graph, variance stabilizing, normality plot), stopping rules (normality, stationarity, stability tests), or confidence bounds (divergence, asymptotic variance, normality). Most of the quantitative tools take advantage of manageable versions of the CLT. The different methods proposed here are first evaluated on a set of benchmark examples and then studied on three full scale realistic applications, along with the standard convergence diagnostics: A hidden Markov modelling of DNA sequences, including a perfect simulation implementation, a latent stage modelling of the dynamics of HIV infection, and a modelling of hospitalization duration by exponential mixtures. The monograph is the outcome of a monthly research seminar held at CREST, Paris, since 1995. The seminar involved the contributors to this monograph and was led by Christian P. Robert, Head of the Satistics Laboratory at CREST and Professor of Statistics at the University of Rouen since 1992.

Discretization and MCMC Convergence Assessment

Discretization and MCMC Convergence Assessment PDF Author: Christian P. Robert
Publisher: Springer Science & Business Media
ISBN: 1461217164
Category : Mathematics
Languages : en
Pages : 201

Get Book Here

Book Description
The exponential increase in the use of MCMC methods and the corre sponding applications in domains of even higher complexity have caused a growing concern about the available convergence assessment methods and the realization that some of these methods were not reliable enough for all-purpose analyses. Some researchers have mainly focussed on the con vergence to stationarity and the estimation of rates of convergence, in rela tion with the eigenvalues of the transition kernel. This monograph adopts a different perspective by developing (supposedly) practical devices to assess the mixing behaviour of the chain under study and, more particularly, it proposes methods based on finite (state space) Markov chains which are obtained either through a discretization of the original Markov chain or through a duality principle relating a continuous state space Markov chain to another finite Markov chain, as in missing data or latent variable models. The motivation for the choice of finite state spaces is that, although the resulting control is cruder, in the sense that it can often monitor con vergence for the discretized version alone, it is also much stricter than alternative methods, since the tools available for finite Markov chains are universal and the resulting transition matrix can be estimated more accu rately. Moreover, while some setups impose a fixed finite state space, other allow for possible refinements in the discretization level and for consecutive improvements in the convergence monitoring.

An Automated Stopping Rule for MCMC Convergence Assessment

An Automated Stopping Rule for MCMC Convergence Assessment PDF Author: Didier Chauveau
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
In this paper, we propose a methodology essentially based on the Central Limit Theorem for Markov chains to monitor convergence of MCMC algorithms using actual outputs. Our methods are grounded on the fact that normality is a testable implication of sufficient mixing. The first control tool tests the normality hypothesis for normalized averages of functions of the Markov chain over independent parallel chains started from a dispersed distribution. A second connected tool is based on graphical monitoring of the stabilization of the variance after n iterations near the limiting variance. Both methods work without knowledge on the sampler driving the chain, and the normality diagnostic leads to automated stopping rules. These stopping rules are implemented in a software toolbox whose performances are illustrated through simulations for finite and continuous state chains reflecting some typical situations and a full scale application. Comparisons are made with the binary control method of Raftery and Lewis.

Convergence Diagnostics for MCMC Methods in the Bayesian Analysis of Volatility Models

Convergence Diagnostics for MCMC Methods in the Bayesian Analysis of Volatility Models PDF Author: P. Giudici
Publisher:
ISBN:
Category :
Languages : en
Pages : 24

Get Book Here

Book Description


Monte Carlo Statistical Methods

Monte Carlo Statistical Methods PDF Author: Christian Robert
Publisher: Springer Science & Business Media
ISBN: 1475741456
Category : Mathematics
Languages : en
Pages : 670

Get Book Here

Book Description
We have sold 4300 copies worldwide of the first edition (1999). This new edition contains five completely new chapters covering new developments.

Possible Biases Induced by MCMC Convergence Diagnostics

Possible Biases Induced by MCMC Convergence Diagnostics PDF Author: Mary Kathryn Cowles
Publisher:
ISBN:
Category : Markov processes
Languages : en
Pages : 19

Get Book Here

Book Description


A Pathological MCMC Algorithm and Its Use as a Benchmark for Convergence Assessment Techniques

A Pathological MCMC Algorithm and Its Use as a Benchmark for Convergence Assessment Techniques PDF Author: Christian P. Robert
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description


On Testing MCMC Convergence in Bayesian Clustering

On Testing MCMC Convergence in Bayesian Clustering PDF Author: Masoud Asgharian
Publisher:
ISBN:
Category :
Languages : en
Pages : 16

Get Book Here

Book Description


Convergence Analysis of Markov Chain Monte Carlo Estimators of Discrete Choice Models in Transportation

Convergence Analysis of Markov Chain Monte Carlo Estimators of Discrete Choice Models in Transportation PDF Author: Chen Wang
Publisher:
ISBN:
Category :
Languages : en
Pages : 62

Get Book Here

Book Description
Although Bayes estimators are attractive for discrete choice models involving complex non-convex optimization and weak identification, researchers in transportation seem somewhat reluctant to adopt the Bayesian approach. A common argument against simulation-based Bayes estimators is that there are no general rules for assessing convergence. In this thesis, we study convergence of the Markov chain Monte Carlo (MCMC) estimator of logit and probit models, not only in marginal utility (preference) space but also in willingness-to-pay space. We use personal vehicle choice as case study, and we apply a series of convergence diagnostics. Because under regularity conditions the asymptotic distributions of frequentist and Bayes estimators coincide, we also compare the behavior of the posterior first and second moments with that of the point estimates of maximum (simulated) likelihood. When working in preference space, the Bayes estimators converge rather quickly. However, problems appear when analyzing convergence of willingness-to-pay measures that have not been discussed in previous literature. In particular, we observed that.

MCMC Convergence Diagnostics

MCMC Convergence Diagnostics PDF Author: Chantal Guihenneuc-Jouyaux
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description