Semi- and Non-parametric Methods for Interval Censored Data with Shape Constraints

Semi- and Non-parametric Methods for Interval Censored Data with Shape Constraints PDF Author: Clifford Isaac Anderson-Bergman
Publisher:
ISBN: 9781303810138
Category :
Languages : en
Pages : 213

Get Book Here

Book Description
Interval censoring occurs when event times are known to have occurred within an interval, rather than observing the exact time of event. This includes observations that are right censored, left censored and contained in intervals such that the left side is greater than the origin and the right side is finite (i.e. neither right censored or left censored). For interval censored data, the most common survival estimator used is the non-parametric maximum likelihood estimator (NPMLE), a generalization of the Kaplan-Meier curve which does not require any uncensored event times. The popularity of this estimator is due in part to the fact that assessing model fit for interval censored data can be very difficult. However, the extreme flexibility of the estimator comes at the cost of high variance, often providing an n^(1/3) convergence rate rather than the more typical n^(1/2). In a compromise between a highly constrained parametric estimator and the overly flexible NPMLE, we apply the popular log-concave density constraint to the NPMLE. By constraining a non-parametric estimator to have a log-concave density, an inves- tigator can improve the performance without needing to select a parametric family or smoothing parameter. We describe a fast algorithm we have developed for finding the log-concave NPMLE for interval censored data. We demonstrate that using the constraint significantly reduces the variance of the survival estimates in comparison to the unconstrained NPMLE via simulations. Next, we present three inference methods for our new estimator. This includes a goodness of fit test, two methods of confidence interval construction and a Cox PH model which incorporates a baseline log-concave distribution. We evaluate the power of the goodness of fit test and compare the other inference methods with the unconstrained counterparts via simulation. We apply these methods to a study on the effects of different environments on the rates of lung cancer among mice and another study investigating age at menopause. While our work demonstrates that the application of the shape constraints can be very helpful in the context of interval censored data, in some situations the log- concave constraint may not allow for as heavy tailed distributions as the investigator would like. To address this, we propose a new, more flexible "inverse convex" shape constraint, examine its behavior via simulation and show that it provides a better fit than the log-concave estimator when applied to real income data, which is well known to be heavy tailed. We are very optimistic about applying this new estimator to censored data, although we have yet to implement an algorithm to do so. We end this work with an algorithm for finding the (unconstrained) bivariate NPMLE for interval censored data. The bivariate NPMLE is used when each subject has two censored outcomes and the investigator is interested in modeling the relation between the two outcomes. Quickly finding the NPMLE has proven to be a challenging computational problem, as the number of parameters to consider is of order O(n^2). We present an efficient EM algorithm to find the bivariate NPMLE. We note that this is not related to shape constrained estimation.

Semi- and Non-parametric Methods for Interval Censored Data with Shape Constraints

Semi- and Non-parametric Methods for Interval Censored Data with Shape Constraints PDF Author: Clifford Isaac Anderson-Bergman
Publisher:
ISBN: 9781303810138
Category :
Languages : en
Pages : 213

Get Book Here

Book Description
Interval censoring occurs when event times are known to have occurred within an interval, rather than observing the exact time of event. This includes observations that are right censored, left censored and contained in intervals such that the left side is greater than the origin and the right side is finite (i.e. neither right censored or left censored). For interval censored data, the most common survival estimator used is the non-parametric maximum likelihood estimator (NPMLE), a generalization of the Kaplan-Meier curve which does not require any uncensored event times. The popularity of this estimator is due in part to the fact that assessing model fit for interval censored data can be very difficult. However, the extreme flexibility of the estimator comes at the cost of high variance, often providing an n^(1/3) convergence rate rather than the more typical n^(1/2). In a compromise between a highly constrained parametric estimator and the overly flexible NPMLE, we apply the popular log-concave density constraint to the NPMLE. By constraining a non-parametric estimator to have a log-concave density, an inves- tigator can improve the performance without needing to select a parametric family or smoothing parameter. We describe a fast algorithm we have developed for finding the log-concave NPMLE for interval censored data. We demonstrate that using the constraint significantly reduces the variance of the survival estimates in comparison to the unconstrained NPMLE via simulations. Next, we present three inference methods for our new estimator. This includes a goodness of fit test, two methods of confidence interval construction and a Cox PH model which incorporates a baseline log-concave distribution. We evaluate the power of the goodness of fit test and compare the other inference methods with the unconstrained counterparts via simulation. We apply these methods to a study on the effects of different environments on the rates of lung cancer among mice and another study investigating age at menopause. While our work demonstrates that the application of the shape constraints can be very helpful in the context of interval censored data, in some situations the log- concave constraint may not allow for as heavy tailed distributions as the investigator would like. To address this, we propose a new, more flexible "inverse convex" shape constraint, examine its behavior via simulation and show that it provides a better fit than the log-concave estimator when applied to real income data, which is well known to be heavy tailed. We are very optimistic about applying this new estimator to censored data, although we have yet to implement an algorithm to do so. We end this work with an algorithm for finding the (unconstrained) bivariate NPMLE for interval censored data. The bivariate NPMLE is used when each subject has two censored outcomes and the investigator is interested in modeling the relation between the two outcomes. Quickly finding the NPMLE has proven to be a challenging computational problem, as the number of parameters to consider is of order O(n^2). We present an efficient EM algorithm to find the bivariate NPMLE. We note that this is not related to shape constrained estimation.

Non- and Semi-parametric Survival Analysis with Left Truncated and Interval Censored Data

Non- and Semi-parametric Survival Analysis with Left Truncated and Interval Censored Data PDF Author: Wei Pan
Publisher:
ISBN:
Category :
Languages : en
Pages : 224

Get Book Here

Book Description


The Statistical Analysis of Interval-censored Failure Time Data

The Statistical Analysis of Interval-censored Failure Time Data PDF Author: Jianguo Sun
Publisher: Springer
ISBN: 0387371192
Category : Mathematics
Languages : en
Pages : 310

Get Book Here

Book Description
This book collects and unifies statistical models and methods that have been proposed for analyzing interval-censored failure time data. It provides the first comprehensive coverage of the topic of interval-censored data and complements the books on right-censored data. The focus of the book is on nonparametric and semiparametric inferences, but it also describes parametric and imputation approaches. This book provides an up-to-date reference for people who are conducting research on the analysis of interval-censored failure time data as well as for those who need to analyze interval-censored data to answer substantive questions.

Survival Analysis with Interval-Censored Data

Survival Analysis with Interval-Censored Data PDF Author: Kris Bogaerts
Publisher: CRC Press
ISBN: 1420077481
Category : Mathematics
Languages : en
Pages : 617

Get Book Here

Book Description
Survival Analysis with Interval-Censored Data: A Practical Approach with Examples in R, SAS, and BUGS provides the reader with a practical introduction into the analysis of interval-censored survival times. Although many theoretical developments have appeared in the last fifty years, interval censoring is often ignored in practice. Many are unaware of the impact of inappropriately dealing with interval censoring. In addition, the necessary software is at times difficult to trace. This book fills in the gap between theory and practice. Features: -Provides an overview of frequentist as well as Bayesian methods. -Include a focus on practical aspects and applications. -Extensively illustrates the methods with examples using R, SAS, and BUGS. Full programs are available on a supplementary website. The authors: Kris Bogaerts is project manager at I-BioStat, KU Leuven. He received his PhD in science (statistics) at KU Leuven on the analysis of interval-censored data. He has gained expertise in a great variety of statistical topics with a focus on the design and analysis of clinical trials. Arnošt Komárek is associate professor of statistics at Charles University, Prague. His subject area of expertise covers mainly survival analysis with the emphasis on interval-censored data and classification based on longitudinal data. He is past chair of the Statistical Modelling Society and editor of Statistical Modelling: An International Journal. Emmanuel Lesaffre is professor of biostatistics at I-BioStat, KU Leuven. His research interests include Bayesian methods, longitudinal data analysis, statistical modelling, analysis of dental data, interval-censored data, misclassification issues, and clinical trials. He is the founding chair of the Statistical Modelling Society, past-president of the International Society for Clinical Biostatistics, and fellow of ISI and ASA.

Nonparametric and Parametric Survival Analysis of Censored Data with Possible Violation of Method Assumptions

Nonparametric and Parametric Survival Analysis of Censored Data with Possible Violation of Method Assumptions PDF Author: Guolin Zhao
Publisher:
ISBN:
Category : Mathematical statistics
Languages : en
Pages : 57

Get Book Here

Book Description
"Estimating survival functions has interested statisticians for numerous years. A survival function gives information on the probability of a time-to-event of interest. Research in the area of survival analysis has increased greatly over the last several decades because of its large usage in areas related to biostatistics and the pharmaceutical industry. Among the methods which estimate the survival function, several are widely used and available in popular statistical software programs. One purpose of this research is to compare the efficiency between competing estimators of the survival function. Results are given for simulations which use nonparametric and parametric estimation methods on censored data. The simulated data sets have right-, left-, or interval-censored time points. Comparisons are done on various types of data to see which survival function estimation methods are more suitable. We consider scenarios where distributional assumptions or censoring type assumptions are violated. Another goal of this research is to examine the effects of these incorrect assumptions."--Abstract from author supplied metadata.

The Nonparametric Least-squares Method for Estimating Monotone Functions with Interval-censored Observations

The Nonparametric Least-squares Method for Estimating Monotone Functions with Interval-censored Observations PDF Author: Gang Cheng
Publisher:
ISBN:
Category : Estimation theory
Languages : en
Pages : 159

Get Book Here

Book Description
The theory of modern empirical process is applied to prove the consistency of the proposed NPLSE. Simulation studies are extensively carried out to provide numerical evidence for the validity of the NPLSE. The proposed estimation method is applied to two real scientific applications. For the first application, California Partners' Study, we estimate the distribution function of HIV transmission time between two partners. In the second application, the NPLSEs of the mean functions of tumor growth are estimated for tumors with different stages at diagnosis based on the data from a cancer surveillance program, the SEER program. An ad-hoc nonparametric statistic is designed to test the difference between two monotone functions under this context. In this dissertation, we also propose a numerical algorithm, the projected Newton-Raphson algorithm, to compute the non- and semi-parametric estimate for the M-estimation problems subject to linear equality or inequality constraints. By combining the Newton-Raphson algorithm and the dual method for strictly convex quadratic programming, the projected Newton-Raphson algorithm shows the desired convergence rate. Compared to the well-known iterative convex minorant algorithm, the projected Newton-Raphson algorithm achieves much quicker convergence when computing the non- and semi-parametric maximum likelihood estimate of panel count data.

Order Theory and Nonparametric Analysis for Interval Censored Data

Order Theory and Nonparametric Analysis for Interval Censored Data PDF Author: Alain C. Vandal
Publisher:
ISBN:
Category : Nonparametric statistics
Languages : en
Pages : 216

Get Book Here

Book Description


Multi-State Survival Models for Interval-Censored Data

Multi-State Survival Models for Interval-Censored Data PDF Author: Ardo van den Hout
Publisher: CRC Press
ISBN: 1466568410
Category : Mathematics
Languages : en
Pages : 257

Get Book Here

Book Description
Multi-State Survival Models for Interval-Censored Data introduces methods to describe stochastic processes that consist of transitions between states over time. It is targeted at researchers in medical statistics, epidemiology, demography, and social statistics. One of the applications in the book is a three-state process for dementia and survival in the older population. This process is described by an illness-death model with a dementia-free state, a dementia state, and a dead state. Statistical modelling of a multi-state process can investigate potential associations between the risk of moving to the next state and variables such as age, gender, or education. A model can also be used to predict the multi-state process. The methods are for longitudinal data subject to interval censoring. Depending on the definition of a state, it is possible that the time of the transition into a state is not observed exactly. However, when longitudinal data are available the transition time may be known to lie in the time interval defined by two successive observations. Such an interval-censored observation scheme can be taken into account in the statistical inference. Multi-state modelling is an elegant combination of statistical inference and the theory of stochastic processes. Multi-State Survival Models for Interval-Censored Data shows that the statistical modelling is versatile and allows for a wide range of applications.

Emerging Topics in Modeling Interval-Censored Survival Data

Emerging Topics in Modeling Interval-Censored Survival Data PDF Author: Jianguo Sun
Publisher: Springer Nature
ISBN: 3031123662
Category : Mathematics
Languages : en
Pages : 322

Get Book Here

Book Description
This book primarily aims to discuss emerging topics in statistical methods and to booster research, education, and training to advance statistical modeling on interval-censored survival data. Commonly collected from public health and biomedical research, among other sources, interval-censored survival data can easily be mistaken for typical right-censored survival data, which can result in erroneous statistical inference due to the complexity of this type of data. The book invites a group of internationally leading researchers to systematically discuss and explore the historical development of the associated methods and their computational implementations, as well as emerging topics related to interval-censored data. It covers a variety of topics, including univariate interval-censored data, multivariate interval-censored data, clustered interval-censored data, competing risk interval-censored data, data with interval-censored covariates, interval-censored data from electric medical records, and misclassified interval-censored data. Researchers, students, and practitioners can directly make use of the state-of-the-art methods covered in the book to tackle their problems in research, education, training and consultation.

The Analysis of Interval-censored Survival Data

The Analysis of Interval-censored Survival Data PDF Author: M. Luz Calle
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description