Break Point Estimation and Variable Selection in Quantile Regressions

Break Point Estimation and Variable Selection in Quantile Regressions PDF Author: Ming Zhong
Publisher:
ISBN: 9781267666772
Category :
Languages : en
Pages :

Get Book Here

Book Description
In both statistics and econometrics, there is a large amount of research literature on issues related to structural breaks. Since checking model stability is a long-standing problem in regression (or autoregression) models, it is desirable to develop methodsto test the presence of break points, and estimate their locations if they exist. By doing so a data series may be segmented into several subseries, which are commonly assumed to have the same functional form but dierent parameters. Another important issue in multiple regressions involves determining which covariates are to be included in the final model. In practice, it is often the case that many covariates are collected and a large parametric model is built at the initial stage. However, the inclusion of irrelevant variables may reduce model performance and stability, aggravate computational burden, and make the resultant model difficult to interpret. Thus, how to efficiently select a subset of significant covariates upon which the response variable depends is of key importance when building multiple regressionmodels. The goal of our research focuses on the above-mentioned two questions: break point detection and variable selection. In Chapter 2, we jointly address both issues in a quantile regression setting. We then elaborate on the problem of break point detection for nonstationary time series in Chapter 3. For both investigations, we emphasize the importance of utilizing quantile related models, and develop methodologies based on them. In Chapter 1, we first introduce the quantile regression model. Distinct from classical regressions in which parameter estimates are derived based on the conditional mean of the response variable given certain values of the predictor variables, quantile regressions aim at estimating either at the conditional median or other quantiles of the response variable. As time series counterpart, the quantile autoregression model is then presented, and shown to be a member of the class of random coefficient autoregressions, often used in time series analysis. We further introduce the problem of break point detection and variable selection in detail, and conduct a literature review on these two topics. As the goal is to nd the best model (either with correctly identified break points, or with appropriately selected variables, or both), the estimation criterion (based on the Minimum Description Length Principle) and the optimization algorithm (based on a Genetic Algorithm) are illustrated. In the second chapter, we propose a new procedure for simultaneously estimating the number and locations of structural breaks and conducting variable selection at conditional quantile(s). In particular, with piecewise quantile regression structure, the estimated segments with selected variables are expected to minimize a convex objective function, and a genetic algorithm is implemented to solve this optimization problem. To incorporate possibly skewed and heavy-tailed innovations into the model building process, we propose the use of Asymmetric Laplace innovations as a substitute of Gaussian innovations. We develop large sample properties and theoretical justifications for the consistency of this method. Numerical results from simulations and data applications show that the proposed approach turns out to be competitive with and often superior to a number of existing methods. The third chapter presents the approach for estimating the number and locations of break points in nonstationary time series via quantile autoregression models. The methodology and its implementation details are linked to those in Chapter 2. Asymptotic properties and theoretical justifications for the consistency of this method are derived, and several simulations as well as data applications are employed to illustrate that our method consistently estimates the number and locations of the breaks.

Break Point Estimation and Variable Selection in Quantile Regressions

Break Point Estimation and Variable Selection in Quantile Regressions PDF Author: Ming Zhong
Publisher:
ISBN: 9781267666772
Category :
Languages : en
Pages :

Get Book Here

Book Description
In both statistics and econometrics, there is a large amount of research literature on issues related to structural breaks. Since checking model stability is a long-standing problem in regression (or autoregression) models, it is desirable to develop methodsto test the presence of break points, and estimate their locations if they exist. By doing so a data series may be segmented into several subseries, which are commonly assumed to have the same functional form but dierent parameters. Another important issue in multiple regressions involves determining which covariates are to be included in the final model. In practice, it is often the case that many covariates are collected and a large parametric model is built at the initial stage. However, the inclusion of irrelevant variables may reduce model performance and stability, aggravate computational burden, and make the resultant model difficult to interpret. Thus, how to efficiently select a subset of significant covariates upon which the response variable depends is of key importance when building multiple regressionmodels. The goal of our research focuses on the above-mentioned two questions: break point detection and variable selection. In Chapter 2, we jointly address both issues in a quantile regression setting. We then elaborate on the problem of break point detection for nonstationary time series in Chapter 3. For both investigations, we emphasize the importance of utilizing quantile related models, and develop methodologies based on them. In Chapter 1, we first introduce the quantile regression model. Distinct from classical regressions in which parameter estimates are derived based on the conditional mean of the response variable given certain values of the predictor variables, quantile regressions aim at estimating either at the conditional median or other quantiles of the response variable. As time series counterpart, the quantile autoregression model is then presented, and shown to be a member of the class of random coefficient autoregressions, often used in time series analysis. We further introduce the problem of break point detection and variable selection in detail, and conduct a literature review on these two topics. As the goal is to nd the best model (either with correctly identified break points, or with appropriately selected variables, or both), the estimation criterion (based on the Minimum Description Length Principle) and the optimization algorithm (based on a Genetic Algorithm) are illustrated. In the second chapter, we propose a new procedure for simultaneously estimating the number and locations of structural breaks and conducting variable selection at conditional quantile(s). In particular, with piecewise quantile regression structure, the estimated segments with selected variables are expected to minimize a convex objective function, and a genetic algorithm is implemented to solve this optimization problem. To incorporate possibly skewed and heavy-tailed innovations into the model building process, we propose the use of Asymmetric Laplace innovations as a substitute of Gaussian innovations. We develop large sample properties and theoretical justifications for the consistency of this method. Numerical results from simulations and data applications show that the proposed approach turns out to be competitive with and often superior to a number of existing methods. The third chapter presents the approach for estimating the number and locations of break points in nonstationary time series via quantile autoregression models. The methodology and its implementation details are linked to those in Chapter 2. Asymptotic properties and theoretical justifications for the consistency of this method are derived, and several simulations as well as data applications are employed to illustrate that our method consistently estimates the number and locations of the breaks.

Quantile Regression

Quantile Regression PDF Author: Marilena Furno
Publisher: John Wiley & Sons
ISBN: 111886364X
Category : Mathematics
Languages : en
Pages : 311

Get Book Here

Book Description
Contains an overview of several technical topics of Quantile Regression Volume two of Quantile Regression offers an important guide for applied researchers that draws on the same example-based approach adopted for the first volume. The text explores topics including robustness, expectiles, m-quantile, decomposition, time series, elemental sets and linear programming. Graphical representations are widely used to visually introduce several issues, and to illustrate each method. All the topics are treated theoretically and using real data examples. Designed as a practical resource, the book is thorough without getting too technical about the statistical background. The authors cover a wide range of QR models useful in several fields. The software commands in R and Stata are available in the appendixes and featured on the accompanying website. The text: Provides an overview of several technical topics such as robustness of quantile regressions, bootstrap and elemental sets, treatment effect estimators Compares quantile regression with alternative estimators like expectiles, M-estimators and M-quantiles Offers a general introduction to linear programming focusing on the simplex method as solving method for the quantile regression problem Considers time-series issues like non-stationarity, spurious regressions, cointegration, conditional heteroskedasticity via quantile regression Offers an analysis that is both theoretically and practical Presents real data examples and graphical representations to explain the technical issues Written for researchers and students in the fields of statistics, economics, econometrics, social and environmental science, this text offers guide to the theory and application of quantile regression models.

Handbook of Quantile Regression

Handbook of Quantile Regression PDF Author: Roger Koenker
Publisher: CRC Press
ISBN: 1351646567
Category : Mathematics
Languages : en
Pages : 739

Get Book Here

Book Description
Quantile regression constitutes an ensemble of statistical techniques intended to estimate and draw inferences about conditional quantile functions. Median regression, as introduced in the 18th century by Boscovich and Laplace, is a special case. In contrast to conventional mean regression that minimizes sums of squared residuals, median regression minimizes sums of absolute residuals; quantile regression simply replaces symmetric absolute loss by asymmetric linear loss. Since its introduction in the 1970's by Koenker and Bassett, quantile regression has been gradually extended to a wide variety of data analytic settings including time series, survival analysis, and longitudinal data. By focusing attention on local slices of the conditional distribution of response variables it is capable of providing a more complete, more nuanced view of heterogeneous covariate effects. Applications of quantile regression can now be found throughout the sciences, including astrophysics, chemistry, ecology, economics, finance, genomics, medicine, and meteorology. Software for quantile regression is now widely available in all the major statistical computing environments. The objective of this volume is to provide a comprehensive review of recent developments of quantile regression methodology illustrating its applicability in a wide range of scientific settings. The intended audience of the volume is researchers and graduate students across a diverse set of disciplines.

Quantile Regression for Cross-Sectional and Time Series Data

Quantile Regression for Cross-Sectional and Time Series Data PDF Author: Jorge M. Uribe
Publisher: Springer Nature
ISBN: 3030445046
Category : Business & Economics
Languages : en
Pages : 63

Get Book Here

Book Description
This brief addresses the estimation of quantile regression models from a practical perspective, which will support researchers who need to use conditional quantile regression to measure economic relationships among a set of variables. It will also benefit students using the methodology for the first time, and practitioners at private or public organizations who are interested in modeling different fragments of the conditional distribution of a given variable. The book pursues a practical approach with reference to energy markets, helping readers learn the main features of the technique more quickly. Emphasis is placed on the implementation details and the correct interpretation of the quantile regression coefficients rather than on the technicalities of the method, unlike the approach used in the majority of the literature. All applications are illustrated with R.

Quantile Regression

Quantile Regression PDF Author: Marilena Furno
Publisher: John Wiley & Sons
ISBN: 1118863593
Category : Mathematics
Languages : en
Pages : 307

Get Book Here

Book Description
Contains an overview of several technical topics of Quantile Regression Volume two of Quantile Regression offers an important guide for applied researchers that draws on the same example-based approach adopted for the first volume. The text explores topics including robustness, expectiles, m-quantile, decomposition, time series, elemental sets and linear programming. Graphical representations are widely used to visually introduce several issues, and to illustrate each method. All the topics are treated theoretically and using real data examples. Designed as a practical resource, the book is thorough without getting too technical about the statistical background. The authors cover a wide range of QR models useful in several fields. The software commands in R and Stata are available in the appendixes and featured on the accompanying website. The text: Provides an overview of several technical topics such as robustness of quantile regressions, bootstrap and elemental sets, treatment effect estimators Compares quantile regression with alternative estimators like expectiles, M-estimators and M-quantiles Offers a general introduction to linear programming focusing on the simplex method as solving method for the quantile regression problem Considers time-series issues like non-stationarity, spurious regressions, cointegration, conditional heteroskedasticity via quantile regression Offers an analysis that is both theoretically and practical Presents real data examples and graphical representations to explain the technical issues Written for researchers and students in the fields of statistics, economics, econometrics, social and environmental science, this text offers guide to the theory and application of quantile regression models.

Estimating and Testing Quantile Regression with Structural Changes

Estimating and Testing Quantile Regression with Structural Changes PDF Author: Jau-er Chen
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
This paper considers the issues related to the asymptotic properties of estimators and test statistics in linear quantile regression with structural changes. We first address the issue of estimating a single structural change and derive the asymptotic properties of the estimated break point. The rate of convergence of the estimated break point is derived. As a supplementary tool, a smoothed empirical likelihood ratio test is proposed for testing structural changes at the estimated break dates. Furthermore we propose a likelihood-ratio-type test for multiple structural changes in quantile regression. The number of break points can be consistently determined via the test procedure. Finally we construct an algorithm based on the principle of dynamic programming to estimate multiple structural changes occurring at unknown dates. Monte Carlo studies show that our method consistently estimates each break point.

Quantile Regression

Quantile Regression PDF Author: I. Gusti Ngurah Agung
Publisher: John Wiley & Sons
ISBN: 1119715180
Category : Mathematics
Languages : en
Pages : 496

Get Book Here

Book Description
QUANTILE REGRESSION A thorough presentation of Quantile Regression designed to help readers obtain richer information from data analyses The conditional least-square or mean-regression (MR) analysis is the quantitative research method used to model and analyze the relationships between a dependent variable and one or more independent variables, where each equation estimation of a regression can give only a single regression function or fitted values variable. As an advanced mean regression analysis, each estimation equation of the mean-regression can be used directly to estimate the conditional quantile regression (QR), which can quickly present the statistical results of a set nine QR(τ)s for τ(tau)s from 0.1 up to 0.9 to predict detail distribution of the response or criterion variable. QR is an important analytical tool in many disciplines such as statistics, econometrics, ecology, healthcare, and engineering. Quantile Regression: Applications on Experimental and Cross Section Data Using EViews provides examples of statistical results of various QR analyses based on experimental and cross section data of a variety of regression models. The author covers the applications of one-way, two-way, and n-way ANOVA quantile regressions, QRs with multi numerical predictors, heterogeneous QRs, and latent variables QRs, amongst others. Throughout the text, readers learn how to develop the best possible quantile regressions and how to conduct more advanced analysis using methods such as the quantile process, the Wald test, the redundant variables test, residual analysis, the stability test, and the omitted variables test. This rigorous volume: Describes how QR can provide a more detailed picture of the relationships between independent variables and the quantiles of the criterion variable, by using the least-square regression Presents the applications of the test for any quantile of any numerical response or criterion variable Explores relationship of QR with heterogeneity: how an independent variable affects a dependent variable Offers expert guidance on forecasting and how to draw the best conclusions from the results obtained Provides a step-by-step estimation method and guide to enable readers to conduct QR analysis using their own data sets Includes a detailed comparison of conditional QR and conditional mean regression Quantile Regression: Applications on Experimental and Cross Section Data Using EViews is a highly useful resource for students and lecturers in statistics, data analysis, econometrics, engineering, ecology, and healthcare, particularly those specializing in regression and quantitative data analysis.

Quantile Regression

Quantile Regression PDF Author: Cristina Davino
Publisher: John Wiley & Sons
ISBN: 1118752716
Category : Mathematics
Languages : en
Pages : 288

Get Book Here

Book Description
A guide to the implementation and interpretation of Quantile Regression models This book explores the theory and numerous applications of quantile regression, offering empirical data analysis as well as the software tools to implement the methods. The main focus of this book is to provide the reader with a comprehensive description of the main issues concerning quantile regression; these include basic modeling, geometrical interpretation, estimation and inference for quantile regression, as well as issues on validity of the model, diagnostic tools. Each methodological aspect is explored and followed by applications using real data. Quantile Regression: Presents a complete treatment of quantile regression methods, including, estimation, inference issues and application of methods. Delivers a balance between methodolgy and application Offers an overview of the recent developments in the quantile regression framework and why to use quantile regression in a variety of areas such as economics, finance and computing. Features a supporting website (www.wiley.com/go/quantile_regression) hosting datasets along with R, Stata and SAS software code. Researchers and PhD students in the field of statistics, economics, econometrics, social and environmental science and chemistry will benefit from this book.

Distributed Quantile Regression Analysis and a Group Variable Selection Method

Distributed Quantile Regression Analysis and a Group Variable Selection Method PDF Author: Liqun Yu (Mathematician)
Publisher:
ISBN:
Category : Electronic dissertations
Languages : en
Pages : 126

Get Book Here

Book Description
This dissertation develops novel methodologies for distributed quantile regression analysis for big data by utilizing a distributed optimization algorithm called the alternating direction method of multipliers (ADMM). Specifically, we first write the penalized quantile regression into a specific form that can be solved by the ADMM and propose numerical algorithms for solving the ADMM subproblems. This results in the distributed QR-ADMM algorithm. Then, to further reduce the computational time, we formulate the penalized quantile regression into another equivalent ADMM form in which all the subproblems have exact closed-form solutions and hence avoid iterative numerical methods. This results in the single-loop QPADM algorithm that further improve on the computational efficiency of the QR-ADMM. Both QR-ADMM and QPADM enjoy flexible parallelization by enabling data splitting across both sample space and feature space, which make them especially appealing for the case when both sample size n and feature dimension p are large. Besides the QR-ADMM and QPADM algorithms for penalized quantile regression, we also develop a group variable selection method by approximating the Bayesian information criterion. Unlike existing penalization methods for feature selection, our proposed gMIC algorithm is free of parameter tuning and hence enjoys greater computational efficiency. Although the current version of gMIC focuses on the generalized linear model, it can be naturally extended to the quantile regression for feature selection. We provide theoretical analysis for our proposed methods. Specifically, we conduct numerical convergence analysis for the QR-ADMM and QPADM algorithms, and provide asymptotical theories and oracle property of feature selection for the gMIC method. All our methods are evaluated with simulation studies and real data analysis.

Quantile Regression for Spatial Data

Quantile Regression for Spatial Data PDF Author: Daniel P. McMillen
Publisher: Springer Science & Business Media
ISBN: 3642318150
Category : Business & Economics
Languages : en
Pages : 69

Get Book Here

Book Description
Quantile regression analysis differs from more conventional regression models in its emphasis on distributions. Whereas standard regression procedures show how the expected value of the dependent variable responds to a change in an explanatory variable, quantile regressions imply predicted changes for the entire distribution of the dependent variable. Despite its advantages, quantile regression is still not commonly used in the analysis of spatial data. The objective of this book is to make quantile regression procedures more accessible for researchers working with spatial data sets. The emphasis is on interpretation of quantile regression results. A series of examples using both simulated and actual data sets shows how readily seemingly complex quantile regression results can be interpreted with sets of well-constructed graphs. Both parametric and nonparametric versions of spatial models are considered in detail.