Data-driven Dynamic Optimization with Auxiliary Covariates

Data-driven Dynamic Optimization with Auxiliary Covariates PDF Author: Christopher George McCord
Publisher:
ISBN:
Category :
Languages : en
Pages : 190

Get Book Here

Book Description
Optimization under uncertainty forms the foundation for many of the fundamental problems the operations research community seeks to solve. In this thesis, we develop and analyze algorithms that incorporate ideas from machine learning to optimize uncertain objectives directly from data. In the first chapter, we consider problems in which the decision affects the observed outcome, such as in personalized medicine and pricing. We present a framework for using observational data to learn to optimize an uncertain objective over a continuous and multi-dimensional decision space. Our approach accounts for the uncertainty in predictions, and we provide theoretical results that show this adds value. In addition, we test our approach on a Warfarin dosing example, and it outperforms the leading alternative methods. In the second chapter, we develop an approach for solving dynamic optimization problems with covariates that uses machine learning to approximate the unknown stochastic process of the uncertainty. We provide theoretical guarantees on the effectiveness of our method and validate the guarantees with computational experiments. In the third chapter, we introduce a distributionally robust approach for incorporating covariates in large-scale, data-driven dynamic optimization. We prove that it is asymptotically optimal and provide a tractable general-purpose approximation scheme that scales to problems with many temporal stages. Across examples in shipment planning, inventory management, and finance, our method achieves improvements of up to 15% over alternatives. In the final chapter, we apply the techniques developed in previous chapters to the problem of optimizing the operating room schedule at a major US hospital. Our partner institution faces significant census variability throughout the week, which limits the amount of patients it can accept due to resource constraints at peak times. We introduce a data-driven approach for this problem that combines machine learning with mixed integer optimization and demonstrate that it can reliably reduce the maximal weekly census.

Data-driven Dynamic Optimization with Auxiliary Covariates

Data-driven Dynamic Optimization with Auxiliary Covariates PDF Author: Christopher George McCord
Publisher:
ISBN:
Category :
Languages : en
Pages : 190

Get Book Here

Book Description
Optimization under uncertainty forms the foundation for many of the fundamental problems the operations research community seeks to solve. In this thesis, we develop and analyze algorithms that incorporate ideas from machine learning to optimize uncertain objectives directly from data. In the first chapter, we consider problems in which the decision affects the observed outcome, such as in personalized medicine and pricing. We present a framework for using observational data to learn to optimize an uncertain objective over a continuous and multi-dimensional decision space. Our approach accounts for the uncertainty in predictions, and we provide theoretical results that show this adds value. In addition, we test our approach on a Warfarin dosing example, and it outperforms the leading alternative methods. In the second chapter, we develop an approach for solving dynamic optimization problems with covariates that uses machine learning to approximate the unknown stochastic process of the uncertainty. We provide theoretical guarantees on the effectiveness of our method and validate the guarantees with computational experiments. In the third chapter, we introduce a distributionally robust approach for incorporating covariates in large-scale, data-driven dynamic optimization. We prove that it is asymptotically optimal and provide a tractable general-purpose approximation scheme that scales to problems with many temporal stages. Across examples in shipment planning, inventory management, and finance, our method achieves improvements of up to 15% over alternatives. In the final chapter, we apply the techniques developed in previous chapters to the problem of optimizing the operating room schedule at a major US hospital. Our partner institution faces significant census variability throughout the week, which limits the amount of patients it can accept due to resource constraints at peak times. We introduce a data-driven approach for this problem that combines machine learning with mixed integer optimization and demonstrate that it can reliably reduce the maximal weekly census.

Data-Driven Evolutionary Optimization

Data-Driven Evolutionary Optimization PDF Author: Yaochu Jin
Publisher: Springer Nature
ISBN: 3030746402
Category : Computers
Languages : en
Pages : 393

Get Book Here

Book Description
Intended for researchers and practitioners alike, this book covers carefully selected yet broad topics in optimization, machine learning, and metaheuristics. Written by world-leading academic researchers who are extremely experienced in industrial applications, this self-contained book is the first of its kind that provides comprehensive background knowledge, particularly practical guidelines, and state-of-the-art techniques. New algorithms are carefully explained, further elaborated with pseudocode or flowcharts, and full working source code is made freely available. This is followed by a presentation of a variety of data-driven single- and multi-objective optimization algorithms that seamlessly integrate modern machine learning such as deep learning and transfer learning with evolutionary and swarm optimization algorithms. Applications of data-driven optimization ranging from aerodynamic design, optimization of industrial processes, to deep neural architecture search are included.

Dynamic Optimization in the Age of Big Data

Dynamic Optimization in the Age of Big Data PDF Author: Bradley Eli Sturt
Publisher:
ISBN:
Category :
Languages : en
Pages : 249

Get Book Here

Book Description
This thesis revisits a fundamental class of dynamic optimization problems introduced by Dantzig (1955). These decision problems remain widely studied in many applications domains (e.g., inventory management, finance, energy planning) but require access to probability distributions that are rarely known in practice. First, we propose a new data-driven approach for addressing multi-stage stochastic linear optimization problems with unknown probability distributions. The approach consists of solving a robust optimization problem that is constructed from sample paths of the underlying stochastic process. As more sample paths are obtained, we prove that the optimal cost of the robust problem converges to that of the underlying stochastic problem. To the best of our knowledge, this is the first data-driven approach for multi-stage stochastic linear optimization problems which is asymptotically optimal when uncertainty is arbitrarily correlated across time. Next, we develop approximation algorithms for the proposed data-driven approach by extending techniques from the field of robust optimization. In particular, we present a simple approximation algorithm, based on overlapping linear decision rules, which can be reformulated as a tractable linear optimization problem with size that scales linearly in the number of data points. For two-stage problems, we show the approximation algorithm is also asymptotically optimal, meaning that the optimal cost of the approximation algorithm converges to that of the underlying stochastic problem as the number of data points tends to infinity. Finally, we extend the proposed data-driven approach to address multi-stage stochastic linear optimization problems with side information. The approach combines predictive machine learning methods (such as K-nearest neighbors, kernel regression, and random forests) with the proposed robust optimization framework. We prove that this machine learning-based approach is asymptotically optimal, and demonstrate the value of the proposed methodology in numerical experiments in the context of inventory management, scheduling, and finance.

Targeted Learning in Data Science

Targeted Learning in Data Science PDF Author: Mark J. van der Laan
Publisher: Springer
ISBN: 3319653040
Category : Mathematics
Languages : en
Pages : 655

Get Book Here

Book Description
This textbook for graduate students in statistics, data science, and public health deals with the practical challenges that come with big, complex, and dynamic data. It presents a scientific roadmap to translate real-world data science applications into formal statistical estimation problems by using the general template of targeted maximum likelihood estimators. These targeted machine learning algorithms estimate quantities of interest while still providing valid inference. Targeted learning methods within data science area critical component for solving scientific problems in the modern age. The techniques can answer complex questions including optimal rules for assigning treatment based on longitudinal data with time-dependent confounding, as well as other estimands in dependent data structures, such as networks. Included in Targeted Learning in Data Science are demonstrations with soft ware packages and real data sets that present a case that targeted learning is crucial for the next generation of statisticians and data scientists. Th is book is a sequel to the first textbook on machine learning for causal inference, Targeted Learning, published in 2011. Mark van der Laan, PhD, is Jiann-Ping Hsu/Karl E. Peace Professor of Biostatistics and Statistics at UC Berkeley. His research interests include statistical methods in genomics, survival analysis, censored data, machine learning, semiparametric models, causal inference, and targeted learning. Dr. van der Laan received the 2004 Mortimer Spiegelman Award, the 2005 Van Dantzig Award, the 2005 COPSS Snedecor Award, the 2005 COPSS Presidential Award, and has graduated over 40 PhD students in biostatistics and statistics. Sherri Rose, PhD, is Associate Professor of Health Care Policy (Biostatistics) at Harvard Medical School. Her work is centered on developing and integrating innovative statistical approaches to advance human health. Dr. Rose’s methodological research focuses on nonparametric machine learning for causal inference and prediction. She co-leads the Health Policy Data Science Lab and currently serves as an associate editor for the Journal of the American Statistical Association and Biostatistics.

Dissertation Abstracts International

Dissertation Abstracts International PDF Author:
Publisher:
ISBN:
Category : Dissertations, Academic
Languages : en
Pages : 886

Get Book Here

Book Description


Dynamic Models for Knowledge-Driven Organizations

Dynamic Models for Knowledge-Driven Organizations PDF Author: Jennex, Murray E.
Publisher: IGI Global
ISBN: 1466624868
Category : Business & Economics
Languages : en
Pages : 443

Get Book Here

Book Description
Since knowledge systems and knowledge management programs are put in place to monitor workers in the performance of their jobs; knowledge is, therefore, an essential component in the achievement of goals and production of economic benefit of an organization. Dynamic Models for Knowledge-Driven Organizations presents a widespread collection of research on the understanding of the managerial, technical and human issues associated with the use of knowledge in organizations while bearing in mind the design, development, and maintenance of useful knowledge management systems. This reference is essential for the tools and information needed to effectively implement knowledge management systems and would benefit researchers and practitioners alike.

Computational Science and Its Applications - ICCSA 2008

Computational Science and Its Applications - ICCSA 2008 PDF Author: Osvaldo Gervasi
Publisher: Springer Science & Business Media
ISBN: 3540698388
Category : Computers
Languages : en
Pages : 1283

Get Book Here

Book Description
The two-volume set LNCS 5072 and 5073 constitutes the refereed proceedings of the International Conference on Computational Science and Its Applications, ICCSA 2008, held in Perugia, Italy, in June/July, 2008. The two volumes contain papers presenting a wealth of original research results in the field of computational science, from foundational issues in computer science and mathematics to advanced applications in virtually all sciences making use of computational techniques. The topics of the fully refereed papers are structured according to the five major conference themes: computational methods, algorithms and scientific applications, high performance technical computing and networks, advanced and emerging applications, geometric modelling, graphics and visualization, as well as information systems and information technologies. Moreover, submissions from more than 20 workshops and technical sessions in the areas, such as embedded systems, geographical analysis, computational geometry, computational geomatics, computer graphics, virtual reality, computer modeling, computer algebra, mobile communications, wireless networks, computational forensics, data storage, information security, web learning, software engineering, computational intelligence, digital security, biometrics, molecular structures, material design, ubiquitous computing, symbolic computations, web systems and intelligence, and e-education contribute to this publication.

Dynamic Linear Models with R

Dynamic Linear Models with R PDF Author: Giovanni Petris
Publisher: Springer Science & Business Media
ISBN: 0387772383
Category : Mathematics
Languages : en
Pages : 258

Get Book Here

Book Description
State space models have gained tremendous popularity in recent years in as disparate fields as engineering, economics, genetics and ecology. After a detailed introduction to general state space models, this book focuses on dynamic linear models, emphasizing their Bayesian analysis. Whenever possible it is shown how to compute estimates and forecasts in closed form; for more complex models, simulation techniques are used. A final chapter covers modern sequential Monte Carlo algorithms. The book illustrates all the fundamental steps needed to use dynamic linear models in practice, using R. Many detailed examples based on real data sets are provided to show how to set up a specific model, estimate its parameters, and use it for forecasting. All the code used in the book is available online. No prior knowledge of Bayesian statistics or time series analysis is required, although familiarity with basic statistics and R is assumed.

Safety and Reliability: Methodology and Applications

Safety and Reliability: Methodology and Applications PDF Author: Tomasz Nowakowski
Publisher: CRC Press
ISBN: 1315736977
Category : Technology & Engineering
Languages : en
Pages : 408

Get Book Here

Book Description
Within the last fifty years the performance requirements for technical objects and systems were supplemented with: customer expectations (quality), abilities to prevent the loss of the object properties in operation time (reliability and maintainability), protection against the effects of undesirable events (safety and security) and the ability to

Targeted Learning

Targeted Learning PDF Author: Mark J. van der Laan
Publisher: Springer Science & Business Media
ISBN: 1441997822
Category : Mathematics
Languages : en
Pages : 628

Get Book Here

Book Description
The statistics profession is at a unique point in history. The need for valid statistical tools is greater than ever; data sets are massive, often measuring hundreds of thousands of measurements for a single subject. The field is ready to move towards clear objective benchmarks under which tools can be evaluated. Targeted learning allows (1) the full generalization and utilization of cross-validation as an estimator selection tool so that the subjective choices made by humans are now made by the machine, and (2) targeting the fitting of the probability distribution of the data toward the target parameter representing the scientific question of interest. This book is aimed at both statisticians and applied researchers interested in causal inference and general effect estimation for observational and experimental data. Part I is an accessible introduction to super learning and the targeted maximum likelihood estimator, including related concepts necessary to understand and apply these methods. Parts II-IX handle complex data structures and topics applied researchers will immediately recognize from their own research, including time-to-event outcomes, direct and indirect effects, positivity violations, case-control studies, censored data, longitudinal data, and genomic studies.