Dynamic Programming Decomposition Methods for Capacity Allocation and Network Revenue Management Problems

Dynamic Programming Decomposition Methods for Capacity Allocation and Network Revenue Management Problems PDF Author: Alexander Erdélyi
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
In this thesis, we develop decomposition-based approximate dynamic programming methods for problems in capacity allocation and network revenue management. Noting that the dynamic programming formulation of these problems suffers from the "curse of dimensionality", we demonstrate that a set of single-dimensional dynamic problems can be employed to provide approximate solutions to the original dynamic program. We show that the proposed approximations have two important characteristics: First, they provide relatively tight performance bounds on the optimal value of the stochastic optimization problem under consideration. Second, they give rise to policies that on average perform significantly better than a variety of benchmark methods found in the literature. We begin by focusing on network revenue management problems. We assume a profit maximizing airline operating a network of flight legs and processing itinerary requests arriving randomly over time. We consider several variants of the basic model and for each show that the dynamic programming formulation can be decomposed by flight legs into a set of single-leg revenue management problems. Furthermore, we demonstrate that the appropriate decomposition method gives rise to an upper bound on the optimal total expected revenue and that this upper bound is tighter than the upper bound provided by a deterministic linear program known from the literature. Finally, computational experiments show that the pol- icy based on the suggested value function approximation performs significantly better than a set of standard benchmark methods. In addition to network revenue management applications, we also consider a capacity allocation problem with a fixed amount of daily processing capacity. Here, the decision maker tries to minimize the cost of scheduling a set of jobs arriving randomly over time to be processed within a given planning horizon. The scheduling (holding) cost of a given job depends on its priority level and the length of its scheduled waiting period. In this setting, the decomposition approach that we suggest decomposes the problem by booking days. In particular, we replace the original dynamic program with a sequence of single-dimensional dynamic programs, each of which is concerned with capacity limitations on one particular booking day only. We show that our approach provides tight lower bounds on the minimum total expected holding cost. Furthermore, it gives rise to a scheduling policy that on average performs better than a variety of benchmark methods known from the literature.

Dynamic Programming Decomposition Methods for Capacity Allocation and Network Revenue Management Problems

Dynamic Programming Decomposition Methods for Capacity Allocation and Network Revenue Management Problems PDF Author: Alexander Erdélyi
Publisher:
ISBN:
Category :
Languages : en
Pages : 0

Get Book Here

Book Description
In this thesis, we develop decomposition-based approximate dynamic programming methods for problems in capacity allocation and network revenue management. Noting that the dynamic programming formulation of these problems suffers from the "curse of dimensionality", we demonstrate that a set of single-dimensional dynamic problems can be employed to provide approximate solutions to the original dynamic program. We show that the proposed approximations have two important characteristics: First, they provide relatively tight performance bounds on the optimal value of the stochastic optimization problem under consideration. Second, they give rise to policies that on average perform significantly better than a variety of benchmark methods found in the literature. We begin by focusing on network revenue management problems. We assume a profit maximizing airline operating a network of flight legs and processing itinerary requests arriving randomly over time. We consider several variants of the basic model and for each show that the dynamic programming formulation can be decomposed by flight legs into a set of single-leg revenue management problems. Furthermore, we demonstrate that the appropriate decomposition method gives rise to an upper bound on the optimal total expected revenue and that this upper bound is tighter than the upper bound provided by a deterministic linear program known from the literature. Finally, computational experiments show that the pol- icy based on the suggested value function approximation performs significantly better than a set of standard benchmark methods. In addition to network revenue management applications, we also consider a capacity allocation problem with a fixed amount of daily processing capacity. Here, the decision maker tries to minimize the cost of scheduling a set of jobs arriving randomly over time to be processed within a given planning horizon. The scheduling (holding) cost of a given job depends on its priority level and the length of its scheduled waiting period. In this setting, the decomposition approach that we suggest decomposes the problem by booking days. In particular, we replace the original dynamic program with a sequence of single-dimensional dynamic programs, each of which is concerned with capacity limitations on one particular booking day only. We show that our approach provides tight lower bounds on the minimum total expected holding cost. Furthermore, it gives rise to a scheduling policy that on average performs better than a variety of benchmark methods known from the literature.

Revenue Management and Pricing Analytics

Revenue Management and Pricing Analytics PDF Author: Guillermo Gallego
Publisher: Springer
ISBN: 1493996061
Category : Business & Economics
Languages : en
Pages : 336

Get Book Here

Book Description
“There is no strategic investment that has a higher return than investing in good pricing, and the text by Gallego and Topaloghu provides the best technical treatment of pricing strategy and tactics available.” Preston McAfee, the J. Stanley Johnson Professor, California Institute of Technology and Chief Economist and Corp VP, Microsoft. “The book by Gallego and Topaloglu provides a fresh, up-to-date and in depth treatment of revenue management and pricing. It fills an important gap as it covers not only traditional revenue management topics also new and important topics such as revenue management under customer choice as well as pricing under competition and online learning. The book can be used for different audiences that range from advanced undergraduate students to masters and PhD students. It provides an in-depth treatment covering recent state of the art topics in an interesting and innovative way. I highly recommend it." Professor Georgia Perakis, the William F. Pounds Professor of Operations Research and Operations Management at the Sloan School of Management, Massachusetts Institute of Technology, Cambridge, Massachusetts. “This book is an important and timely addition to the pricing analytics literature by two authors who have made major contributions to the field. It covers traditional revenue management as well as assortment optimization and dynamic pricing. The comprehensive treatment of choice models in each application is particularly welcome. It is mathematically rigorous but accessible to students at the advanced undergraduate or graduate levels with a rich set of exercises at the end of each chapter. This book is highly recommended for Masters or PhD level courses on the topic and is a necessity for researchers with an interest in the field.” Robert L. Phillips, Director of Pricing Research at Amazon “At last, a serious and comprehensive treatment of modern revenue management and assortment optimization integrated with choice modeling. In this book, Gallego and Topaloglu provide the underlying model derivations together with a wide range of applications and examples; all of these facets will better equip students for handling real-world problems. For mathematically inclined researchers and practitioners, it will doubtless prove to be thought-provoking and an invaluable reference.” Richard Ratliff, Research Scientist at Sabre “This book, written by two of the leading researchers in the area, brings together in one place most of the recent research on revenue management and pricing analytics. New industries (ride sharing, cloud computing, restaurants) and new developments in the airline and hotel industries make this book very timely and relevant, and will serve as a critical reference for researchers.” Professor Kalyan Talluri, the Munjal Chair in Global Business and Operations, Imperial College, London, UK.

Applications in Statistical Computing

Applications in Statistical Computing PDF Author: Nadja Bauer
Publisher: Springer Nature
ISBN: 3030251470
Category : Computers
Languages : en
Pages : 336

Get Book Here

Book Description
This volume presents a selection of research papers on various topics at the interface of statistics and computer science. Emphasis is put on the practical applications of statistical methods in various disciplines, using machine learning and other computational methods. The book covers fields of research including the design of experiments, computational statistics, music data analysis, statistical process control, biometrics, industrial engineering, and econometrics. Gathering innovative, high-quality and scientifically relevant contributions, the volume was published in honor of Claus Weihs, Professor of Computational Statistics at TU Dortmund University, on the occasion of his 66th birthday.

The Theory and Practice of Revenue Management

The Theory and Practice of Revenue Management PDF Author: Kalyan T. Talluri
Publisher: Springer Science & Business Media
ISBN: 0387273913
Category : Business & Economics
Languages : en
Pages : 731

Get Book Here

Book Description
Revenue management (RM) has emerged as one of the most important new business practices in recent times. This book is the first comprehensive reference book to be published in the field of RM. It unifies the field, drawing from industry sources as well as relevant research from disparate disciplines, as well as documenting industry practices and implementation details. Successful hardcover version published in April 2004.

Approximate Dynamic Programming

Approximate Dynamic Programming PDF Author: Warren B. Powell
Publisher: John Wiley & Sons
ISBN: 0470182954
Category : Mathematics
Languages : en
Pages : 487

Get Book Here

Book Description
A complete and accessible introduction to the real-world applications of approximate dynamic programming With the growing levels of sophistication in modern-day operations, it is vital for practitioners to understand how to approach, model, and solve complex industrial problems. Approximate Dynamic Programming is a result of the author's decades of experience working in large industrial settings to develop practical and high-quality solutions to problems that involve making decisions in the presence of uncertainty. This groundbreaking book uniquely integrates four distinct disciplines—Markov design processes, mathematical programming, simulation, and statistics—to demonstrate how to successfully model and solve a wide range of real-life problems using the techniques of approximate dynamic programming (ADP). The reader is introduced to the three curses of dimensionality that impact complex problems and is also shown how the post-decision state variable allows for the use of classical algorithmic strategies from operations research to treat complex stochastic optimization problems. Designed as an introduction and assuming no prior training in dynamic programming of any form, Approximate Dynamic Programming contains dozens of algorithms that are intended to serve as a starting point in the design of practical solutions for real problems. The book provides detailed coverage of implementation challenges including: modeling complex sequential decision processes under uncertainty, identifying robust policies, designing and estimating value function approximations, choosing effective stepsize rules, and resolving convergence issues. With a focus on modeling and algorithms in conjunction with the language of mainstream operations research, artificial intelligence, and control theory, Approximate Dynamic Programming: Models complex, high-dimensional problems in a natural and practical way, which draws on years of industrial projects Introduces and emphasizes the power of estimating a value function around the post-decision state, allowing solution algorithms to be broken down into three fundamental steps: classical simulation, classical optimization, and classical statistics Presents a thorough discussion of recursive estimation, including fundamental theory and a number of issues that arise in the development of practical algorithms Offers a variety of methods for approximating dynamic programs that have appeared in previous literature, but that have never been presented in the coherent format of a book Motivated by examples from modern-day operations research, Approximate Dynamic Programming is an accessible introduction to dynamic modeling and is also a valuable guide for the development of high-quality solutions to problems that exist in operations research and engineering. The clear and precise presentation of the material makes this an appropriate text for advanced undergraduate and beginning graduate courses, while also serving as a reference for researchers and practitioners. A companion Web site is available for readers, which includes additional exercises, solutions to exercises, and data sets to reinforce the book's main concepts.

Fair Revenue Sharing Mechanisms for Strategic Passenger Airline Alliances

Fair Revenue Sharing Mechanisms for Strategic Passenger Airline Alliances PDF Author: Demet Çetiner
Publisher: Springer Science & Business Media
ISBN: 3642358225
Category : Business & Economics
Languages : en
Pages : 180

Get Book Here

Book Description
​A major problem arising in airline alliances is to design allocation mechanisms determining how the revenue of a product should be shared among the airlines. The nucleolus is a concept of cooperative game theory that provides solutions for allocating the cost or benefit of a cooperation. This work provides fair revenue proportions for the airline alliances based on the nucleolus, which assumes a centralized decision making system. The proposed mechanism is used as a benchmark to evaluate the fairness of the revenue sharing mechanisms, where the alliance partners behave selfishly. Additionally, a new selfish revenue allocation rule is developed that improves the performance of the existing methods.

Routing, Flow, and Capacity Design in Communication and Computer Networks

Routing, Flow, and Capacity Design in Communication and Computer Networks PDF Author: Michal Pioro
Publisher: Elsevier
ISBN: 0080516432
Category : Computers
Languages : en
Pages : 795

Get Book Here

Book Description
In network design, the gap between theory and practice is woefully broad. This book narrows it, comprehensively and critically examining current network design models and methods. You will learn where mathematical modeling and algorithmic optimization have been under-utilized. At the opposite extreme, you will learn where they tend to fail to contribute to the twin goals of network efficiency and cost-savings. Most of all, you will learn precisely how to tailor theoretical models to make them as useful as possible in practice.Throughout, the authors focus on the traffic demands encountered in the real world of network design. Their generic approach, however, allows problem formulations and solutions to be applied across the board to virtually any type of backbone communication or computer network. For beginners, this book is an excellent introduction. For seasoned professionals, it provides immediate solutions and a strong foundation for further advances in the use of mathematical modeling for network design. Written by leading researchers with a combined 40 years of industrial and academic network design experience. Considers the development of design models for different technologies, including TCP/IP, IDN, MPLS, ATM, SONET/SDH, and WDM. Discusses recent topics such as shortest path routing and fair bandwidth assignment in IP/MPLS networks. Addresses proper multi-layer modeling across network layers using different technologies—for example, IP over ATM over SONET, IP over WDM, and IDN over SONET. Covers restoration-oriented design methods that allow recovery from failures of large-capacity transport links and transit nodes. Presents, at the end of each chapter, exercises useful to both students and practitioners.

Hotel Revenue Management: From Theory to Practice

Hotel Revenue Management: From Theory to Practice PDF Author: Stanislav Ivanov
Publisher: Zangador
ISBN: 9549278638
Category : Travel
Languages : en
Pages : 205

Get Book Here

Book Description
This research monograph aims at developing an integrative framework of hotel revenue management. It elaborates the fundamental theoretical concepts in the field of hotel revenue management like the revenue management system, process, metrics, analysis, forecasting, segmentation and profiling, and ethical issues. Special attention is paid on the pricing and non-pricing revenue management tools used by hoteliers to maximise their revenues and gross operating profit. The monograph investigates the revenue management practices of accommodation establishments in Bulgaria and provides recommendations for their improvement. The book is suitable for undergraduate and graduate students in tourism, hospitality, hotel management, services studies programmes, and researchers interested in revenue/yield management. The book may also be used by hotel general managers, marketing managers, revenue managers and other practitioners looking for ways to improve their knowledge in the field.

Reinforcement Learning and Dynamic Programming Using Function Approximators

Reinforcement Learning and Dynamic Programming Using Function Approximators PDF Author: Lucian Busoniu
Publisher: CRC Press
ISBN: 1439821097
Category : Computers
Languages : en
Pages : 280

Get Book Here

Book Description
From household appliances to applications in robotics, engineered systems involving complex dynamics can only be as effective as the algorithms that control them. While Dynamic Programming (DP) has provided researchers with a way to optimally solve decision and control problems involving complex dynamic systems, its practical value was limited by algorithms that lacked the capacity to scale up to realistic problems. However, in recent years, dramatic developments in Reinforcement Learning (RL), the model-free counterpart of DP, changed our understanding of what is possible. Those developments led to the creation of reliable methods that can be applied even when a mathematical model of the system is unavailable, allowing researchers to solve challenging control problems in engineering, as well as in a variety of other disciplines, including economics, medicine, and artificial intelligence. Reinforcement Learning and Dynamic Programming Using Function Approximators provides a comprehensive and unparalleled exploration of the field of RL and DP. With a focus on continuous-variable problems, this seminal text details essential developments that have substantially altered the field over the past decade. In its pages, pioneering experts provide a concise introduction to classical RL and DP, followed by an extensive presentation of the state-of-the-art and novel methods in RL and DP with approximation. Combining algorithm development with theoretical guarantees, they elaborate on their work with illustrative examples and insightful comparisons. Three individual chapters are dedicated to representative algorithms from each of the major classes of techniques: value iteration, policy iteration, and policy search. The features and performance of these algorithms are highlighted in extensive experimental studies on a range of control applications. The recent development of applications involving complex systems has led to a surge of interest in RL and DP methods and the subsequent need for a quality resource on the subject. For graduate students and others new to the field, this book offers a thorough introduction to both the basics and emerging methods. And for those researchers and practitioners working in the fields of optimal and adaptive control, machine learning, artificial intelligence, and operations research, this resource offers a combination of practical algorithms, theoretical analysis, and comprehensive examples that they will be able to adapt and apply to their own work. Access the authors' website at www.dcsc.tudelft.nl/rlbook/ for additional material, including computer code used in the studies and information concerning new developments.

Applications of Stochastic Programming

Applications of Stochastic Programming PDF Author: Stein W. Wallace
Publisher: SIAM
ISBN: 9780898718799
Category : Mathematics
Languages : en
Pages : 724

Get Book Here

Book Description
Consisting of two parts, this book presents papers describing publicly available stochastic programming systems that are operational. It presents a diverse collection of application papers in areas such as production, supply chain and scheduling, gaming, environmental and pollution control, financial modeling, telecommunications, and electricity.