Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems PDF Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030483061
Category : Mathematics
Languages : en
Pages : 138

Get Book Here

Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems

Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems PDF Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030483061
Category : Mathematics
Languages : en
Pages : 138

Get Book Here

Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.

Stochastic Linear-Quadratic Optimal Control Theory: Open-Loop and Closed-Loop Solutions

Stochastic Linear-Quadratic Optimal Control Theory: Open-Loop and Closed-Loop Solutions PDF Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030209229
Category : Mathematics
Languages : en
Pages : 129

Get Book Here

Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents the results in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, it precisely identifies, for the first time, the interconnections between three well-known, relevant issues – the existence of optimal controls, solvability of the optimality system, and solvability of the associated Riccati equation. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.

Mean Field Games and Mean Field Type Control Theory

Mean Field Games and Mean Field Type Control Theory PDF Author: Alain Bensoussan
Publisher: Springer Science & Business Media
ISBN: 1461485088
Category : Science
Languages : en
Pages : 132

Get Book Here

Book Description
​Mean field games and Mean field type control introduce new problems in Control Theory. The terminology “games” may be confusing. In fact they are control problems, in the sense that one is interested in a single decision maker, whom we can call the representative agent. However, these problems are not standard, since both the evolution of the state and the objective functional is influenced but terms which are not directly related to the state or the control of the decision maker. They are however, indirectly related to him, in the sense that they model a very large community of agents similar to the representative agent. All the agents behave similarly and impact the representative agent. However, because of the large number an aggregation effect takes place. The interesting consequence is that the impact of the community can be modeled by a mean field term, but when this is done, the problem is reduced to a control problem. ​

Modeling, Stochastic Control, Optimization, and Applications

Modeling, Stochastic Control, Optimization, and Applications PDF Author: George Yin
Publisher: Springer
ISBN: 3030254984
Category : Mathematics
Languages : en
Pages : 599

Get Book Here

Book Description
This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.

Matrix Riccati Equations in Control and Systems Theory

Matrix Riccati Equations in Control and Systems Theory PDF Author: Hisham Abou-Kandil
Publisher: Birkhäuser
ISBN: 3034880812
Category : Science
Languages : en
Pages : 584

Get Book Here

Book Description
The authors present the theory of symmetric (Hermitian) matrix Riccati equations and contribute to the development of the theory of non-symmetric Riccati equations as well as to certain classes of coupled and generalized Riccati equations occurring in differential games and stochastic control. The volume offers a complete treatment of generalized and coupled Riccati equations. It deals with differential, discrete-time, algebraic or periodic symmetric and non-symmetric equations, with special emphasis on those equations appearing in control and systems theory. Extensions to Riccati theory allow to tackle robust control problems in a unified approach. The book makes available classical and recent results to engineers and mathematicians alike. It is accessible to graduate students in mathematics, applied mathematics, control engineering, physics or economics. Researchers working in any of the fields where Riccati equations are used can find the main results with the proper mathematical background.

Lectures on BSDEs, Stochastic Control, and Stochastic Differential Games with Financial Applications

Lectures on BSDEs, Stochastic Control, and Stochastic Differential Games with Financial Applications PDF Author: Rene Carmona
Publisher: SIAM
ISBN: 1611974240
Category : Mathematics
Languages : en
Pages : 263

Get Book Here

Book Description
The goal of this textbook is to introduce students to the stochastic analysis tools that play an increasing role in the probabilistic approach to optimization problems, including stochastic control and stochastic differential games. While optimal control is taught in many graduate programs in applied mathematics and operations research, the author was intrigued by the lack of coverage of the theory of stochastic differential games. This is the first title in SIAM?s Financial Mathematics book series and is based on the author?s lecture notes. It will be helpful to students who are interested in stochastic differential equations (forward, backward, forward-backward); the probabilistic approach to stochastic control (dynamic programming and the stochastic maximum principle); and mean field games and control of McKean?Vlasov dynamics. The theory is illustrated by applications to models of systemic risk, macroeconomic growth, flocking/schooling, crowd behavior, and predatory trading, among others.

Mean-Field-Type Games for Engineers

Mean-Field-Type Games for Engineers PDF Author: Julian Barreiro-Gomez
Publisher: CRC Press
ISBN: 9780367566135
Category : Computers
Languages : en
Pages : 0

Get Book Here

Book Description
This book comprises an appropriate background to work and do research on mean-field-type control and game theory. It starts with studying the deterministic optimal control and differential linear-quadratic games, and progressively moves to analyzing mean-field-type control and game problems incorporating several stochastic processes.

Probabilistic Theory of Mean Field Games with Applications I

Probabilistic Theory of Mean Field Games with Applications I PDF Author: René Carmona
Publisher: Springer
ISBN: 3319589202
Category : Mathematics
Languages : en
Pages : 728

Get Book Here

Book Description
This two-volume book offers a comprehensive treatment of the probabilistic approach to mean field game models and their applications. The book is self-contained in nature and includes original material and applications with explicit examples throughout, including numerical solutions. Volume I of the book is entirely devoted to the theory of mean field games without a common noise. The first half of the volume provides a self-contained introduction to mean field games, starting from concrete illustrations of games with a finite number of players, and ending with ready-for-use solvability results. Readers are provided with the tools necessary for the solution of forward-backward stochastic differential equations of the McKean-Vlasov type at the core of the probabilistic approach. The second half of this volume focuses on the main principles of analysis on the Wasserstein space. It includes Lions' approach to the Wasserstein differential calculus, and the applications of its results to the analysis of stochastic mean field control problems. Together, both Volume I and Volume II will greatly benefit mathematical graduate students and researchers interested in mean field games. The authors provide a detailed road map through the book allowing different access points for different readers and building up the level of technical detail. The accessible approach and overview will allow interested researchers in the applied sciences to obtain a clear overview of the state of the art in mean field games.

The Master Equation and the Convergence Problem in Mean Field Games

The Master Equation and the Convergence Problem in Mean Field Games PDF Author: Pierre Cardaliaguet
Publisher: Princeton University Press
ISBN: 0691190712
Category : Mathematics
Languages : en
Pages : 224

Get Book Here

Book Description
This book describes the latest advances in the theory of mean field games, which are optimal control problems with a continuum of players, each of them interacting with the whole statistical distribution of a population. While it originated in economics, this theory now has applications in areas as diverse as mathematical finance, crowd phenomena, epidemiology, and cybersecurity. Because mean field games concern the interactions of infinitely many players in an optimal control framework, one expects them to appear as the limit for Nash equilibria of differential games with finitely many players as the number of players tends to infinity. This book rigorously establishes this convergence, which has been an open problem until now. The limit of the system associated with differential games with finitely many players is described by the so-called master equation, a nonlocal transport equation in the space of measures. After defining a suitable notion of differentiability in the space of measures, the authors provide a complete self-contained analysis of the master equation. Their analysis includes the case of common noise problems in which all the players are affected by a common Brownian motion. They then go on to explain how to use the master equation to prove the mean field limit. This groundbreaking book presents two important new results in mean field games that contribute to a unified theoretical framework for this exciting and fast-developing area of mathematics.

Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems

Singular Linear-Quadratic Zero-Sum Differential Games and H∞ Control Problems PDF Author: Valery Y. Glizer
Publisher: Springer Nature
ISBN: 3031070518
Category : Mathematics
Languages : en
Pages : 211

Get Book Here

Book Description
This monograph is devoted to the analysis and solution of singular differential games and singular $H_{\inf}$ control problems in both finite- and infinite-horizon settings. Expanding on the authors’ previous work in this area, this novel text is the first to study the aforementioned singular problems using the regularization approach. After a brief introduction, solvability conditions are presented for the regular differential games and $H_{\inf}$ control problems. In the following chapter, the authors solve the singular finite-horizon linear-quadratic differential game using the regularization method. Next, they apply this method to the solution of an infinite-horizon type. The last two chapters are dedicated to the solution of singular finite-horizon and infinite-horizon linear-quadratic $H_{\inf}$ control problems. The authors use theoretical and real-world examples to illustrate the results and their applicability throughout the text, and have carefully organized the content to be as self-contained as possible, making it possible to study each chapter independently or in succession. Each chapter includes its own introduction, list of notations, a brief literature review on the topic, and a corresponding bibliography. For easier readability, detailed proofs are presented in separate subsections. Singular Linear-Quadratic Zero-Sum Differential Games and $H_{\inf}$ Control Problems will be of interest to researchers and engineers working in the areas of applied mathematics, dynamic games, control engineering, mechanical and aerospace engineering, electrical engineering, and biology. This book can also serve as a useful reference for graduate students in these area