Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030483061
Category : Mathematics
Languages : en
Pages : 138
Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
Stochastic Linear-Quadratic Optimal Control Theory: Differential Games and Mean-Field Problems
Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030483061
Category : Mathematics
Languages : en
Pages : 138
Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
Publisher: Springer Nature
ISBN: 3030483061
Category : Mathematics
Languages : en
Pages : 138
Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents results for two-player differential games and mean-field optimal control problems in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, the book identifies, for the first time, the interconnections between the existence of open-loop and closed-loop Nash equilibria, solvability of the optimality system, and solvability of the associated Riccati equation, and also explores the open-loop solvability of mean-filed linear-quadratic optimal control problems. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
Modeling, Stochastic Control, Optimization, and Applications
Author: George Yin
Publisher: Springer
ISBN: 3030254984
Category : Mathematics
Languages : en
Pages : 593
Book Description
This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.
Publisher: Springer
ISBN: 3030254984
Category : Mathematics
Languages : en
Pages : 593
Book Description
This volume collects papers, based on invited talks given at the IMA workshop in Modeling, Stochastic Control, Optimization, and Related Applications, held at the Institute for Mathematics and Its Applications, University of Minnesota, during May and June, 2018. There were four week-long workshops during the conference. They are (1) stochastic control, computation methods, and applications, (2) queueing theory and networked systems, (3) ecological and biological applications, and (4) finance and economics applications. For broader impacts, researchers from different fields covering both theoretically oriented and application intensive areas were invited to participate in the conference. It brought together researchers from multi-disciplinary communities in applied mathematics, applied probability, engineering, biology, ecology, and networked science, to review, and substantially update most recent progress. As an archive, this volume presents some of the highlights of the workshops, and collect papers covering a broad range of topics.
The Master Equation and the Convergence Problem in Mean Field Games
Author: Pierre Cardaliaguet
Publisher: Princeton University Press
ISBN: 0691190712
Category : Mathematics
Languages : en
Pages : 224
Book Description
This book describes the latest advances in the theory of mean field games, which are optimal control problems with a continuum of players, each of them interacting with the whole statistical distribution of a population. While it originated in economics, this theory now has applications in areas as diverse as mathematical finance, crowd phenomena, epidemiology, and cybersecurity. Because mean field games concern the interactions of infinitely many players in an optimal control framework, one expects them to appear as the limit for Nash equilibria of differential games with finitely many players as the number of players tends to infinity. This book rigorously establishes this convergence, which has been an open problem until now. The limit of the system associated with differential games with finitely many players is described by the so-called master equation, a nonlocal transport equation in the space of measures. After defining a suitable notion of differentiability in the space of measures, the authors provide a complete self-contained analysis of the master equation. Their analysis includes the case of common noise problems in which all the players are affected by a common Brownian motion. They then go on to explain how to use the master equation to prove the mean field limit. This groundbreaking book presents two important new results in mean field games that contribute to a unified theoretical framework for this exciting and fast-developing area of mathematics.
Publisher: Princeton University Press
ISBN: 0691190712
Category : Mathematics
Languages : en
Pages : 224
Book Description
This book describes the latest advances in the theory of mean field games, which are optimal control problems with a continuum of players, each of them interacting with the whole statistical distribution of a population. While it originated in economics, this theory now has applications in areas as diverse as mathematical finance, crowd phenomena, epidemiology, and cybersecurity. Because mean field games concern the interactions of infinitely many players in an optimal control framework, one expects them to appear as the limit for Nash equilibria of differential games with finitely many players as the number of players tends to infinity. This book rigorously establishes this convergence, which has been an open problem until now. The limit of the system associated with differential games with finitely many players is described by the so-called master equation, a nonlocal transport equation in the space of measures. After defining a suitable notion of differentiability in the space of measures, the authors provide a complete self-contained analysis of the master equation. Their analysis includes the case of common noise problems in which all the players are affected by a common Brownian motion. They then go on to explain how to use the master equation to prove the mean field limit. This groundbreaking book presents two important new results in mean field games that contribute to a unified theoretical framework for this exciting and fast-developing area of mathematics.
Matrix Riccati Equations in Control and Systems Theory
Author: Hisham Abou-Kandil
Publisher: Birkhäuser
ISBN: 3034880812
Category : Science
Languages : en
Pages : 584
Book Description
The authors present the theory of symmetric (Hermitian) matrix Riccati equations and contribute to the development of the theory of non-symmetric Riccati equations as well as to certain classes of coupled and generalized Riccati equations occurring in differential games and stochastic control. The volume offers a complete treatment of generalized and coupled Riccati equations. It deals with differential, discrete-time, algebraic or periodic symmetric and non-symmetric equations, with special emphasis on those equations appearing in control and systems theory. Extensions to Riccati theory allow to tackle robust control problems in a unified approach. The book makes available classical and recent results to engineers and mathematicians alike. It is accessible to graduate students in mathematics, applied mathematics, control engineering, physics or economics. Researchers working in any of the fields where Riccati equations are used can find the main results with the proper mathematical background.
Publisher: Birkhäuser
ISBN: 3034880812
Category : Science
Languages : en
Pages : 584
Book Description
The authors present the theory of symmetric (Hermitian) matrix Riccati equations and contribute to the development of the theory of non-symmetric Riccati equations as well as to certain classes of coupled and generalized Riccati equations occurring in differential games and stochastic control. The volume offers a complete treatment of generalized and coupled Riccati equations. It deals with differential, discrete-time, algebraic or periodic symmetric and non-symmetric equations, with special emphasis on those equations appearing in control and systems theory. Extensions to Riccati theory allow to tackle robust control problems in a unified approach. The book makes available classical and recent results to engineers and mathematicians alike. It is accessible to graduate students in mathematics, applied mathematics, control engineering, physics or economics. Researchers working in any of the fields where Riccati equations are used can find the main results with the proper mathematical background.
Stochastic Linear-Quadratic Optimal Control Theory: Open-Loop and Closed-Loop Solutions
Author: Jingrui Sun
Publisher: Springer Nature
ISBN: 3030209229
Category : Mathematics
Languages : en
Pages : 129
Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents the results in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, it precisely identifies, for the first time, the interconnections between three well-known, relevant issues – the existence of optimal controls, solvability of the optimality system, and solvability of the associated Riccati equation. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
Publisher: Springer Nature
ISBN: 3030209229
Category : Mathematics
Languages : en
Pages : 129
Book Description
This book gathers the most essential results, including recent ones, on linear-quadratic optimal control problems, which represent an important aspect of stochastic control. It presents the results in the context of finite and infinite horizon problems, and discusses a number of new and interesting issues. Further, it precisely identifies, for the first time, the interconnections between three well-known, relevant issues – the existence of optimal controls, solvability of the optimality system, and solvability of the associated Riccati equation. Although the content is largely self-contained, readers should have a basic grasp of linear algebra, functional analysis and stochastic ordinary differential equations. The book is mainly intended for senior undergraduate and graduate students majoring in applied mathematics who are interested in stochastic control theory. However, it will also appeal to researchers in other related areas, such as engineering, management, finance/economics and the social sciences.
LQ Dynamic Optimization and Differential Games
Author: Jacob Engwerda
Publisher: John Wiley & Sons
ISBN: 9780470015247
Category : Business & Economics
Languages : en
Pages : 514
Book Description
Game theory is the theory of social situations, and the majority of research into the topic focuses on how groups of people interact by developing formulas and algorithms to identify optimal strategies and to predict the outcome of interactions. Only fifty years old, it has already revolutionized economics and finance, and is spreading rapidly to a wide variety of fields. LQ Dynamic Optimization and Differential Games is an assessment of the state of the art in its field and the first modern book on linear-quadratic game theory, one of the most commonly used tools for modelling and analysing strategic decision making problems in economics and management. Linear quadratic dynamic models have a long tradition in economics, operations research and control engineering; and the author begins by describing the one-decision maker LQ dynamic optimization problem before introducing LQ differential games. Covers cooperative and non-cooperative scenarios, and treats the standard information structures (open-loop and feedback). Includes real-life economic examples to illustrate theoretical concepts and results. Presents problem formulations and sound mathematical problem analysis. Includes exercises and solutions, enabling use for self-study or as a course text. Supported by a website featuring solutions to exercises, further examples and computer code for numerical examples. LQ Dynamic Optimization and Differential Games offers a comprehensive introduction to the theory and practice of this extensively used class of economic models, and will appeal to applied mathematicians and econometricians as well as researchers and senior undergraduate/graduate students in economics, mathematics, engineering and management science.
Publisher: John Wiley & Sons
ISBN: 9780470015247
Category : Business & Economics
Languages : en
Pages : 514
Book Description
Game theory is the theory of social situations, and the majority of research into the topic focuses on how groups of people interact by developing formulas and algorithms to identify optimal strategies and to predict the outcome of interactions. Only fifty years old, it has already revolutionized economics and finance, and is spreading rapidly to a wide variety of fields. LQ Dynamic Optimization and Differential Games is an assessment of the state of the art in its field and the first modern book on linear-quadratic game theory, one of the most commonly used tools for modelling and analysing strategic decision making problems in economics and management. Linear quadratic dynamic models have a long tradition in economics, operations research and control engineering; and the author begins by describing the one-decision maker LQ dynamic optimization problem before introducing LQ differential games. Covers cooperative and non-cooperative scenarios, and treats the standard information structures (open-loop and feedback). Includes real-life economic examples to illustrate theoretical concepts and results. Presents problem formulations and sound mathematical problem analysis. Includes exercises and solutions, enabling use for self-study or as a course text. Supported by a website featuring solutions to exercises, further examples and computer code for numerical examples. LQ Dynamic Optimization and Differential Games offers a comprehensive introduction to the theory and practice of this extensively used class of economic models, and will appeal to applied mathematicians and econometricians as well as researchers and senior undergraduate/graduate students in economics, mathematics, engineering and management science.
Essays on Pareto Optimality in Cooperative Games
Author: Yaning Lin
Publisher: Springer Nature
ISBN: 9811950490
Category : Technology & Engineering
Languages : en
Pages : 169
Book Description
The book focuses on Pareto optimality in cooperative games. Most of the existing works focus on the Pareto optimality of deterministic continuous-time systems or for the regular convex LQ case. To expand on the available literature, we explore the existence conditions of Pareto solutions in stochastic differential game for more general cases. In addition, the LQ Pareto game for stochastic singular systems, Pareto-based guaranteed cost control for uncertain mean-field stochastic systems, and the existence conditions of Pareto solutions in cooperative difference game are also studied in detail. Addressing Pareto optimality for more general cases and wider systems is one of the major features of the book, making it particularly suitable for readers who are interested in multi-objective optimal control. Accordingly, it offers a valuable asset for researchers, engineers, and graduate students in the fields of control theory and control engineering, economics, management science, mathematics, etc.
Publisher: Springer Nature
ISBN: 9811950490
Category : Technology & Engineering
Languages : en
Pages : 169
Book Description
The book focuses on Pareto optimality in cooperative games. Most of the existing works focus on the Pareto optimality of deterministic continuous-time systems or for the regular convex LQ case. To expand on the available literature, we explore the existence conditions of Pareto solutions in stochastic differential game for more general cases. In addition, the LQ Pareto game for stochastic singular systems, Pareto-based guaranteed cost control for uncertain mean-field stochastic systems, and the existence conditions of Pareto solutions in cooperative difference game are also studied in detail. Addressing Pareto optimality for more general cases and wider systems is one of the major features of the book, making it particularly suitable for readers who are interested in multi-objective optimal control. Accordingly, it offers a valuable asset for researchers, engineers, and graduate students in the fields of control theory and control engineering, economics, management science, mathematics, etc.
Mean Field Games and Mean Field Type Control Theory
Author: Alain Bensoussan
Publisher: Springer Science & Business Media
ISBN: 1461485088
Category : Science
Languages : en
Pages : 132
Book Description
Mean field games and Mean field type control introduce new problems in Control Theory. The terminology “games” may be confusing. In fact they are control problems, in the sense that one is interested in a single decision maker, whom we can call the representative agent. However, these problems are not standard, since both the evolution of the state and the objective functional is influenced but terms which are not directly related to the state or the control of the decision maker. They are however, indirectly related to him, in the sense that they model a very large community of agents similar to the representative agent. All the agents behave similarly and impact the representative agent. However, because of the large number an aggregation effect takes place. The interesting consequence is that the impact of the community can be modeled by a mean field term, but when this is done, the problem is reduced to a control problem.
Publisher: Springer Science & Business Media
ISBN: 1461485088
Category : Science
Languages : en
Pages : 132
Book Description
Mean field games and Mean field type control introduce new problems in Control Theory. The terminology “games” may be confusing. In fact they are control problems, in the sense that one is interested in a single decision maker, whom we can call the representative agent. However, these problems are not standard, since both the evolution of the state and the objective functional is influenced but terms which are not directly related to the state or the control of the decision maker. They are however, indirectly related to him, in the sense that they model a very large community of agents similar to the representative agent. All the agents behave similarly and impact the representative agent. However, because of the large number an aggregation effect takes place. The interesting consequence is that the impact of the community can be modeled by a mean field term, but when this is done, the problem is reduced to a control problem.
Mean Field Games
Author: Yves Achdou
Publisher: Springer Nature
ISBN: 3030598373
Category : Mathematics
Languages : en
Pages : 316
Book Description
This volume provides an introduction to the theory of Mean Field Games, suggested by J.-M. Lasry and P.-L. Lions in 2006 as a mean-field model for Nash equilibria in the strategic interaction of a large number of agents. Besides giving an accessible presentation of the main features of mean-field game theory, the volume offers an overview of recent developments which explore several important directions: from partial differential equations to stochastic analysis, from the calculus of variations to modeling and aspects related to numerical methods. Arising from the CIME Summer School "Mean Field Games" held in Cetraro in 2019, this book collects together lecture notes prepared by Y. Achdou (with M. Laurière), P. Cardaliaguet, F. Delarue, A. Porretta and F. Santambrogio. These notes will be valuable for researchers and advanced graduate students who wish to approach this theory and explore its connections with several different fields in mathematics.
Publisher: Springer Nature
ISBN: 3030598373
Category : Mathematics
Languages : en
Pages : 316
Book Description
This volume provides an introduction to the theory of Mean Field Games, suggested by J.-M. Lasry and P.-L. Lions in 2006 as a mean-field model for Nash equilibria in the strategic interaction of a large number of agents. Besides giving an accessible presentation of the main features of mean-field game theory, the volume offers an overview of recent developments which explore several important directions: from partial differential equations to stochastic analysis, from the calculus of variations to modeling and aspects related to numerical methods. Arising from the CIME Summer School "Mean Field Games" held in Cetraro in 2019, this book collects together lecture notes prepared by Y. Achdou (with M. Laurière), P. Cardaliaguet, F. Delarue, A. Porretta and F. Santambrogio. These notes will be valuable for researchers and advanced graduate students who wish to approach this theory and explore its connections with several different fields in mathematics.
Mean-Field-Type Games for Engineers
Author: Julian Barreiro-Gomez
Publisher: CRC Press
ISBN: 1000473538
Category : Technology & Engineering
Languages : en
Pages : 526
Book Description
The contents of this book comprise an appropriate background to start working and doing research on mean-field-type control and game theory. To make the exposition and explanation even easier, we first study the deterministic optimal control and differential linear-quadratic games. Then, we progressively add complexity step-by-step and little-by-little to the problem settings until we finally study and analyze mean-field-type control and game problems incorporating several stochastic processes, e.g., Brownian motions, Poisson jumps, and random coefficients. We go beyond the Nash equilibrium, which provides a solution for non- cooperative games, by analyzing other game-theoretical concepts such as the Berge, Stackelberg, adversarial/robust, and co-opetitive equilibria. For the mean-field-type game analysis, we provide several numerical examples using a Matlab-based user-friendly toolbox that is available for the free use to the readers of this book. We present several engineering applications in both continuous and discrete time. Among these applications we find the following: water distribution systems, micro-grid energy storage, stirred tank reactor, mechanism design for evolutionary dynamics, multi-level building evacuation problem, and the COVID-19 propagation control. "With such a demand from engineering audiences, this book is very timely and provides a thorough study of mean-field-type game theory. The strenuous protagonist of this book is to bridge between the theoretical findings and engineering solutions. The book introduces the basics first, and then mathematical frameworks are elaborately explained. The engineering application examples are shown in detail, and the popular learning approaches are also investigated. Those advantageous characteristics will make this book a comprehensive handbook of many engineering fields for many years, and I will buy one when it gets published." - Zhu Han
Publisher: CRC Press
ISBN: 1000473538
Category : Technology & Engineering
Languages : en
Pages : 526
Book Description
The contents of this book comprise an appropriate background to start working and doing research on mean-field-type control and game theory. To make the exposition and explanation even easier, we first study the deterministic optimal control and differential linear-quadratic games. Then, we progressively add complexity step-by-step and little-by-little to the problem settings until we finally study and analyze mean-field-type control and game problems incorporating several stochastic processes, e.g., Brownian motions, Poisson jumps, and random coefficients. We go beyond the Nash equilibrium, which provides a solution for non- cooperative games, by analyzing other game-theoretical concepts such as the Berge, Stackelberg, adversarial/robust, and co-opetitive equilibria. For the mean-field-type game analysis, we provide several numerical examples using a Matlab-based user-friendly toolbox that is available for the free use to the readers of this book. We present several engineering applications in both continuous and discrete time. Among these applications we find the following: water distribution systems, micro-grid energy storage, stirred tank reactor, mechanism design for evolutionary dynamics, multi-level building evacuation problem, and the COVID-19 propagation control. "With such a demand from engineering audiences, this book is very timely and provides a thorough study of mean-field-type game theory. The strenuous protagonist of this book is to bridge between the theoretical findings and engineering solutions. The book introduces the basics first, and then mathematical frameworks are elaborately explained. The engineering application examples are shown in detail, and the popular learning approaches are also investigated. Those advantageous characteristics will make this book a comprehensive handbook of many engineering fields for many years, and I will buy one when it gets published." - Zhu Han