Author: Sean Meyn
Publisher: Cambridge University Press
ISBN: 1316511960
Category : Business & Economics
Languages : en
Pages : 453
Book Description
A how-to guide and scientific tutorial covering the universe of reinforcement learning and control theory for online decision making.
Control Systems and Reinforcement Learning
Author: Sean Meyn
Publisher: Cambridge University Press
ISBN: 1316511960
Category : Business & Economics
Languages : en
Pages : 453
Book Description
A how-to guide and scientific tutorial covering the universe of reinforcement learning and control theory for online decision making.
Publisher: Cambridge University Press
ISBN: 1316511960
Category : Business & Economics
Languages : en
Pages : 453
Book Description
A how-to guide and scientific tutorial covering the universe of reinforcement learning and control theory for online decision making.
Data-Driven Science and Engineering
Author: Steven L. Brunton
Publisher: Cambridge University Press
ISBN: 1009098489
Category : Computers
Languages : en
Pages : 615
Book Description
A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.
Publisher: Cambridge University Press
ISBN: 1009098489
Category : Computers
Languages : en
Pages : 615
Book Description
A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.
Handbook of Reinforcement Learning and Control
Author: Kyriakos G. Vamvoudakis
Publisher: Springer Nature
ISBN: 3030609901
Category : Technology & Engineering
Languages : en
Pages : 833
Book Description
This handbook presents state-of-the-art research in reinforcement learning, focusing on its applications in the control and game theory of dynamic systems and future directions for related research and technology. The contributions gathered in this book deal with challenges faced when using learning and adaptation methods to solve academic and industrial problems, such as optimization in dynamic environments with single and multiple agents, convergence and performance analysis, and online implementation. They explore means by which these difficulties can be solved, and cover a wide range of related topics including: deep learning; artificial intelligence; applications of game theory; mixed modality learning; and multi-agent reinforcement learning. Practicing engineers and scholars in the field of machine learning, game theory, and autonomous control will find the Handbook of Reinforcement Learning and Control to be thought-provoking, instructive and informative.
Publisher: Springer Nature
ISBN: 3030609901
Category : Technology & Engineering
Languages : en
Pages : 833
Book Description
This handbook presents state-of-the-art research in reinforcement learning, focusing on its applications in the control and game theory of dynamic systems and future directions for related research and technology. The contributions gathered in this book deal with challenges faced when using learning and adaptation methods to solve academic and industrial problems, such as optimization in dynamic environments with single and multiple agents, convergence and performance analysis, and online implementation. They explore means by which these difficulties can be solved, and cover a wide range of related topics including: deep learning; artificial intelligence; applications of game theory; mixed modality learning; and multi-agent reinforcement learning. Practicing engineers and scholars in the field of machine learning, game theory, and autonomous control will find the Handbook of Reinforcement Learning and Control to be thought-provoking, instructive and informative.
Reinforcement Learning and Optimal Control
Author: Dimitri P. Bertsekas
Publisher:
ISBN: 9787302540328
Category : Artificial intelligence
Languages : zh-CN
Pages : 373
Book Description
Publisher:
ISBN: 9787302540328
Category : Artificial intelligence
Languages : zh-CN
Pages : 373
Book Description
Reinforcement Learning and Dynamic Programming Using Function Approximators
Author: Lucian Busoniu
Publisher: CRC Press
ISBN: 1439821097
Category : Computers
Languages : en
Pages : 280
Book Description
From household appliances to applications in robotics, engineered systems involving complex dynamics can only be as effective as the algorithms that control them. While Dynamic Programming (DP) has provided researchers with a way to optimally solve decision and control problems involving complex dynamic systems, its practical value was limited by algorithms that lacked the capacity to scale up to realistic problems. However, in recent years, dramatic developments in Reinforcement Learning (RL), the model-free counterpart of DP, changed our understanding of what is possible. Those developments led to the creation of reliable methods that can be applied even when a mathematical model of the system is unavailable, allowing researchers to solve challenging control problems in engineering, as well as in a variety of other disciplines, including economics, medicine, and artificial intelligence. Reinforcement Learning and Dynamic Programming Using Function Approximators provides a comprehensive and unparalleled exploration of the field of RL and DP. With a focus on continuous-variable problems, this seminal text details essential developments that have substantially altered the field over the past decade. In its pages, pioneering experts provide a concise introduction to classical RL and DP, followed by an extensive presentation of the state-of-the-art and novel methods in RL and DP with approximation. Combining algorithm development with theoretical guarantees, they elaborate on their work with illustrative examples and insightful comparisons. Three individual chapters are dedicated to representative algorithms from each of the major classes of techniques: value iteration, policy iteration, and policy search. The features and performance of these algorithms are highlighted in extensive experimental studies on a range of control applications. The recent development of applications involving complex systems has led to a surge of interest in RL and DP methods and the subsequent need for a quality resource on the subject. For graduate students and others new to the field, this book offers a thorough introduction to both the basics and emerging methods. And for those researchers and practitioners working in the fields of optimal and adaptive control, machine learning, artificial intelligence, and operations research, this resource offers a combination of practical algorithms, theoretical analysis, and comprehensive examples that they will be able to adapt and apply to their own work. Access the authors' website at www.dcsc.tudelft.nl/rlbook/ for additional material, including computer code used in the studies and information concerning new developments.
Publisher: CRC Press
ISBN: 1439821097
Category : Computers
Languages : en
Pages : 280
Book Description
From household appliances to applications in robotics, engineered systems involving complex dynamics can only be as effective as the algorithms that control them. While Dynamic Programming (DP) has provided researchers with a way to optimally solve decision and control problems involving complex dynamic systems, its practical value was limited by algorithms that lacked the capacity to scale up to realistic problems. However, in recent years, dramatic developments in Reinforcement Learning (RL), the model-free counterpart of DP, changed our understanding of what is possible. Those developments led to the creation of reliable methods that can be applied even when a mathematical model of the system is unavailable, allowing researchers to solve challenging control problems in engineering, as well as in a variety of other disciplines, including economics, medicine, and artificial intelligence. Reinforcement Learning and Dynamic Programming Using Function Approximators provides a comprehensive and unparalleled exploration of the field of RL and DP. With a focus on continuous-variable problems, this seminal text details essential developments that have substantially altered the field over the past decade. In its pages, pioneering experts provide a concise introduction to classical RL and DP, followed by an extensive presentation of the state-of-the-art and novel methods in RL and DP with approximation. Combining algorithm development with theoretical guarantees, they elaborate on their work with illustrative examples and insightful comparisons. Three individual chapters are dedicated to representative algorithms from each of the major classes of techniques: value iteration, policy iteration, and policy search. The features and performance of these algorithms are highlighted in extensive experimental studies on a range of control applications. The recent development of applications involving complex systems has led to a surge of interest in RL and DP methods and the subsequent need for a quality resource on the subject. For graduate students and others new to the field, this book offers a thorough introduction to both the basics and emerging methods. And for those researchers and practitioners working in the fields of optimal and adaptive control, machine learning, artificial intelligence, and operations research, this resource offers a combination of practical algorithms, theoretical analysis, and comprehensive examples that they will be able to adapt and apply to their own work. Access the authors' website at www.dcsc.tudelft.nl/rlbook/ for additional material, including computer code used in the studies and information concerning new developments.
Neural Systems for Control
Author: Omid Omidvar
Publisher: Elsevier
ISBN: 0080537391
Category : Computers
Languages : en
Pages : 375
Book Description
Control problems offer an industrially important application and a guide to understanding control systems for those working in Neural Networks. Neural Systems for Control represents the most up-to-date developments in the rapidly growing aplication area of neural networks and focuses on research in natural and artifical neural systems directly applicable to control or making use of modern control theory. The book covers such important new developments in control systems such as intelligent sensors in semiconductor wafer manufacturing; the relation between muscles and cerebral neurons in speech recognition; online compensation of reconfigurable control for spacecraft aircraft and other systems; applications to rolling mills, robotics and process control; the usage of past output data to identify nonlinear systems by neural networks; neural approximate optimal control; model-free nonlinear control; and neural control based on a regulation of physiological investigation/blood pressure control. All researchers and students dealing with control systems will find the fascinating Neural Systems for Control of immense interest and assistance. - Focuses on research in natural and artifical neural systems directly applicable to contol or making use of modern control theory - Represents the most up-to-date developments in this rapidly growing application area of neural networks - Takes a new and novel approach to system identification and synthesis
Publisher: Elsevier
ISBN: 0080537391
Category : Computers
Languages : en
Pages : 375
Book Description
Control problems offer an industrially important application and a guide to understanding control systems for those working in Neural Networks. Neural Systems for Control represents the most up-to-date developments in the rapidly growing aplication area of neural networks and focuses on research in natural and artifical neural systems directly applicable to control or making use of modern control theory. The book covers such important new developments in control systems such as intelligent sensors in semiconductor wafer manufacturing; the relation between muscles and cerebral neurons in speech recognition; online compensation of reconfigurable control for spacecraft aircraft and other systems; applications to rolling mills, robotics and process control; the usage of past output data to identify nonlinear systems by neural networks; neural approximate optimal control; model-free nonlinear control; and neural control based on a regulation of physiological investigation/blood pressure control. All researchers and students dealing with control systems will find the fascinating Neural Systems for Control of immense interest and assistance. - Focuses on research in natural and artifical neural systems directly applicable to contol or making use of modern control theory - Represents the most up-to-date developments in this rapidly growing application area of neural networks - Takes a new and novel approach to system identification and synthesis
Rollout, Policy Iteration, and Distributed Reinforcement Learning
Author: Dimitri Bertsekas
Publisher: Athena Scientific
ISBN: 1886529078
Category : Computers
Languages : en
Pages : 498
Book Description
The purpose of this book is to develop in greater depth some of the methods from the author's Reinforcement Learning and Optimal Control recently published textbook (Athena Scientific, 2019). In particular, we present new research, relating to systems involving multiple agents, partitioned architectures, and distributed asynchronous computation. We pay special attention to the contexts of dynamic programming/policy iteration and control theory/model predictive control. We also discuss in some detail the application of the methodology to challenging discrete/combinatorial optimization problems, such as routing, scheduling, assignment, and mixed integer programming, including the use of neural network approximations within these contexts. The book focuses on the fundamental idea of policy iteration, i.e., start from some policy, and successively generate one or more improved policies. If just one improved policy is generated, this is called rollout, which, based on broad and consistent computational experience, appears to be one of the most versatile and reliable of all reinforcement learning methods. In this book, rollout algorithms are developed for both discrete deterministic and stochastic DP problems, and the development of distributed implementations in both multiagent and multiprocessor settings, aiming to take advantage of parallelism. Approximate policy iteration is more ambitious than rollout, but it is a strictly off-line method, and it is generally far more computationally intensive. This motivates the use of parallel and distributed computation. One of the purposes of the monograph is to discuss distributed (possibly asynchronous) methods that relate to rollout and policy iteration, both in the context of an exact and an approximate implementation involving neural networks or other approximation architectures. Much of the new research is inspired by the remarkable AlphaZero chess program, where policy iteration, value and policy networks, approximate lookahead minimization, and parallel computation all play an important role.
Publisher: Athena Scientific
ISBN: 1886529078
Category : Computers
Languages : en
Pages : 498
Book Description
The purpose of this book is to develop in greater depth some of the methods from the author's Reinforcement Learning and Optimal Control recently published textbook (Athena Scientific, 2019). In particular, we present new research, relating to systems involving multiple agents, partitioned architectures, and distributed asynchronous computation. We pay special attention to the contexts of dynamic programming/policy iteration and control theory/model predictive control. We also discuss in some detail the application of the methodology to challenging discrete/combinatorial optimization problems, such as routing, scheduling, assignment, and mixed integer programming, including the use of neural network approximations within these contexts. The book focuses on the fundamental idea of policy iteration, i.e., start from some policy, and successively generate one or more improved policies. If just one improved policy is generated, this is called rollout, which, based on broad and consistent computational experience, appears to be one of the most versatile and reliable of all reinforcement learning methods. In this book, rollout algorithms are developed for both discrete deterministic and stochastic DP problems, and the development of distributed implementations in both multiagent and multiprocessor settings, aiming to take advantage of parallelism. Approximate policy iteration is more ambitious than rollout, but it is a strictly off-line method, and it is generally far more computationally intensive. This motivates the use of parallel and distributed computation. One of the purposes of the monograph is to discuss distributed (possibly asynchronous) methods that relate to rollout and policy iteration, both in the context of an exact and an approximate implementation involving neural networks or other approximation architectures. Much of the new research is inspired by the remarkable AlphaZero chess program, where policy iteration, value and policy networks, approximate lookahead minimization, and parallel computation all play an important role.
Reinforcement Learning, second edition
Author: Richard S. Sutton
Publisher: MIT Press
ISBN: 0262352702
Category : Computers
Languages : en
Pages : 549
Book Description
The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intelligence. Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives while interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the field's key ideas and algorithms. This second edition has been significantly expanded and updated, presenting new topics and updating coverage of other topics. Like the first edition, this second edition focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes. Part I covers as much of reinforcement learning as possible without going beyond the tabular case for which exact solutions can be found. Many algorithms presented in this part are new to the second edition, including UCB, Expected Sarsa, and Double Learning. Part II extends these ideas to function approximation, with new sections on such topics as artificial neural networks and the Fourier basis, and offers expanded treatment of off-policy learning and policy-gradient methods. Part III has new chapters on reinforcement learning's relationships to psychology and neuroscience, as well as an updated case-studies chapter including AlphaGo and AlphaGo Zero, Atari game playing, and IBM Watson's wagering strategy. The final chapter discusses the future societal impacts of reinforcement learning.
Publisher: MIT Press
ISBN: 0262352702
Category : Computers
Languages : en
Pages : 549
Book Description
The significantly expanded and updated new edition of a widely used text on reinforcement learning, one of the most active research areas in artificial intelligence. Reinforcement learning, one of the most active research areas in artificial intelligence, is a computational approach to learning whereby an agent tries to maximize the total amount of reward it receives while interacting with a complex, uncertain environment. In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the field's key ideas and algorithms. This second edition has been significantly expanded and updated, presenting new topics and updating coverage of other topics. Like the first edition, this second edition focuses on core online learning algorithms, with the more mathematical material set off in shaded boxes. Part I covers as much of reinforcement learning as possible without going beyond the tabular case for which exact solutions can be found. Many algorithms presented in this part are new to the second edition, including UCB, Expected Sarsa, and Double Learning. Part II extends these ideas to function approximation, with new sections on such topics as artificial neural networks and the Fourier basis, and offers expanded treatment of off-policy learning and policy-gradient methods. Part III has new chapters on reinforcement learning's relationships to psychology and neuroscience, as well as an updated case-studies chapter including AlphaGo and AlphaGo Zero, Atari game playing, and IBM Watson's wagering strategy. The final chapter discusses the future societal impacts of reinforcement learning.
Optimal Adaptive Control and Differential Games by Reinforcement Learning Principles
Author: Draguna L. Vrabie
Publisher: IET
ISBN: 1849194890
Category : Computers
Languages : en
Pages : 305
Book Description
The book reviews developments in the following fields: optimal adaptive control; online differential games; reinforcement learning principles; and dynamic feedback control systems.
Publisher: IET
ISBN: 1849194890
Category : Computers
Languages : en
Pages : 305
Book Description
The book reviews developments in the following fields: optimal adaptive control; online differential games; reinforcement learning principles; and dynamic feedback control systems.
Reinforcement Learning for Optimal Feedback Control
Author: Rushikesh Kamalapurkar
Publisher: Springer
ISBN: 331978384X
Category : Technology & Engineering
Languages : en
Pages : 305
Book Description
Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution. To yield an approximate optimal controller, the authors focus on theories and methods that fall under the umbrella of actor–critic methods for machine learning. They concentrate on establishing stability during the learning phase and the execution phase, and adaptive model-based and data-driven reinforcement learning, to assist readers in the learning process, which typically relies on instantaneous input-output measurements. This monograph provides academic researchers with backgrounds in diverse disciplines from aerospace engineering to computer science, who are interested in optimal reinforcement learning functional analysis and functional approximation theory, with a good introduction to the use of model-based methods. The thorough treatment of an advanced treatment to control will also interest practitioners working in the chemical-process and power-supply industry.
Publisher: Springer
ISBN: 331978384X
Category : Technology & Engineering
Languages : en
Pages : 305
Book Description
Reinforcement Learning for Optimal Feedback Control develops model-based and data-driven reinforcement learning methods for solving optimal control problems in nonlinear deterministic dynamical systems. In order to achieve learning under uncertainty, data-driven methods for identifying system models in real-time are also developed. The book illustrates the advantages gained from the use of a model and the use of previous experience in the form of recorded data through simulations and experiments. The book’s focus on deterministic systems allows for an in-depth Lyapunov-based analysis of the performance of the methods described during the learning phase and during execution. To yield an approximate optimal controller, the authors focus on theories and methods that fall under the umbrella of actor–critic methods for machine learning. They concentrate on establishing stability during the learning phase and the execution phase, and adaptive model-based and data-driven reinforcement learning, to assist readers in the learning process, which typically relies on instantaneous input-output measurements. This monograph provides academic researchers with backgrounds in diverse disciplines from aerospace engineering to computer science, who are interested in optimal reinforcement learning functional analysis and functional approximation theory, with a good introduction to the use of model-based methods. The thorough treatment of an advanced treatment to control will also interest practitioners working in the chemical-process and power-supply industry.