Author: Zhenting Hou
Publisher: Springer Science & Business Media
ISBN: 3642681271
Category : Mathematics
Languages : en
Pages : 286
Get Book Here
Book Description
Markov processes play an important role in the study of probability theory. Homogeneous denumerable Markov processes are among the main topics in the theory and have a wide range of application in various fields of science and technology (for example, in physics, cybernetics, queuing theory and dynamical programming). This book is a detailed presentation and summary of the research results obtained by the authors in recent years. Most of the results are published for the first time. Two new methods are given: one is the minimal nonnegative solution, the second the limit transition method. With the help of these two methods, the authors solve many important problems in the framework of denumerable Markov processes.
Author: Xiangqun Yang
Publisher:
ISBN:
Category : Mathematics
Languages : en
Pages : 428
Get Book Here
Book Description
Reaches the forefront of research in the construction theory of denumerable Markov processes and gives impetus to the development of probability theory. Introduces Markov processes and their construction; surveys research in the field; and presents the author's original results, which include complete solutions to some important problems, many published here for the first time in English. Complete solutions are given for two key construction problems: birth-death processes and two-sided birth-death processes.
Author: Zhenting Hou
Publisher: Springer Science & Business Media
ISBN: 146130265X
Category : Mathematics
Languages : en
Pages : 501
Get Book Here
Book Description
The general theory of stochastic processes and the more specialized theory of Markov processes evolved enormously in the second half of the last century. In parallel, the theory of controlled Markov chains (or Markov decision processes) was being pioneered by control engineers and operations researchers. Researchers in Markov processes and controlled Markov chains have been, for a long time, aware of the synergies between these two subject areas. However, this may be the first volume dedicated to highlighting these synergies and, almost certainly, it is the first volume that emphasizes the contributions of the vibrant and growing Chinese school of probability. The chapters that appear in this book reflect both the maturity and the vitality of modern day Markov processes and controlled Markov chains. They also will provide an opportunity to trace the connections that have emerged between the work done by members of the Chinese school of probability and the work done by the European, US, Central and South American and Asian scholars.
Author: A. T. Bharucha-Reid
Publisher: Courier Corporation
ISBN: 0486150356
Category : Mathematics
Languages : en
Pages : 485
Get Book Here
Book Description
This graduate-level text and reference in probability, with numerous applications to several fields of science, presents nonmeasure-theoretic introduction to theory of Markov processes. The work also covers mathematical models based on the theory, employed in various applied fields. Prerequisites are a knowledge of elementary probability theory, mathematical statistics, and analysis. Appendixes. Bibliographies. 1960 edition.
Author: Wolfgang Woess
Publisher: Bradt Travel Guides
ISBN: 9783037190715
Category : Mathematics
Languages : en
Pages : 380
Get Book Here
Book Description
Markov chains are among the basic and most important examples of random processes. This book is about time-homogeneous Markov chains that evolve with discrete time steps on a countable state space. A specific feature is the systematic use, on a relatively elementary level, of generating functions associated with transition probabilities for analyzing Markov chains. Basic definitions and facts include the construction of the trajectory space and are followed by ample material concerning recurrence and transience, the convergence and ergodic theorems for positive recurrent chains. There is a side-trip to the Perron-Frobenius theorem. Special attention is given to reversible Markov chains and to basic mathematical models of population evolution such as birth-and-death chains, Galton-Watson process and branching Markov chains. A good part of the second half is devoted to the introduction of the basic language and elements of the potential theory of transient Markov chains. Here the construction and properties of the Martin boundary for describing positive harmonic functions are crucial. In the long final chapter on nearest neighbor random walks on (typically infinite) trees the reader can harvest from the seed of methods laid out so far, in order to obtain a rather detailed understanding of a specific, broad class of Markov chains. The level varies from basic to more advanced, addressing an audience from master's degree students to researchers in mathematics, and persons who want to teach the subject on a medium or advanced level. Measure theory is not avoided; careful and complete proofs are provided. A specific characteristic of the book is the rich source of classroom-tested exercises with solutions.
Author: Farid AitSahlia
Publisher: World Scientific
ISBN: 9812833862
Category : Mathematics
Languages : en
Pages : 847
Get Book Here
Book Description
This unique volume presents a collection of the extensive journal publications written by Kai Lai Chung over a span of 70-odd years. It was produced to celebrate his 90th birthday. The selection is only a subset of the many contributions that he made throughout his prolific career. Another volume, Chance and Choice, published by World Scientific in 2004, contains yet another subset, with four articles in common with this volume. Kai Lai Chung''s research contributions have had a major influence on several areas in probability. Among his most significant works are those related to sums of independent random variables, Markov chains, time reversal of Markov processes, probabilistic potential theory, Brownian excursions, and gauge theorems for the SchrAdinger equation.As Kai Lai Chung''s contributions spawned critical new developments, this volume also contains retrospective and perspective views provided by collaborators and other authors who themselves advanced the areas of probability and mathematics."
Author: Ch'En Hsi-Ju
Publisher: American Mathematical Soc.
ISBN: 9780821814628
Category :
Languages : en
Pages : 322
Get Book Here
Book Description
Author: Kai Lai Chung
Publisher: Springer
ISBN: 3642496865
Category : Mathematics
Languages : en
Pages : 287
Get Book Here
Book Description
The theory of Markov chains, although a special case of Markov processes, is here developed for its own sake and presented on its own merits. In general, the hypothesis of a denumerable state space, which is the defining hypothesis of what we call a "chain" here, generates more clear-cut questions and demands more precise and definitive an swers. For example, the principal limit theorem (§§ 1. 6, II. 10), still the object of research for general Markov processes, is here in its neat final form; and the strong Markov property (§ 11. 9) is here always applicable. While probability theory has advanced far enough that a degree of sophistication is needed even in the limited context of this book, it is still possible here to keep the proportion of definitions to theorems relatively low. . From the standpoint of the general theory of stochastic processes, a continuous parameter Markov chain appears to be the first essentially discontinuous process that has been studied in some detail. It is common that the sample functions of such a chain have discontinuities worse than jumps, and these baser discontinuities play a central role in the theory, of which the mystery remains to be completely unraveled. In this connection the basic concepts of separability and measurability, which are usually applied only at an early stage of the discussion to establish a certain smoothness of the sample functions, are here applied constantly as indispensable tools.
Author: David Freedman
Publisher: Springer Science & Business Media
ISBN: 1461382300
Category : Mathematics
Languages : en
Pages : 150
Get Book Here
Book Description
A long time ago I started writing a book about Markov chains, Brownian motion, and diffusion. I soon had two hundred pages of manuscript and my publisher was enthusiastic. Some years and several drafts later, I had a thousand pages of manuscript, and my publisher was less enthusiastic. So we made it a trilogy: Markov Chains Brownian Motion and Diffusion Approximating Countable Markov Chains familiarly - MC, B & D, and ACM. I wrote the first two books for beginning graduate students with some knowledge of probability; if you can follow Sections 10.4 to 10.9 of Markov Chains, you're in. The first two books are quite independent of one another, and completely independent of this one, which is a monograph explaining one way to think about chains with instantaneous states. The results here are supposed to be new, except when there are specific disclaimers. It's written in the framework of Markov chains; we wanted to reprint in this volume the MC chapters needed for reference. but this proved impossible. Most of the proofs in the trilogy are new, and I tried hard to make them explicit. The old ones were often elegant, but I seldom saw what made them go. With my own, I can sometimes show you why things work. And, as I will argue in a minute, my demonstrations are easier technically. If I wrote them down well enough, you may come to agree.
Author: Zhen-Qing Chen
Publisher: Princeton University Press
ISBN: 069113605X
Category : Mathematics
Languages : en
Pages : 496
Get Book Here
Book Description
This book gives a comprehensive and self-contained introduction to the theory of symmetric Markov processes and symmetric quasi-regular Dirichlet forms. In a detailed and accessible manner, Zhen-Qing Chen and Masatoshi Fukushima cover the essential elements and applications of the theory of symmetric Markov processes, including recurrence/transience criteria, probabilistic potential theory, additive functional theory, and time change theory. The authors develop the theory in a general framework of symmetric quasi-regular Dirichlet forms in a unified manner with that of regular Dirichlet forms, emphasizing the role of extended Dirichlet spaces and the rich interplay between the probabilistic and analytic aspects of the theory. Chen and Fukushima then address the latest advances in the theory, presented here for the first time in any book. Topics include the characterization of time-changed Markov processes in terms of Douglas integrals and a systematic account of reflected Dirichlet spaces, and the important roles such advances play in the boundary theory of symmetric Markov processes. This volume is an ideal resource for researchers and practitioners, and can also serve as a textbook for advanced graduate students. It includes examples, appendixes, and exercises with solutions.
