Dynamic Wireless Network Control Via Stochastic Approximation

Dynamic Wireless Network Control Via Stochastic Approximation PDF Author: Sina Firouzabadi
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
This thesis investigates different stochastic approximation-based algorithms for performance optimization of wireless networks. Stochastic approximation is used to learn the randomly-varying characteristics of the network conditions and adapt the transmission strategies accordingly. The basic premise of wireless network optimization based on stochastic approximation will be presented, followed by several applications of this technique. The first application optimizes secondary user transmission strategies in cognitive networks with imperfect network state observations. In this setting the secondary user maximizes its revenue while generating a bounded performance loss to the primary users' network. The state of the primary users' network, defined as a collection of variables describing features of the network (e.g., buffer state, packet service state) evolves over time according to a homogeneous Markov process. The statistics of the Markov process are dependent on the strategy of the secondary user and, thus, the instantaneous idleness/transmission action of the secondary user has a long term impact on the temporal evolution of the network. The Markov process generates a sequence of states in the state space of the network that projects onto a sequence of observations in the observation space, that is, the collection of all the observations of the secondary user. Based on the sequence of observations from secondary users, an iterative stochastic approximation based algorithm is proposed that optimizes the strategy of the secondary users with no a priori knowledge of the statistics of the Markov process and of the state-observation probability map. The second application of stochastic approximation theory presented is around the design of green cellular networks through the use of distributed antennas. After presenting an information theoretic analysis of the ergodic capacity of distributed antenna systems in a cellular setting, optimized antenna placement in such systems is investigated. A general framework for this optimization based on stochastic approximation theory, with no constraint on the location of the antennas, will be presented. It will be shown that optimal placement of antennas inside the coverage region can significantly improve the power efficiency of wireless networks. As we will see, our stochastic optimization framework is sufficiently general to incorporate interference as well as general performance metrics. We will also present different numerical studies for illustrating the power efficiency and area spectral efficiency of distributed antenna systems, under different assumptions about availability of channel side information at the transmitter. Finally in the last part of the thesis, we present a distributed algorithm for optimizing the rate-reliability tradeoff in wireless networks with randomly time-varying channels. The stochastic optimization is based on wireless network utility maximization, extended to incorporate dynamics at the physical layer. The proposed algorithm enables a distributed implementation. We also verify the convergence of the proposed algorithm using Stochastic Approximation. The performance of the proposed algorithm and its convergence is illustrated via simulations.

Dynamic Wireless Network Control Via Stochastic Approximation

Dynamic Wireless Network Control Via Stochastic Approximation PDF Author: Sina Firouzabadi
Publisher:
ISBN:
Category :
Languages : en
Pages :

Get Book Here

Book Description
This thesis investigates different stochastic approximation-based algorithms for performance optimization of wireless networks. Stochastic approximation is used to learn the randomly-varying characteristics of the network conditions and adapt the transmission strategies accordingly. The basic premise of wireless network optimization based on stochastic approximation will be presented, followed by several applications of this technique. The first application optimizes secondary user transmission strategies in cognitive networks with imperfect network state observations. In this setting the secondary user maximizes its revenue while generating a bounded performance loss to the primary users' network. The state of the primary users' network, defined as a collection of variables describing features of the network (e.g., buffer state, packet service state) evolves over time according to a homogeneous Markov process. The statistics of the Markov process are dependent on the strategy of the secondary user and, thus, the instantaneous idleness/transmission action of the secondary user has a long term impact on the temporal evolution of the network. The Markov process generates a sequence of states in the state space of the network that projects onto a sequence of observations in the observation space, that is, the collection of all the observations of the secondary user. Based on the sequence of observations from secondary users, an iterative stochastic approximation based algorithm is proposed that optimizes the strategy of the secondary users with no a priori knowledge of the statistics of the Markov process and of the state-observation probability map. The second application of stochastic approximation theory presented is around the design of green cellular networks through the use of distributed antennas. After presenting an information theoretic analysis of the ergodic capacity of distributed antenna systems in a cellular setting, optimized antenna placement in such systems is investigated. A general framework for this optimization based on stochastic approximation theory, with no constraint on the location of the antennas, will be presented. It will be shown that optimal placement of antennas inside the coverage region can significantly improve the power efficiency of wireless networks. As we will see, our stochastic optimization framework is sufficiently general to incorporate interference as well as general performance metrics. We will also present different numerical studies for illustrating the power efficiency and area spectral efficiency of distributed antenna systems, under different assumptions about availability of channel side information at the transmitter. Finally in the last part of the thesis, we present a distributed algorithm for optimizing the rate-reliability tradeoff in wireless networks with randomly time-varying channels. The stochastic optimization is based on wireless network utility maximization, extended to incorporate dynamics at the physical layer. The proposed algorithm enables a distributed implementation. We also verify the convergence of the proposed algorithm using Stochastic Approximation. The performance of the proposed algorithm and its convergence is illustrated via simulations.

Stochastic Power Control for Wireless Networks

Stochastic Power Control for Wireless Networks PDF Author: Shili Lu
Publisher:
ISBN:
Category : University of Ottawa theses
Languages : en
Pages : 296

Get Book Here

Book Description


Scheduling and Congestion Control for Wireless Internet

Scheduling and Congestion Control for Wireless Internet PDF Author: Xin Wang
Publisher: Springer Science & Business Media
ISBN: 1461484200
Category : Computers
Languages : en
Pages : 60

Get Book Here

Book Description
This brief proposes that the keys to internet cross-layer optimization are the development of non-standard implicit primal-dual solvers for underlying optimization problems, and design of jointly optimal network protocols as decomposition of such solvers. Relying on this novel design-space oriented approach, the author develops joint TCP congestion control and wireless-link scheduling schemes for wireless applications over Internet with centralized and distributed (multi-hop) wireless links. Different from the existing solutions, the proposed schemes can be asynchronously implemented without message passing among network nodes; thus they are readily deployed with current infrastructure. Moreover, global convergence/stability of the proposed schemes to optimal equilibrium is established using the Lyapunov method in the network fluid model. Simulation results are provided to evaluate the proposed schemes in practical networks.

Stochastic Approximation and Applications to Networked Systems

Stochastic Approximation and Applications to Networked Systems PDF Author: Thu Thi Le Nguyen
Publisher:
ISBN:
Category : Mathematics
Languages : en
Pages : 103

Get Book Here

Book Description
The second part studies general stochastic approximation algorithms with switching which include many applications that had appeared on literature as special cases. We investigate the inherent interaction between control and communication systems by considering classes SA algorithms that accommodate random network topology, nonlinear dynamics, with complex system noise structures (additive or non additive), and other uncertainties in a unified framework. Interaction among control strategy and the multiple stochastic processes introduces critical challenges in such problems. By modeling the random switching as a discrete time Markov chain and studying multiple stochastic uncertainties in a unified framework, it is shown that under broad conditions, the algorithms are convergent. The performance of the algorithms is further analyzed by establishing their rate of convergence and asymptotic characterizations. Simulation case studies are conducted to evaluate the performance of the procedures in various aspects.

Game Theory and Learning for Wireless Networks

Game Theory and Learning for Wireless Networks PDF Author: Samson Lasaulce
Publisher: Academic Press
ISBN: 0123846986
Category : Business & Economics
Languages : en
Pages : 346

Get Book Here

Book Description
This is the first comprehensive tutorial on game theory and its application to wireless communications. The book starts with a guide to the essential principles of game theory relevant to the communications engineer, giving tools that can be used to develop applications in wireless communications. It explains how game theory models can be applied to distributed resource allocation in a perfect world. Having clarified how the models can be applied in principle, the book then gives practical implementation methods for the real world, showing how the models in the perfect world need to be adapted to real life situations which are far from perfect. The first tutorial style book that gives all the relevant theory, at the right level of rigour, for the wireless communications engineer Bridges the gap between theory and practice by giving examples and case studies showing how game theory can solve real world resource allocation problems Contains algorithms and techniques to implement game theory in wireless terminals.

Drift Fields, a Method for Resource Allocation in Wireless Networks

Drift Fields, a Method for Resource Allocation in Wireless Networks PDF Author: Vinay Rudramuni Majjigi
Publisher: Stanford University
ISBN:
Category :
Languages : en
Pages : 116

Get Book Here

Book Description
This dissertation recommends system engineering designs that implement the latest technologies in OFDMA cellular and femtocellular networks, specifically in the area of resource allocation and interference coordination. These recommended designs guarantee good user experience for time-sensitive applications such as streaming video. While throughput is often the metric used to benchmark a system, field performance requires the system also guarantees a maximum service latency to satisfy users. This dissertation provides both intuitive and low-overhead schemes that are robust and practical for implementation. The novelty of this work is the application of stochastic control techniques that guarantee the Quality of Service (QoS) through proper buffer management. Guarantee of a non-empty user buffer for streaming applications prevents service interruption. The thesis considers both centralized and distributed topologies that result from either a single base-station serving many users, or many femtocell base-stations each serving a single user, respectively. This dissertation provides insight and solutions to the following question: Under the constraints of buffer management, how does a system engineer determine the transmission scheme, resource allocation algorithms, transmitter coordination, user feedback, and achievable QoS guarantees that maximize efficiency. A combination of theory, heuristics motivated in theory, and numerical simulations will justify the presented methods.

WCNN'93, Portland

WCNN'93, Portland PDF Author:
Publisher: Psychology Press
ISBN: 9780805814972
Category : Computer science
Languages : en
Pages : 744

Get Book Here

Book Description


 PDF Author:
Publisher: CRC Press
ISBN: 1135439621
Category :
Languages : en
Pages : 1142

Get Book Here

Book Description


Nonlinear Control and Filtering for Stochastic Networked Systems

Nonlinear Control and Filtering for Stochastic Networked Systems PDF Author: Lifeng Ma
Publisher: CRC Press
ISBN: 0429761929
Category : Technology & Engineering
Languages : en
Pages : 180

Get Book Here

Book Description
In this book, control and filtering problems for several classes of stochastic networked systems are discussed. In each chapter, the stability, robustness, reliability, consensus performance, and/or disturbance attenuation levels are investigated within a unified theoretical framework. The aim is to derive the sufficient conditions such that the resulting systems achieve the prescribed design requirements despite all the network-induced phenomena. Further, novel notions such as randomly occurring sensor failures and consensus in probability are discussed. Finally, the theories/techniques developed are applied to emerging research areas. Key Features Unifies existing and emerging concepts concerning stochastic control/filtering and distributed control/filtering with an emphasis on a variety of network-induced complexities Includes concepts like randomly occurring sensor failures and consensus in probability (with respect to time-varying stochastic multi-agent systems) Exploits the recursive linear matrix inequality approach, completing the square method, Hamilton-Jacobi inequality approach, and parameter-dependent matrix inequality approach to handle the emerging mathematical/computational challenges Captures recent advances of theories, techniques, and applications of stochastic control as well as filtering from an engineering-oriented perspective Gives simulation examples in each chapter to reflect the engineering practice

Learning for Decision and Control in Stochastic Networks

Learning for Decision and Control in Stochastic Networks PDF Author: Longbo Huang
Publisher: Springer Nature
ISBN: 3031315979
Category : Technology & Engineering
Languages : en
Pages : 80

Get Book Here

Book Description
This book introduces the Learning-Augmented Network Optimization (LANO) paradigm, which interconnects network optimization with the emerging AI theory and algorithms and has been receiving a growing attention in network research. The authors present the topic based on a general stochastic network optimization model, and review several important theoretical tools that are widely adopted in network research, including convex optimization, the drift method, and mean-field analysis. The book then covers several popular learning-based methods, i.e., learning-augmented drift, multi-armed bandit and reinforcement learning, along with applications in networks where the techniques have been successfully applied. The authors also provide a discussion on potential future directions and challenges.