Ekram Hossain

Deep Reinforcement Learning for Wireless Communications and Networking Comprehensive guide to Deep Reinforcement Learning (DRL) as applied to wireless communication systems Deep Reinforcement Learning for Wireless Communications and Networking presents an overview of the development of DRL while providing fundamental knowledge about theories, formulation, design, learning models, algorithms and implementation of DRL together with a particular case study to practice. The book also covers diverse applications of DRL to address various problems in wireless networks, such as caching, offloading, resource sharing, and security. The authors discuss open issues by introducing some advanced DRL approaches to address emerging issues in wireless communications and networking. Covering new advanced models of DRL, e.g., deep dueling architecture and generative adversarial networks, as well as emerging problems considered in wireless networks, e.g., ambient backscatter communication, intelligent reflecting surfaces and edge intelligence, this is the first comprehensive book studying applications of DRL for wireless networks that presents the state-of-the-art research in architecture, protocol, and application design. Deep Reinforcement Learning for Wireless Communications and Networking covers specific topics such as: Deep reinforcement learning models, covering deep learning, deep reinforcement learning, and models of deep reinforcement learningPhysical layer applications covering signal detection, decoding, and beamforming, power and rate control, and physical-layer securityMedium access control (MAC) layer applications, covering resource allocation, channel access, and user/cell associationNetwork layer applications, covering traffic routing, network classification, and network slicing With comprehensive coverage of an exciting and noteworthy new technology, Deep Reinforcement Learning for Wireless Communications and Networking is an essential learning resource for researchers and communications engineers, along with developers and entrepreneurs in autonomous systems, who wish to harness this technology in practical applications.

Do you need to design efficient wireless communications systems? This unique text provides detailed coverage of radio resource allocation problems in wireless networks and the techniques that can be used to solve them. Covering basic principles and mathematical algorithms, and with a particular focus on power control and channel allocation, you will learn how to model, analyze, and optimize the allocation of resources in both physical and data link layers, and for a range of different network types. Both established and emerging networks are considered, including CDMA and OFDMA wireless networks, relay-based wireless networks, and cognitive radio networks. Numerous exercises help you put knowledge into practice, and provide the tools needed to address some of the current research problems in the field. This is an essential reference whether you are a graduate student, researcher or industry professional working in the field of wireless communication networks.

Covering the fundamental theory together with the state of the art in research and development, this practical guide provides the techniques needed to design, analyze, and optimize device-to-device (D2D) communications in wireless networking. With an ever-increasing demand for higher data rate wireless access, D2D communication is set to become a key feature supported by next generation cellular networks. This book introduces D2D-based wireless communications from the physical, MAC, network, and application layer perspectives, providing all the key background information before moving on to discuss real-world applications as well as potential future developments. Key topics are discussed in detail, such as dynamic resource sharing (for example of spectrum and power) between cellular and ad hoc D2D communications to accommodate larger volumes of traffic and provide better service to users. Readers will understand the practical challenges of resource management, optimization, security, standardization, and network topology, and learn how the design principles are applied in practice.

Introduction to Network Simulator NS2 is a primer providing materials for NS2 beginners, whether students, professors, or researchers for understanding the architecture of Network Simulator 2 (NS2) and for incorporating simulation modules into NS2. The authors discuss the simulation architecture and the key components of NS2 including simulation-related objects, network objects, packet-related objects, and helper objects. The NS2 modules included within are nodes, links, SimpleLink objects, packets, agents, and applications. Further, the book covers three helper modules: timers, random number generators, and error models. Also included are chapters on summary of debugging, variable and packet tracing, result compilation, and examples for extending NS2. Two appendices provide the details of scripting language Tcl, OTcl and AWK, as well object oriented programming used extensively in NS2.

Providing an extensive overview of the radio resource management problem in femtocell networks, this invaluable book considers both code division multiple access femtocells and orthogonal frequency-division multiple access femtocells. In addition to incorporating current research on this topic, the book also covers technical challenges in femtocell deployment, provides readers with a variety of approaches to resource allocation and a comparison of their effectiveness, explains how to model various networks using Stochastic geometry and shot noise theory, and much more.

Introduction to Network Simulator NS2 is a primer providing materials for NS2 beginners, whether students, professors, or researchers for understanding the architecture of Network Simulator 2 (NS2) and for incorporating simulation modules into NS2. The authors discuss the simulation architecture and the key components of NS2 including simulation-related objects, network objects, packet-related objects, and helper objects. The NS2 modules included within are nodes, links, SimpleLink objects, packets, agents, and applications. Further, the book covers three helper modules: timers, random number generators, and error models. Also included are chapters on summary of debugging, variable and packet tracing, result compilation, and examples for extending NS2. Two appendices provide the details of scripting language Tcl, OTcl and AWK, as well object oriented programming used extensively in NS2.

Are you involved in designing the next generation of wireless networks? With spectrum becoming an ever scarcer resource, it is critical that new systems utilize all available frequency bands as efficiently as possible. The revolutionary technology presented in this book will be at the cutting edge of future wireless communications. Dynamic Spectrum Access and Management in Cognitive Radio Networks provides you with an all-inclusive introduction to this emerging technology, outlining the fundamentals of cognitive radio-based wireless communication and networking, spectrum sharing models, and the requirements for dynamic spectrum access. In addition to the different techniques and their applications in designing dynamic spectrum access methods, you'll also find state-of-the-art dynamic spectrum access schemes, including classifications of the different schemes and the technical details of each scheme. This is a perfect introduction for graduate students and researchers, as well as a useful self-study guide for practitioners.