Back to search

Carleton University

Performance Improvements for Wireless Mobile Networks via Deep Reinforcement Learning

Abstract

dc:description.abstract

Deep reinforcement learning (DRL) is evolved from a collection of powerful techniques in artificial intelligence areas, and has been extensively used in different areas. In DRL, an agent learns to take actions that would yield the most reward by interacting with the environment without prior knowledge of an exact mathematical model of the environment.In this work, we investigate the performance improvements for wireless mobile networks via DRL. We firstly present a DRL approach in cache-enabled opportunistic interference alignment wireless networks. Most existing related works assume that the wireless channels are invariant, which is unrealistic. We consider time-varying channels, and therefore the complexity of the system is very high. We use Google TensorFlow to implement DRL in this chapter to obtain the optimal user selection policy in cache-enabled opportunistic interference alignment wireless networks. Simulation results are presented to show that the network's sum rate and energy efficiency can be significantly improved by using the proposed approach.Secondly, we design a software-defined framework for connected vehicles, which integrates communication, caching and mobile edge computing. A deep reinforcement learning-based resource allocation scheme is proposed for the connected vehicles. The dynamic change processes of the resources are modeled as Markov chains, respectively. Without any assumptions about the objective functions or any low-complexity preprocessing, the proposed scheme can directly solve the resource allocation problems with large-scale state space. Simulation results verify that the proposed scheme can converge at a fast speed, and improve the network operator's total utilities.Thirdly, we study trust-based social networks with mobile edge computing, in-network caching and device-to-device communications. An optimization problem is formulated to maximize the network operator's utility with comprehensive considerations of trust values, computation capabilities, wireless channel qualities, and the cache status of all the available nodes. We apply a DRL approach to automatically make a decision for allocating the network resources. The decision is made purely through observing the network's states, rather than any handcrafted or explicit control rules, which makes it adaptive to variable network conditions. Simulation results with different network parameters are presented to show the effectiveness of the proposed scheme.

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Doctoral
Discipline thesis:degree_discipline
Engineering, Electrical and Computer
Grantor dc:publisher
Carleton University
Year dc:date.issued
2019

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • He, Ying

Subjects

dc:subject × 2

Rights

dc:rights
Statement dc:rights
  • Copyright © 2019 the author(s). Theses may be used for non-commercial research, educational, or related academic purposes only. Such uses include personal study, research, scholarship, and teaching. Theses may only be shared by linking to Carleton University Institutional Repository and no part may be used without proper attribution to the author. No part may be used for commercial purposes directly or indirectly via a for-profit platform; no adaptation or derivative works are permitted without consent from the copyright owner.
Language dc:language.iso
en

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Carleton University
Base URL
carleton.scholaris.ca/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

He, Ying. Performance Improvements for Wireless Mobile Networks via Deep Reinforcement Learning. Doctoral thesis, Carleton University, 2019. https://hdl.handle.net/20.500.14718/39709