Login | Register

Application of Reinforcement Learning in 5G Millimeter-Wave Networks

Title:

Application of Reinforcement Learning in 5G Millimeter-Wave Networks

Golkaramnay, Artmiz ORCID: https://orcid.org/0000-0002-9618-9199 (2020) Application of Reinforcement Learning in 5G Millimeter-Wave Networks. Masters thesis, Concordia University.

[thumbnail of Golkaramnay_MASc_S2020.pdf]
Preview
Text (application/pdf)
Golkaramnay_MASc_S2020.pdf - Accepted Version
1MB

Abstract

The increasingly growing number of mobile communications users and smart devices have attracted researchers and industry pioneers to the largely under-utilized spectrum in the millimeter-wave (mmWave) frequency bands for the 5th generation of wireless networks. This could provide hundreds of times more capacity as compared to 4G cellular networks. The main reason for ignoring the mmWave spectrum until now, has been its vulnerability to signal blockages and possible disconnection or interruption in service. Considering that today’s mobile users expect high reliability and throughput connections, the mmWave signal sensitivity to blockages must be addressed. This research proposes to predict base stations that can service a user without disconnections, given the user’s path or destination in the network.
In modern networks, reinforcement learning has been effectively utilized to obtain optimal decisions (or actions being taken) in small state-action spaces. Deep reinforcement learning has been able find optimal policies in larger network spaces. In this work, similar techniques are employed to find ways to serve the user without service disconnection or interruption. First, using dynamic programming for a fixed user path, the exact optimal serving base stations are listed. Then, using Q-learning, the network will learn to predict the optimal user path and serving base stations listed, given a fixed destination for the user. Lastly, deep Q-learning is used to approximate optimal user paths and base station lists along that path, similar to the Q-learning results, which can also be applied to networks with more sophisticated state spaces.

Divisions:Concordia University > Gina Cody School of Engineering and Computer Science > Electrical and Computer Engineering
Item Type:Thesis (Masters)
Authors:Golkaramnay, Artmiz
Institution:Concordia University
Degree Name:M.A. Sc.
Program:Electrical and Computer Engineering
Date:27 March 2020
Thesis Supervisor(s):Mehmet Ali, Mustafa and Qiu, Dongyu
ID Code:986700
Deposited By: Artmiz Golkaramnay
Deposited On:27 Oct 2022 13:46
Last Modified:27 Oct 2022 13:46
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top