A novel dynamic Q-learning-based scheduler technique for LTE-advanced technologies using neural networks

• Main Authors: Sorin Comsa, Ioan, Sijing Zhang, Aydin, M., Kuonen, P., Wagen, J.
• Format: Conference Proceeding
• Language: English
• Subjects: CQI; Dynamic scheduling; fairness; Heuristic algorithms; LTE-Advanced; neural network; Neural networks; Optimal scheduling; policy; Q-learning; Scheduling algorithms; scheduling rule; Throughput; TTI
• ISSN: 0742-1303
• DOI: 10.1109/LCN.2012.6423642

The tradeoff concept between system capacity and user fairness attracts a big interest in LTE-Advanced resource allocation strategies. By using static threshold values for throughput or fairness, regardless the network conditions, makes the scheduler to be inflexible when different tradeoff levels are required by the system. This paper proposes a novel dynamic neural Q-learning-based scheduling technique that achieves a flexible throughput-fairness tradeoff by offering optimal solutions according to the Channel Quality Indicator (CQI) for different classes of users. The Q-learning algorithm is used to adopt different policies of scheduling rules, at each Transmission Time Interval (TTI). The novel scheduling technique makes use of neural networks in order to estimate proper scheduling rules for different states which have not been explored yet. Simulation results indicate that the novel proposed method outperforms the existing scheduling techniques by maximizing the system throughput when different levels of fairness are required. Moreover, the system achieves a desired throughput-fairness tradeoff and an overall satisfaction for different classes of users.