Optimal Control of Data Transmission over a Fluctuating Channel with Unknown State

• Published in: Journal of communications technology & electronics 2018-12, Vol.63 (12), p.1506-1517
• Main Authors: Kuznetsov, N. A., Myasnikov, D. V., Semenikhin, K. V.
• Format: Article
• Language: English
• Subjects: Analysis; Analysis and Synthesis of Control Systems; Buffers; Communications Engineering; Computer simulation; Cybersecurity; Data transmission; Energy conservation; Energy consumption; Engineering; Markov analysis; Markov chains; Markov processes; Networks; Optimal control; Optimization; Packet transmission; Policies; Queues; Queuing theory; Telecommunications equipment; Variation
• ISSN: 1064-2269; 1555-6557
• DOI: 10.1134/S1064226918120136

—Optimization problem for data packet transmission over a communication channel governed by a hidden Markov process is considered. The transmitter is modeled as a single-channel finite-buffer queuing system with non-stationary Poisson arrivals. The service rate is proportional to the controlled transmission rate with channel-dependent factor. Buffer overflow leads to packet losses, whereas channel state worsening results in lower service rate. The goal of the optimization problem is to minimize average losses under constraint on the transmitter energy consumption. The exact form of the optimal policy is presented for the augmented control problem. Several control policies with incomplete information are proposed on the basis of the optimal control and hidden state estimates. We consider two estimates based on the optimal filtering equations and the current queue state. Results of computer simulation are presented to compare the control policies under consideration.