Toward self‐driving processes: A deep reinforcement learning approach to control

• Published in: AIChE journal 2019-10, Vol.65 (10), p.n/a
• Main Authors: Spielberg, Steven, Tulsyan, Aditya, Lawrence, Nathan P., Loewen, Philip D., Bhushan Gopaluni, R.
• Format: Article
• Language: English
• Subjects: actor–critic networks; Computer simulation; Controllers; deep learning; Machine learning; model‐free learning; Performance degradation; process control; Reinforcement; reinforcement learning
• ISSN: 0001-1541; 1547-5905
• DOI: 10.1002/aic.16689

Advanced model‐based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously and to initiate a remedial model re‐identification procedure in the event of performance degradation. Such procedures are typically complicated and resource intensive, and they often cause costly interruptions to normal operations. In this article, we exploit recent developments in reinforcement learning and deep learning to develop a novel adaptive, model‐free controller for general discrete‐time processes. The deep reinforcement learning (DRL) controller we propose is a data‐based controller that learns the control policy in real time by merely interacting with the process. The effectiveness and benefits of the DRL controller are demonstrated through many simulations.