Towards optimized TBM cutter changing policies with reinforcement learning

In tunnel boring machine (TBM) excavation, cutter maintenance is necessary, but the time for it has to be minimized for efficiency. Although there is extensive literature on TBM cutter wear and predictive maintenance for different industrial applications, there is no optimized policy for cutter chan...

Full description

Saved in:
Bibliographic Details
Published in:Geomechanik und Tunnelbau 2022-10, Vol.15 (5), p.665-670
Main Authors: Erharter, Georg H., Hansen, Tom F.
Format: Article
Language:English
Subjects:
Boring machines
cutter wear
Cutters
Dredging
Drilling & boring machinery
Engineering geology
Excavation
Felsmechanik
Industrial applications
Ingenieurgeologie
Learning algorithms
Logistics
Machine learning
Maschineller Vortrieb
Mechanized tunneling
Policies
policy optimization
Predictive maintenance
Reinforcement
reinforcement learning
Rock mechanics
Simulation
TBM tunnelling
Tunnel construction
Wear
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In tunnel boring machine (TBM) excavation, cutter maintenance is necessary, but the time for it has to be minimized for efficiency. Although there is extensive literature on TBM cutter wear and predictive maintenance for different industrial applications, there is no optimized policy for cutter changes in TBM tunnelling today. This study aims to investigate the application of reinforcement learning (RL) – a branch of machine learning – for finding optimized policies for cutter changing that maximize the number of working cutters and minimize the maintenance effort. A simulation of a TBM excavation process is developed that focuses on the cutter wear and an agent that controls when cutters must be changed. The simulation uses generated parameters that indicate the cutter life, but the results could be transferred to real sensor data in future excavations once that level of development is reached. The article presents the first results from this RL scenario which can give valuable insights into TBM excavation logistics and presents a challenging multiaction‐selection RL problem.
ISSN:1865-7362
1865-7389
DOI:10.1002/geot.202200032