A deep reinforcement learning based method for real-time path planning and dynamic obstacle avoidance

In a dynamic environment, the moving obstacle makes the path planning of the manipulator very difficult. Therefore, this paper proposes a path planning with dynamic obstacle avoidance method of the manipulator based on a deep reinforcement learning algorithm soft actor-critic (SAC). To avoid the mov...

Full description

Saved in:
Bibliographic Details
Published in:Neurocomputing (Amsterdam) 2022-08, Vol.497, p.64-75
Main Authors: Chen, Pengzhan, Pei, Jiean, Lu, Weiqing, Li, Mingzhen
Format: Article
Language:English
Subjects:
Dynamic obstacle avoidance
Path planning
Prioritized Experience Replay (PER)
Soft Actor-Critic (SAC)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In a dynamic environment, the moving obstacle makes the path planning of the manipulator very difficult. Therefore, this paper proposes a path planning with dynamic obstacle avoidance method of the manipulator based on a deep reinforcement learning algorithm soft actor-critic (SAC). To avoid the moving obstacle in the environment and make real-time planning, we design a comprehensive reward function of dynamic obstacle avoidance and target approach. Aiming at the problem of low sample utilization caused by random sampling, in this paper, prioritized experience replay (PER) is employed to change the weight of samples, and then improve the sampling efficiency. In addition, we carry out the simulation experiment and give the results. The result shows that this method can effectively avoid moving obstacles in the environment, and complete the planning task with a high success rate.
ISSN:0925-2312
1872-8286
DOI:10.1016/j.neucom.2022.05.006