Deceptive Path Planning via Count-Based Reinforcement Learning under Specific Time Constraint

• Published in: Mathematics (Basel) 2024-07, Vol.12 (13), p.1979
• Main Authors: Chen, Dejun, Zeng, Yunxiu, Zhang, Yi, Li, Shuilin, Xu, Kai, Yin, Quanjun
• Format: Article
• Language: English
• Subjects: count-based reinforcement learning; Deception; deceptiveness; Experiments; goal recognition; Methods; Path planning; Planning; Probability; Public safety; Random walk; Rationality; Recognition; Statistical analysis
• ISSN: 2227-7390; 2227-7390
• DOI: 10.3390/math12131979

Deceptive path planning (DPP) aims to find a path that minimizes the probability of the observer identifying the real goal of the observed before it reaches. It is important for addressing issues such as public safety, strategic path planning, and logistics route privacy protection. Existing traditional methods often rely on “dissimulation”—hiding the truth—to obscure paths while ignoring the time constraints. Building upon the theory of probabilistic goal recognition based on cost difference, we proposed a DPP method, DPP_Q, based on count-based Q-learning for solving the DPP problems in discrete path-planning domains under specific time constraints. Furthermore, to extend this method to continuous domains, we proposed a new model of probabilistic goal recognition called the Approximate Goal Recognition Model (AGRM) and verified its feasibility in discrete path-planning domains. Finally, we also proposed a DPP method based on proximal policy optimization for continuous path-planning domains under specific time constraints called DPP_PPO. DPP methods like DPP_Q and DPP_PPO are types of research that have not yet been explored in the field of path planning. Experimental results show that, in discrete domains, compared to traditional methods, DPP_Q exhibits better effectiveness in enhancing the average deceptiveness of paths. (Improved on average by 12.53% compared to traditional methods). In continuous domains, DPP_PPO shows significant advantages over random walk methods. Both DPP_Q and DPP_PPO demonstrate good applicability in path-planning domains with uncomplicated obstacles.