Hidden Enemy Visualization using Fast Panoptic Segmentation on Battlefields

Most of enemies in battlefields are not visible due to cover and concealment, and it yields fear and a weakened combat power for allies. In order to overcome it, we present a new approach for visualizing hidden enemies in battlefields to enhance cognition ability and survival for soldiers. Our metho...

Full description

Saved in:
Bibliographic Details
Main Authors: Son, Jeany, Lee, Soyeon
Format: Conference Proceeding
Language:English
Subjects:
Battlefield
Cognition
Conferences
Deep Learning
Games
Image Completion
Image reconstruction
Image restoration
Image segmentation
Military
Panoptic Segmentation
Real-time systems
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Most of enemies in battlefields are not visible due to cover and concealment, and it yields fear and a weakened combat power for allies. In order to overcome it, we present a new approach for visualizing hidden enemies in battlefields to enhance cognition ability and survival for soldiers. Our method is composed of two separate sub-task networks. One is an efficient real-time panoptic segmentation network based on YOLACT [1] to find hidden enemies as well as to understand scenes from the viewpoint of soldiers. The other is an image completion network to reconstruct occluded parts of enemies which is guided by the panoptic segmentation networks. Our experiments on the Cityscapes benchmarks show that the proposed panoptic segmentation network achieves almost realtime speed without significant performance drops. We also demonstrate qualitative results of our segmentation-guided image completion method successfully on a dataset constructed from images of the Battlefield4 game.
ISSN:2375-9356
DOI:10.1109/BigComp51126.2021.00061