GADA-SegNet: gated attentive domain adaptation network for semantic segmentation of LiDAR point clouds

We propose GADA-SegNet, a gated attentive domain adaptation network for semantic segmentation of LiDAR point clouds. Unlike most of existing methods that learn fully from point-wise annotations, our GADA-SegNet attempts to learn from labeled data first and then transfer itself smoothly to unlabeled...

Full description

Saved in:
Bibliographic Details
Published in:The Visual computer 2023-06, Vol.39 (6), p.2471-2481
Main Authors: Kong, Xin, Xia, Shifeng, Liu, Ningzhong, Wei, Mingqing
Format: Article
Language:English
Subjects:
Adaptation
Artificial Intelligence
Computer Graphics
Computer Science
Datasets
Deep learning
Image Processing and Computer Vision
Image segmentation
Lidar
Modules
Original Article
Semantic segmentation
Semantics
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose GADA-SegNet, a gated attentive domain adaptation network for semantic segmentation of LiDAR point clouds. Unlike most of existing methods that learn fully from point-wise annotations, our GADA-SegNet attempts to learn from labeled data first and then transfer itself smoothly to unlabeled data. We have three key contributions to bridge the domain gap between the labeled data and the unlabeled yet unseen data. First, we design a new gated connection module that can filter out noise and domain-private features from the low-level features, for better high- and low-level feature fusion. Second, we introduce a multi-scale attention module that can ease the large-scale variation of objects and class imbalance in complex scenes to reduce the class-level domain gap. Third, we develop a shared domain discriminator to implement the class-level domain discrimination for large-scale LiDAR point clouds. Experiments on both synthetic-to-real and real-to-real scenarios show clear improvements of our GADA-SegNet over its competitors.
ISSN:0178-2789
1432-2315
DOI:10.1007/s00371-023-02799-w