nuScenes Knowledge Graph -- A comprehensive semantic representation of traffic scenes for trajectory prediction

Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonst...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-12
Main Authors: Mlodzian, Leon, Sun, Zhigang, Berkemeyer, Hendrik, Monka, Sebastian, Wang, Zixu, Dietze, Stefan, Halilaj, Lavdim, Luettin, Juergen
Format: Article
Language:English
Subjects:
Graph neural networks
Knowledge representation
Roads
Semantics
Topology
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonstrated the potential of leveraging heterogeneous context for improving trajectory prediction, state-of-the-art deep learning approaches still rely on a limited subset of this information. This is mainly due to the limited availability of comprehensive representations. This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes. Further, we present nuScenes Knowledge Graph (nSKG), a knowledge graph for the nuScenes dataset, that models explicitly all scene participants and road elements, as well as their semantic and spatial relationships. To facilitate the usage of the nSKG via graph neural networks for trajectory prediction, we provide the data in a format, ready-to-use by the PyG library. All artefacts can be found here: https://github.com/boschresearch/nuScenes_Knowledge_Graph
ISSN:2331-8422