Multimodal Vehicle Classification Based on Radar and Acoustic Sensors Using Hybrid Shallow CNN

This study proposed a multimodal vehicle classification approach using a hybrid shallow CNN architecture that integrates radar and acoustic sensor data to overcome the limitations of single-sensor systems. The shallow CNN includes convolutional layers with max-pooling and fully connected layers, emp...

Full description

Saved in:
Bibliographic Details
Main Authors: Yazli, Aida Yasmin, Mohd Shariff, Khairul Khaizi, Mutalib Al Junid Syed Abdul Rahman, Syed Abdul, Md Ali, Mohd Ali
Format: Conference Proceeding
Language:English
Subjects:
acoustic sensor
Acoustic sensors
Convolutional neural networks
Data integration
lassification
Motorcycles
Radar
Radar imaging
radar sensor
shallow CNN
System performance
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study proposed a multimodal vehicle classification approach using a hybrid shallow CNN architecture that integrates radar and acoustic sensor data to overcome the limitations of single-sensor systems. The shallow CNN includes convolutional layers with max-pooling and fully connected layers, employing concatenation or summation operators for data fusion at early or late stages. Evaluated on a dataset of 3300 paired samples across five vehicle classes, with spectrogram images as input, the proposed method yielded promising results. Late fusion with concatenation outperformed early fusion and summation. The highest F1-scores were 99%-100% for lorry, motorcycles, buses, and no traffic, and 97% for cars. This multimodal approach demonstrated its potential for intelligent transportation systems and traffic monitoring applications.
ISSN:2324-7851
DOI:10.1109/ISWTA62130.2024.10652023