Cross-modal generative models for multi-modal plastic sorting

Automated sorting through chemometric analysis of plastic spectral data could be a key strategy towards improving plastic waste management. Deep learning is a promising chemometric tool, but further development through multi-modal deep learning has been limited by lack of data availability. A new Mu...

Full description

Saved in:
Bibliographic Details
Published in:Journal of cleaner production 2023-08, Vol.415, p.137919, Article 137919
Main Authors: Neo, Edward R.K., Low, Jonathan S.C., Goodship, Vannessa, Coles, Stuart R., Debattista, Kurt
Format: Article
Language:English
Subjects:
Chemometrics
Data augmentation
Generative deep learning
Multi-modal
Plastic recycling
Spectroscopy
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Automated sorting through chemometric analysis of plastic spectral data could be a key strategy towards improving plastic waste management. Deep learning is a promising chemometric tool, but further development through multi-modal deep learning has been limited by lack of data availability. A new Multi-modal Plastic Spectral Database (MMPSD) consisting of Fourier Transform Infrared (FTIR), Raman and Laser-induced Breakdown Spectroscopy (LIBS) data for each sample in the database is introduced in this work. MMPSD serves as the basis for novel cross-modality generative model technique termed Spectral Conversion Autoencoders (SCAE), which generates synthetic data from data of another modality. SCAE is advantageous over traditional generative models like Variational Autoencoders (VAE), as it can generate class specific synthetic data without the need to train multiple models for each data class. MMPSD also facilitated the exploration of multi-modal deep learning, which improved the classification accuracy as compared to an uni-modal approach from 0.933 to 0.970. SCAE can further be combined with multi-modal methods to achieve a higher accuracy of 0.963 while still using a single sensor to reduce costs, which can be applied for multi-modal augmentation from FTIR sensors used in industrial sorting. [Display omitted] •Chemometrics research limited by small and uni-modal spectral databases.•Multi-modal database aids development of advanced chemometrics tools.•Cross-modal generative and multi-modal deep learning were developed.•Multi-modal fusion of FTIR, Raman and LIBS data improves classification accuracy.•FTIR data augmented with cross-modal synthetic data can be applied industrially.
ISSN:0959-6526
1879-1786
DOI:10.1016/j.jclepro.2023.137919