Loading…

A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes

Deep learning-based defect detection approaches offer great potential for end-to-end surface defect detection. After the prevalent Convolutional Neural Network (CNN) models were state-of-the-art for almost a decade, transformer-based models recently surpassed the performance of CNN models on standar...

Full description

Saved in:
Bibliographic Details
Published in:Journal of energy storage 2025-01, Vol.105, p.114378, Article 114378
Main Authors: Mattern, Alexander, Gerdes, Henrik, Grunert, Dennis, Schmitt, Robert H.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c222t-d18ebd7c4053751a31a664b6872bb3c14431a1a2bec3b37c74fbeb49c01168dc3
container_end_page
container_issue
container_start_page 114378
container_title Journal of energy storage
container_volume 105
creator Mattern, Alexander
Gerdes, Henrik
Grunert, Dennis
Schmitt, Robert H.
description Deep learning-based defect detection approaches offer great potential for end-to-end surface defect detection. After the prevalent Convolutional Neural Network (CNN) models were state-of-the-art for almost a decade, transformer-based models recently surpassed the performance of CNN models on standard benchmark datasets. However, standard benchmarks such as the Common Objects in Context (COCO) dataset are not comparable to industrial use cases. To evaluate the applicability of transformer models in an industrial context, this paper applies a transformer-based object detection model for surface defect detection on Lithium-Ion Battery Electrodes LIBE and compares the results to a CNN-based object detection model. As a result, the transformer-based model outperforms the CNN model but is inferior in detection speed. In addition, the paper demonstrates the importance of a well-annotated dataset and shows the sensitivity of annotations for the model performance. Finally, this paper presents practical steps for an industrial application regarding backbone choice, inference speed, and metrics. •Deep-learning surface defect detection for lithium-ion batteries.•CNNs and transformers are both applicable to industrial object detection.•Computer vision as a key enabler for automatic optical inspection.
doi_str_mv 10.1016/j.est.2024.114378
format article
fullrecord <record><control><sourceid>elsevier_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1016_j_est_2024_114378</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S2352152X24039641</els_id><sourcerecordid>S2352152X24039641</sourcerecordid><originalsourceid>FETCH-LOGICAL-c222t-d18ebd7c4053751a31a664b6872bb3c14431a1a2bec3b37c74fbeb49c01168dc3</originalsourceid><addsrcrecordid>eNp9kM1KAzEUhbNQsNQ-gLu8wIy5SeanuKqlamGoGwV3IT93IENnUpJR6NubUteuDtzvnMu9h5AHYCUwqB-HEtNccsZlCSBF096QBRcVL6DiX3dkldLAWDZWAOt6QeKG2jCedPQpTDT0dI56Sn2II0aqJ0e3h0NhdEJHgxnQztThnMVn9xgcHhPNZpq-Y68tZthnmGimnS_2WZ71PGM8090xg5gT6Z7c9vqYcPWnS_L5svvYvhXd--t-u-kKyzmfCwctGtdYySrRVKAF6LqWpm4bboywIGWegOYGrTCisY3sDRq5tgygbp0VSwLXvTaGlCL26hT9qONZAVOXrtSgclfq0pW6dpUzT9dMfgx_PEaVrMfJovMx369c8P-kfwFclHTf</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes</title><source>ScienceDirect Freedom Collection</source><creator>Mattern, Alexander ; Gerdes, Henrik ; Grunert, Dennis ; Schmitt, Robert H.</creator><creatorcontrib>Mattern, Alexander ; Gerdes, Henrik ; Grunert, Dennis ; Schmitt, Robert H.</creatorcontrib><description>Deep learning-based defect detection approaches offer great potential for end-to-end surface defect detection. After the prevalent Convolutional Neural Network (CNN) models were state-of-the-art for almost a decade, transformer-based models recently surpassed the performance of CNN models on standard benchmark datasets. However, standard benchmarks such as the Common Objects in Context (COCO) dataset are not comparable to industrial use cases. To evaluate the applicability of transformer models in an industrial context, this paper applies a transformer-based object detection model for surface defect detection on Lithium-Ion Battery Electrodes LIBE and compares the results to a CNN-based object detection model. As a result, the transformer-based model outperforms the CNN model but is inferior in detection speed. In addition, the paper demonstrates the importance of a well-annotated dataset and shows the sensitivity of annotations for the model performance. Finally, this paper presents practical steps for an industrial application regarding backbone choice, inference speed, and metrics. •Deep-learning surface defect detection for lithium-ion batteries.•CNNs and transformers are both applicable to industrial object detection.•Computer vision as a key enabler for automatic optical inspection.</description><identifier>ISSN: 2352-152X</identifier><identifier>DOI: 10.1016/j.est.2024.114378</identifier><language>eng</language><publisher>Elsevier Ltd</publisher><subject>Convolutional neural network ; Electrode coating ; Object detection ; Surface defects ; Transformer</subject><ispartof>Journal of energy storage, 2025-01, Vol.105, p.114378, Article 114378</ispartof><rights>2024 The Authors</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c222t-d18ebd7c4053751a31a664b6872bb3c14431a1a2bec3b37c74fbeb49c01168dc3</cites><orcidid>0000-0001-8378-3722</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27924,27925</link.rule.ids></links><search><creatorcontrib>Mattern, Alexander</creatorcontrib><creatorcontrib>Gerdes, Henrik</creatorcontrib><creatorcontrib>Grunert, Dennis</creatorcontrib><creatorcontrib>Schmitt, Robert H.</creatorcontrib><title>A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes</title><title>Journal of energy storage</title><description>Deep learning-based defect detection approaches offer great potential for end-to-end surface defect detection. After the prevalent Convolutional Neural Network (CNN) models were state-of-the-art for almost a decade, transformer-based models recently surpassed the performance of CNN models on standard benchmark datasets. However, standard benchmarks such as the Common Objects in Context (COCO) dataset are not comparable to industrial use cases. To evaluate the applicability of transformer models in an industrial context, this paper applies a transformer-based object detection model for surface defect detection on Lithium-Ion Battery Electrodes LIBE and compares the results to a CNN-based object detection model. As a result, the transformer-based model outperforms the CNN model but is inferior in detection speed. In addition, the paper demonstrates the importance of a well-annotated dataset and shows the sensitivity of annotations for the model performance. Finally, this paper presents practical steps for an industrial application regarding backbone choice, inference speed, and metrics. •Deep-learning surface defect detection for lithium-ion batteries.•CNNs and transformers are both applicable to industrial object detection.•Computer vision as a key enabler for automatic optical inspection.</description><subject>Convolutional neural network</subject><subject>Electrode coating</subject><subject>Object detection</subject><subject>Surface defects</subject><subject>Transformer</subject><issn>2352-152X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2025</creationdate><recordtype>article</recordtype><recordid>eNp9kM1KAzEUhbNQsNQ-gLu8wIy5SeanuKqlamGoGwV3IT93IENnUpJR6NubUteuDtzvnMu9h5AHYCUwqB-HEtNccsZlCSBF096QBRcVL6DiX3dkldLAWDZWAOt6QeKG2jCedPQpTDT0dI56Sn2II0aqJ0e3h0NhdEJHgxnQztThnMVn9xgcHhPNZpq-Y68tZthnmGimnS_2WZ71PGM8090xg5gT6Z7c9vqYcPWnS_L5svvYvhXd--t-u-kKyzmfCwctGtdYySrRVKAF6LqWpm4bboywIGWegOYGrTCisY3sDRq5tgygbp0VSwLXvTaGlCL26hT9qONZAVOXrtSgclfq0pW6dpUzT9dMfgx_PEaVrMfJovMx369c8P-kfwFclHTf</recordid><startdate>20250101</startdate><enddate>20250101</enddate><creator>Mattern, Alexander</creator><creator>Gerdes, Henrik</creator><creator>Grunert, Dennis</creator><creator>Schmitt, Robert H.</creator><general>Elsevier Ltd</general><scope>6I.</scope><scope>AAFTH</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-8378-3722</orcidid></search><sort><creationdate>20250101</creationdate><title>A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes</title><author>Mattern, Alexander ; Gerdes, Henrik ; Grunert, Dennis ; Schmitt, Robert H.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c222t-d18ebd7c4053751a31a664b6872bb3c14431a1a2bec3b37c74fbeb49c01168dc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2025</creationdate><topic>Convolutional neural network</topic><topic>Electrode coating</topic><topic>Object detection</topic><topic>Surface defects</topic><topic>Transformer</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Mattern, Alexander</creatorcontrib><creatorcontrib>Gerdes, Henrik</creatorcontrib><creatorcontrib>Grunert, Dennis</creatorcontrib><creatorcontrib>Schmitt, Robert H.</creatorcontrib><collection>ScienceDirect Open Access Titles</collection><collection>Elsevier:ScienceDirect:Open Access</collection><collection>CrossRef</collection><jtitle>Journal of energy storage</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mattern, Alexander</au><au>Gerdes, Henrik</au><au>Grunert, Dennis</au><au>Schmitt, Robert H.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes</atitle><jtitle>Journal of energy storage</jtitle><date>2025-01-01</date><risdate>2025</risdate><volume>105</volume><spage>114378</spage><pages>114378-</pages><artnum>114378</artnum><issn>2352-152X</issn><abstract>Deep learning-based defect detection approaches offer great potential for end-to-end surface defect detection. After the prevalent Convolutional Neural Network (CNN) models were state-of-the-art for almost a decade, transformer-based models recently surpassed the performance of CNN models on standard benchmark datasets. However, standard benchmarks such as the Common Objects in Context (COCO) dataset are not comparable to industrial use cases. To evaluate the applicability of transformer models in an industrial context, this paper applies a transformer-based object detection model for surface defect detection on Lithium-Ion Battery Electrodes LIBE and compares the results to a CNN-based object detection model. As a result, the transformer-based model outperforms the CNN model but is inferior in detection speed. In addition, the paper demonstrates the importance of a well-annotated dataset and shows the sensitivity of annotations for the model performance. Finally, this paper presents practical steps for an industrial application regarding backbone choice, inference speed, and metrics. •Deep-learning surface defect detection for lithium-ion batteries.•CNNs and transformers are both applicable to industrial object detection.•Computer vision as a key enabler for automatic optical inspection.</abstract><pub>Elsevier Ltd</pub><doi>10.1016/j.est.2024.114378</doi><orcidid>https://orcid.org/0000-0001-8378-3722</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2352-152X
ispartof Journal of energy storage, 2025-01, Vol.105, p.114378, Article 114378
issn 2352-152X
language eng
recordid cdi_crossref_primary_10_1016_j_est_2024_114378
source ScienceDirect Freedom Collection
subjects Convolutional neural network
Electrode coating
Object detection
Surface defects
Transformer
title A comparison of transformer and CNN-based object detection models for surface defects on Li-Ion Battery Electrodes
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T12%3A11%3A20IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20comparison%20of%20transformer%20and%20CNN-based%20object%20detection%20models%20for%20surface%20defects%20on%20Li-Ion%20Battery%20Electrodes&rft.jtitle=Journal%20of%20energy%20storage&rft.au=Mattern,%20Alexander&rft.date=2025-01-01&rft.volume=105&rft.spage=114378&rft.pages=114378-&rft.artnum=114378&rft.issn=2352-152X&rft_id=info:doi/10.1016/j.est.2024.114378&rft_dat=%3Celsevier_cross%3ES2352152X24039641%3C/elsevier_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c222t-d18ebd7c4053751a31a664b6872bb3c14431a1a2bec3b37c74fbeb49c01168dc3%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true