Loading…
Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images
Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and...
Saved in:
Published in: | Electronics (Basel) 2019-03, Vol.8 (3), p.308 |
---|---|
Main Authors: | , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263 |
---|---|
cites | cdi_FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263 |
container_end_page | |
container_issue | 3 |
container_start_page | 308 |
container_title | Electronics (Basel) |
container_volume | 8 |
creator | Kwan, Chiman Chou, Bryan Bell III, James |
description | Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and blue) color of scenes on Mars. The Mastcam has two cameras: left and right. The right camera has three times better resolution than that of the left. It is well known that demosaicing introduces color and zipper artifacts. Here, we present a comparative study of demosaicing results using conventional and deep learning algorithms. Sixteen left and 15 right Mastcam images were used in our experiments. Due to a lack of ground truth images for Mastcam data from Mars, we compared the various algorithms using a blind image quality assessment model. It was observed that no one algorithm can work the best for all images. In particular, a deep learning-based algorithm worked the best for the right Mastcam images and a conventional algorithm achieved the best results for the left Mastcam images. Moreover, subjective evaluation of five demosaiced Mastcam images was also used to compare the various algorithms. |
doi_str_mv | 10.3390/electronics8030308 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2548418383</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2548418383</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263</originalsourceid><addsrcrecordid>eNplUE1LAzEUDKJg0f4BTwHPq_na3eRY1q9CxUvxurymLzVlN1mTreC_d0s9CM47zIMZhmEIueHsTkrD7rFDO6YYvM2ayen0GZkJVpvCCCPO__yXZJ7znk0wXGrJZuS9if0AyecYaHT0AXGgK4QUfNhRCFvaxPCFYfQxQDfJfczg7VFcdLuY_PjRZ-pioq-QRws9Xfaww3xNLhx0Gee_fEXWT4_r5qVYvT0vm8WqsJKbsVAbpbmRoEBwLdEJJTRUJZZVrSpbbqRWYFAwwRW60okanLW1rgRsOYhKXpHbU-yQ4ucB89ju4yFNTXMrSqXVFKrl5BInl00x54SuHZLvIX23nLXHBdv_C8ofduNmxQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2548418383</pqid></control><display><type>article</type><title>Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images</title><source>Publicly Available Content Database</source><creator>Kwan, Chiman ; Chou, Bryan ; Bell III, James</creator><creatorcontrib>Kwan, Chiman ; Chou, Bryan ; Bell III, James</creatorcontrib><description>Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and blue) color of scenes on Mars. The Mastcam has two cameras: left and right. The right camera has three times better resolution than that of the left. It is well known that demosaicing introduces color and zipper artifacts. Here, we present a comparative study of demosaicing results using conventional and deep learning algorithms. Sixteen left and 15 right Mastcam images were used in our experiments. Due to a lack of ground truth images for Mastcam data from Mars, we compared the various algorithms using a blind image quality assessment model. It was observed that no one algorithm can work the best for all images. In particular, a deep learning-based algorithm worked the best for the right Mastcam images and a conventional algorithm achieved the best results for the left Mastcam images. Moreover, subjective evaluation of five demosaiced Mastcam images was also used to compare the various algorithms.</description><identifier>ISSN: 2079-9292</identifier><identifier>EISSN: 2079-9292</identifier><identifier>DOI: 10.3390/electronics8030308</identifier><language>eng</language><publisher>Basel: MDPI AG</publisher><subject>Aeronautics ; Algorithms ; Business metrics ; Color ; Comparative studies ; Curiosity (Mars rover) ; Deep learning ; Digital cameras ; Digital imaging ; Image filters ; Image quality ; Machine learning ; Mars rovers ; Methods ; Neural networks ; Quality assessment</subject><ispartof>Electronics (Basel), 2019-03, Vol.8 (3), p.308</ispartof><rights>2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263</citedby><cites>FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263</cites><orcidid>0000-0002-4341-0769</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.proquest.com/docview/2548418383/fulltextPDF?pq-origsite=primo$$EPDF$$P50$$Gproquest$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2548418383?pq-origsite=primo$$EHTML$$P50$$Gproquest$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,25753,27924,27925,37012,44590,75126</link.rule.ids></links><search><creatorcontrib>Kwan, Chiman</creatorcontrib><creatorcontrib>Chou, Bryan</creatorcontrib><creatorcontrib>Bell III, James</creatorcontrib><title>Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images</title><title>Electronics (Basel)</title><description>Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and blue) color of scenes on Mars. The Mastcam has two cameras: left and right. The right camera has three times better resolution than that of the left. It is well known that demosaicing introduces color and zipper artifacts. Here, we present a comparative study of demosaicing results using conventional and deep learning algorithms. Sixteen left and 15 right Mastcam images were used in our experiments. Due to a lack of ground truth images for Mastcam data from Mars, we compared the various algorithms using a blind image quality assessment model. It was observed that no one algorithm can work the best for all images. In particular, a deep learning-based algorithm worked the best for the right Mastcam images and a conventional algorithm achieved the best results for the left Mastcam images. Moreover, subjective evaluation of five demosaiced Mastcam images was also used to compare the various algorithms.</description><subject>Aeronautics</subject><subject>Algorithms</subject><subject>Business metrics</subject><subject>Color</subject><subject>Comparative studies</subject><subject>Curiosity (Mars rover)</subject><subject>Deep learning</subject><subject>Digital cameras</subject><subject>Digital imaging</subject><subject>Image filters</subject><subject>Image quality</subject><subject>Machine learning</subject><subject>Mars rovers</subject><subject>Methods</subject><subject>Neural networks</subject><subject>Quality assessment</subject><issn>2079-9292</issn><issn>2079-9292</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>PIMPY</sourceid><recordid>eNplUE1LAzEUDKJg0f4BTwHPq_na3eRY1q9CxUvxurymLzVlN1mTreC_d0s9CM47zIMZhmEIueHsTkrD7rFDO6YYvM2ayen0GZkJVpvCCCPO__yXZJ7znk0wXGrJZuS9if0AyecYaHT0AXGgK4QUfNhRCFvaxPCFYfQxQDfJfczg7VFcdLuY_PjRZ-pioq-QRws9Xfaww3xNLhx0Gee_fEXWT4_r5qVYvT0vm8WqsJKbsVAbpbmRoEBwLdEJJTRUJZZVrSpbbqRWYFAwwRW60okanLW1rgRsOYhKXpHbU-yQ4ucB89ju4yFNTXMrSqXVFKrl5BInl00x54SuHZLvIX23nLXHBdv_C8ofduNmxQ</recordid><startdate>20190311</startdate><enddate>20190311</enddate><creator>Kwan, Chiman</creator><creator>Chou, Bryan</creator><creator>Bell III, James</creator><general>MDPI AG</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><orcidid>https://orcid.org/0000-0002-4341-0769</orcidid></search><sort><creationdate>20190311</creationdate><title>Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images</title><author>Kwan, Chiman ; Chou, Bryan ; Bell III, James</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Aeronautics</topic><topic>Algorithms</topic><topic>Business metrics</topic><topic>Color</topic><topic>Comparative studies</topic><topic>Curiosity (Mars rover)</topic><topic>Deep learning</topic><topic>Digital cameras</topic><topic>Digital imaging</topic><topic>Image filters</topic><topic>Image quality</topic><topic>Machine learning</topic><topic>Mars rovers</topic><topic>Methods</topic><topic>Neural networks</topic><topic>Quality assessment</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kwan, Chiman</creatorcontrib><creatorcontrib>Chou, Bryan</creatorcontrib><creatorcontrib>Bell III, James</creatorcontrib><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies & Aerospace Database (1962 - current)</collection><collection>ProQuest Central</collection><collection>AUTh Library subscriptions: ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>ProQuest advanced technologies & aerospace journals</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><jtitle>Electronics (Basel)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kwan, Chiman</au><au>Chou, Bryan</au><au>Bell III, James</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images</atitle><jtitle>Electronics (Basel)</jtitle><date>2019-03-11</date><risdate>2019</risdate><volume>8</volume><issue>3</issue><spage>308</spage><pages>308-</pages><issn>2079-9292</issn><eissn>2079-9292</eissn><abstract>Bayer pattern filters have been used in many commercial digital cameras. In National Aeronautics and Space Administration’s (NASA) mast camera (Mastcam) imaging system, onboard the Mars Science Laboratory (MSL) rover Curiosity, a Bayer pattern filter is being used to capture the RGB (red, green, and blue) color of scenes on Mars. The Mastcam has two cameras: left and right. The right camera has three times better resolution than that of the left. It is well known that demosaicing introduces color and zipper artifacts. Here, we present a comparative study of demosaicing results using conventional and deep learning algorithms. Sixteen left and 15 right Mastcam images were used in our experiments. Due to a lack of ground truth images for Mastcam data from Mars, we compared the various algorithms using a blind image quality assessment model. It was observed that no one algorithm can work the best for all images. In particular, a deep learning-based algorithm worked the best for the right Mastcam images and a conventional algorithm achieved the best results for the left Mastcam images. Moreover, subjective evaluation of five demosaiced Mastcam images was also used to compare the various algorithms.</abstract><cop>Basel</cop><pub>MDPI AG</pub><doi>10.3390/electronics8030308</doi><orcidid>https://orcid.org/0000-0002-4341-0769</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2079-9292 |
ispartof | Electronics (Basel), 2019-03, Vol.8 (3), p.308 |
issn | 2079-9292 2079-9292 |
language | eng |
recordid | cdi_proquest_journals_2548418383 |
source | Publicly Available Content Database |
subjects | Aeronautics Algorithms Business metrics Color Comparative studies Curiosity (Mars rover) Deep learning Digital cameras Digital imaging Image filters Image quality Machine learning Mars rovers Methods Neural networks Quality assessment |
title | Comparison of Deep Learning and Conventional Demosaicing Algorithms for Mastcam Images |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T11%3A50%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Comparison%20of%20Deep%20Learning%20and%20Conventional%20Demosaicing%20Algorithms%20for%20Mastcam%20Images&rft.jtitle=Electronics%20(Basel)&rft.au=Kwan,%20Chiman&rft.date=2019-03-11&rft.volume=8&rft.issue=3&rft.spage=308&rft.pages=308-&rft.issn=2079-9292&rft.eissn=2079-9292&rft_id=info:doi/10.3390/electronics8030308&rft_dat=%3Cproquest_cross%3E2548418383%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c319t-4b48193a4a2183ef2428a65e56746c5b384a9e20214ef5f27afcc7862ad1a263%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2548418383&rft_id=info:pmid/&rfr_iscdi=true |