Loading…

Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data

Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still...

Full description

Saved in:
Bibliographic Details
Published in:Space Weather 2022-10, Vol.20 (10), p.n/a
Main Authors: Rüdisser, H. T., Windisch, A., Amerstorfer, U. V., Möstl, C., Amerstorfer, T., Bailey, R. L., Reiss, M. A.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53
container_end_page n/a
container_issue 10
container_start_page
container_title Space Weather
container_volume 20
creator Rüdisser, H. T.
Windisch, A.
Amerstorfer, U. V.
Möstl, C.
Amerstorfer, T.
Bailey, R. L.
Reiss, M. A.
description Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions. Plain Language Summary Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the f
doi_str_mv 10.1029/2022SW003149
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2728486223</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2728486223</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</originalsourceid><addsrcrecordid>eNp90MFOwzAMANAIgcQY3PiASFwpJE7apsdpGzBpiENBPVZZ6kqZumYkqdD-nqJy4MTJlvVs2SbklrMHzqB4BAZQVowJLoszMuOphCQXBTv_k1-SqxD2jIFMQc5ItRiiO-hoDV1hRBOt66lr6aaP6I-d7jFqf6JL512vO_qqQ6Dr_eQCtT0tXac9rWzfjD20tHGgKx31NblodRfw5jfOycfT-n35kmzfnjfLxTYxIlN5wmWTAWeYKWyFQbPLuREFmqxJG9QKGin5TmCWSqWbdCwg5KigNa1RutCpmJO7ae7Ru88BQ6z3bvDjqqGGHJRUGYAY1f2kjHcheGzro7eH8bCas_rndfXf140cJv5lOzz9a-uyWgMXRS6-AVvTb3E</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2728486223</pqid></control><display><type>article</type><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><source>Wiley Open Access</source><source>Alma/SFX Local Collection</source><creator>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</creator><creatorcontrib>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</creatorcontrib><description>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions. Plain Language Summary Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future. Key Points We automatically detect interplanetary coronal mass ejections in solar wind in situ data We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind We propose a pipeline generally applicable to time series event detection problems</description><identifier>ISSN: 1542-7390</identifier><identifier>ISSN: 1539-4964</identifier><identifier>EISSN: 1542-7390</identifier><identifier>DOI: 10.1029/2022SW003149</identifier><language>eng</language><publisher>Washington: John Wiley &amp; Sons, Inc</publisher><subject>Algorithms ; Coronal mass ejection ; Corotating Interaction Regions (CIR) ; Datasets ; Image segmentation ; Machine learning ; Medical imaging ; Solar corona ; Solar wind ; Space weather ; Spacecraft ; Time series ; Training ; Weather forecasting ; Wind data ; Wind spacecraft</subject><ispartof>Space Weather, 2022-10, Vol.20 (10), p.n/a</ispartof><rights>2022. The Authors.</rights><rights>2022. This article is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</cites><orcidid>0000-0001-9024-6706 ; 0000-0002-2559-2669 ; 0000-0003-1516-5441 ; 0000-0003-2021-6557</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1029%2F2022SW003149$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1029%2F2022SW003149$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,11562,27924,27925,46052,46476</link.rule.ids></links><search><creatorcontrib>Rüdisser, H. T.</creatorcontrib><creatorcontrib>Windisch, A.</creatorcontrib><creatorcontrib>Amerstorfer, U. V.</creatorcontrib><creatorcontrib>Möstl, C.</creatorcontrib><creatorcontrib>Amerstorfer, T.</creatorcontrib><creatorcontrib>Bailey, R. L.</creatorcontrib><creatorcontrib>Reiss, M. A.</creatorcontrib><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><title>Space Weather</title><description>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions. Plain Language Summary Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future. Key Points We automatically detect interplanetary coronal mass ejections in solar wind in situ data We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind We propose a pipeline generally applicable to time series event detection problems</description><subject>Algorithms</subject><subject>Coronal mass ejection</subject><subject>Corotating Interaction Regions (CIR)</subject><subject>Datasets</subject><subject>Image segmentation</subject><subject>Machine learning</subject><subject>Medical imaging</subject><subject>Solar corona</subject><subject>Solar wind</subject><subject>Space weather</subject><subject>Spacecraft</subject><subject>Time series</subject><subject>Training</subject><subject>Weather forecasting</subject><subject>Wind data</subject><subject>Wind spacecraft</subject><issn>1542-7390</issn><issn>1539-4964</issn><issn>1542-7390</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><recordid>eNp90MFOwzAMANAIgcQY3PiASFwpJE7apsdpGzBpiENBPVZZ6kqZumYkqdD-nqJy4MTJlvVs2SbklrMHzqB4BAZQVowJLoszMuOphCQXBTv_k1-SqxD2jIFMQc5ItRiiO-hoDV1hRBOt66lr6aaP6I-d7jFqf6JL512vO_qqQ6Dr_eQCtT0tXac9rWzfjD20tHGgKx31NblodRfw5jfOycfT-n35kmzfnjfLxTYxIlN5wmWTAWeYKWyFQbPLuREFmqxJG9QKGin5TmCWSqWbdCwg5KigNa1RutCpmJO7ae7Ru88BQ6z3bvDjqqGGHJRUGYAY1f2kjHcheGzro7eH8bCas_rndfXf140cJv5lOzz9a-uyWgMXRS6-AVvTb3E</recordid><startdate>202210</startdate><enddate>202210</enddate><creator>Rüdisser, H. T.</creator><creator>Windisch, A.</creator><creator>Amerstorfer, U. V.</creator><creator>Möstl, C.</creator><creator>Amerstorfer, T.</creator><creator>Bailey, R. L.</creator><creator>Reiss, M. A.</creator><general>John Wiley &amp; Sons, Inc</general><scope>24P</scope><scope>WIN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7TG</scope><scope>8FD</scope><scope>H8D</scope><scope>KL.</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0001-9024-6706</orcidid><orcidid>https://orcid.org/0000-0002-2559-2669</orcidid><orcidid>https://orcid.org/0000-0003-1516-5441</orcidid><orcidid>https://orcid.org/0000-0003-2021-6557</orcidid></search><sort><creationdate>202210</creationdate><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><author>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Coronal mass ejection</topic><topic>Corotating Interaction Regions (CIR)</topic><topic>Datasets</topic><topic>Image segmentation</topic><topic>Machine learning</topic><topic>Medical imaging</topic><topic>Solar corona</topic><topic>Solar wind</topic><topic>Space weather</topic><topic>Spacecraft</topic><topic>Time series</topic><topic>Training</topic><topic>Weather forecasting</topic><topic>Wind data</topic><topic>Wind spacecraft</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rüdisser, H. T.</creatorcontrib><creatorcontrib>Windisch, A.</creatorcontrib><creatorcontrib>Amerstorfer, U. V.</creatorcontrib><creatorcontrib>Möstl, C.</creatorcontrib><creatorcontrib>Amerstorfer, T.</creatorcontrib><creatorcontrib>Bailey, R. L.</creatorcontrib><creatorcontrib>Reiss, M. A.</creatorcontrib><collection>Wiley Open Access</collection><collection>Wiley Online Library Free Content</collection><collection>CrossRef</collection><collection>Meteorological &amp; Geoastrophysical Abstracts</collection><collection>Technology Research Database</collection><collection>Aerospace Database</collection><collection>Meteorological &amp; Geoastrophysical Abstracts - Academic</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Space Weather</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rüdisser, H. T.</au><au>Windisch, A.</au><au>Amerstorfer, U. V.</au><au>Möstl, C.</au><au>Amerstorfer, T.</au><au>Bailey, R. L.</au><au>Reiss, M. A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</atitle><jtitle>Space Weather</jtitle><date>2022-10</date><risdate>2022</risdate><volume>20</volume><issue>10</issue><epage>n/a</epage><issn>1542-7390</issn><issn>1539-4964</issn><eissn>1542-7390</eissn><abstract>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions. Plain Language Summary Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future. Key Points We automatically detect interplanetary coronal mass ejections in solar wind in situ data We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind We propose a pipeline generally applicable to time series event detection problems</abstract><cop>Washington</cop><pub>John Wiley &amp; Sons, Inc</pub><doi>10.1029/2022SW003149</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0001-9024-6706</orcidid><orcidid>https://orcid.org/0000-0002-2559-2669</orcidid><orcidid>https://orcid.org/0000-0003-1516-5441</orcidid><orcidid>https://orcid.org/0000-0003-2021-6557</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1542-7390
ispartof Space Weather, 2022-10, Vol.20 (10), p.n/a
issn 1542-7390
1539-4964
1542-7390
language eng
recordid cdi_proquest_journals_2728486223
source Wiley Open Access; Alma/SFX Local Collection
subjects Algorithms
Coronal mass ejection
Corotating Interaction Regions (CIR)
Datasets
Image segmentation
Machine learning
Medical imaging
Solar corona
Solar wind
Space weather
Spacecraft
Time series
Training
Weather forecasting
Wind data
Wind spacecraft
title Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T00%3A10%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20Detection%20of%20Interplanetary%20Coronal%20Mass%20Ejections%20in%20Solar%20Wind%20In%20Situ%20Data&rft.jtitle=Space%20Weather&rft.au=R%C3%BCdisser,%20H.%20T.&rft.date=2022-10&rft.volume=20&rft.issue=10&rft.epage=n/a&rft.issn=1542-7390&rft.eissn=1542-7390&rft_id=info:doi/10.1029/2022SW003149&rft_dat=%3Cproquest_cross%3E2728486223%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2728486223&rft_id=info:pmid/&rfr_iscdi=true