Loading…
Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data
Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still...
Saved in:
Published in: | Space Weather 2022-10, Vol.20 (10), p.n/a |
---|---|
Main Authors: | , , , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | cdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53 |
container_end_page | n/a |
container_issue | 10 |
container_start_page | |
container_title | Space Weather |
container_volume | 20 |
creator | Rüdisser, H. T. Windisch, A. Amerstorfer, U. V. Möstl, C. Amerstorfer, T. Bailey, R. L. Reiss, M. A. |
description | Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions.
Plain Language Summary
Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the f |
doi_str_mv | 10.1029/2022SW003149 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2728486223</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2728486223</sourcerecordid><originalsourceid>FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</originalsourceid><addsrcrecordid>eNp90MFOwzAMANAIgcQY3PiASFwpJE7apsdpGzBpiENBPVZZ6kqZumYkqdD-nqJy4MTJlvVs2SbklrMHzqB4BAZQVowJLoszMuOphCQXBTv_k1-SqxD2jIFMQc5ItRiiO-hoDV1hRBOt66lr6aaP6I-d7jFqf6JL512vO_qqQ6Dr_eQCtT0tXac9rWzfjD20tHGgKx31NblodRfw5jfOycfT-n35kmzfnjfLxTYxIlN5wmWTAWeYKWyFQbPLuREFmqxJG9QKGin5TmCWSqWbdCwg5KigNa1RutCpmJO7ae7Ru88BQ6z3bvDjqqGGHJRUGYAY1f2kjHcheGzro7eH8bCas_rndfXf140cJv5lOzz9a-uyWgMXRS6-AVvTb3E</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2728486223</pqid></control><display><type>article</type><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><source>Wiley Open Access</source><source>Alma/SFX Local Collection</source><creator>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</creator><creatorcontrib>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</creatorcontrib><description>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions.
Plain Language Summary
Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future.
Key Points
We automatically detect interplanetary coronal mass ejections in solar wind in situ data
We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind
We propose a pipeline generally applicable to time series event detection problems</description><identifier>ISSN: 1542-7390</identifier><identifier>ISSN: 1539-4964</identifier><identifier>EISSN: 1542-7390</identifier><identifier>DOI: 10.1029/2022SW003149</identifier><language>eng</language><publisher>Washington: John Wiley & Sons, Inc</publisher><subject>Algorithms ; Coronal mass ejection ; Corotating Interaction Regions (CIR) ; Datasets ; Image segmentation ; Machine learning ; Medical imaging ; Solar corona ; Solar wind ; Space weather ; Spacecraft ; Time series ; Training ; Weather forecasting ; Wind data ; Wind spacecraft</subject><ispartof>Space Weather, 2022-10, Vol.20 (10), p.n/a</ispartof><rights>2022. The Authors.</rights><rights>2022. This article is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</cites><orcidid>0000-0001-9024-6706 ; 0000-0002-2559-2669 ; 0000-0003-1516-5441 ; 0000-0003-2021-6557</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://onlinelibrary.wiley.com/doi/pdf/10.1029%2F2022SW003149$$EPDF$$P50$$Gwiley$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://onlinelibrary.wiley.com/doi/full/10.1029%2F2022SW003149$$EHTML$$P50$$Gwiley$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,11562,27924,27925,46052,46476</link.rule.ids></links><search><creatorcontrib>Rüdisser, H. T.</creatorcontrib><creatorcontrib>Windisch, A.</creatorcontrib><creatorcontrib>Amerstorfer, U. V.</creatorcontrib><creatorcontrib>Möstl, C.</creatorcontrib><creatorcontrib>Amerstorfer, T.</creatorcontrib><creatorcontrib>Bailey, R. L.</creatorcontrib><creatorcontrib>Reiss, M. A.</creatorcontrib><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><title>Space Weather</title><description>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions.
Plain Language Summary
Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future.
Key Points
We automatically detect interplanetary coronal mass ejections in solar wind in situ data
We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind
We propose a pipeline generally applicable to time series event detection problems</description><subject>Algorithms</subject><subject>Coronal mass ejection</subject><subject>Corotating Interaction Regions (CIR)</subject><subject>Datasets</subject><subject>Image segmentation</subject><subject>Machine learning</subject><subject>Medical imaging</subject><subject>Solar corona</subject><subject>Solar wind</subject><subject>Space weather</subject><subject>Spacecraft</subject><subject>Time series</subject><subject>Training</subject><subject>Weather forecasting</subject><subject>Wind data</subject><subject>Wind spacecraft</subject><issn>1542-7390</issn><issn>1539-4964</issn><issn>1542-7390</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>24P</sourceid><recordid>eNp90MFOwzAMANAIgcQY3PiASFwpJE7apsdpGzBpiENBPVZZ6kqZumYkqdD-nqJy4MTJlvVs2SbklrMHzqB4BAZQVowJLoszMuOphCQXBTv_k1-SqxD2jIFMQc5ItRiiO-hoDV1hRBOt66lr6aaP6I-d7jFqf6JL512vO_qqQ6Dr_eQCtT0tXac9rWzfjD20tHGgKx31NblodRfw5jfOycfT-n35kmzfnjfLxTYxIlN5wmWTAWeYKWyFQbPLuREFmqxJG9QKGin5TmCWSqWbdCwg5KigNa1RutCpmJO7ae7Ru88BQ6z3bvDjqqGGHJRUGYAY1f2kjHcheGzro7eH8bCas_rndfXf140cJv5lOzz9a-uyWgMXRS6-AVvTb3E</recordid><startdate>202210</startdate><enddate>202210</enddate><creator>Rüdisser, H. T.</creator><creator>Windisch, A.</creator><creator>Amerstorfer, U. V.</creator><creator>Möstl, C.</creator><creator>Amerstorfer, T.</creator><creator>Bailey, R. L.</creator><creator>Reiss, M. A.</creator><general>John Wiley & Sons, Inc</general><scope>24P</scope><scope>WIN</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7TG</scope><scope>8FD</scope><scope>H8D</scope><scope>KL.</scope><scope>L7M</scope><orcidid>https://orcid.org/0000-0001-9024-6706</orcidid><orcidid>https://orcid.org/0000-0002-2559-2669</orcidid><orcidid>https://orcid.org/0000-0003-1516-5441</orcidid><orcidid>https://orcid.org/0000-0003-2021-6557</orcidid></search><sort><creationdate>202210</creationdate><title>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</title><author>Rüdisser, H. T. ; Windisch, A. ; Amerstorfer, U. V. ; Möstl, C. ; Amerstorfer, T. ; Bailey, R. L. ; Reiss, M. A.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Algorithms</topic><topic>Coronal mass ejection</topic><topic>Corotating Interaction Regions (CIR)</topic><topic>Datasets</topic><topic>Image segmentation</topic><topic>Machine learning</topic><topic>Medical imaging</topic><topic>Solar corona</topic><topic>Solar wind</topic><topic>Space weather</topic><topic>Spacecraft</topic><topic>Time series</topic><topic>Training</topic><topic>Weather forecasting</topic><topic>Wind data</topic><topic>Wind spacecraft</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rüdisser, H. T.</creatorcontrib><creatorcontrib>Windisch, A.</creatorcontrib><creatorcontrib>Amerstorfer, U. V.</creatorcontrib><creatorcontrib>Möstl, C.</creatorcontrib><creatorcontrib>Amerstorfer, T.</creatorcontrib><creatorcontrib>Bailey, R. L.</creatorcontrib><creatorcontrib>Reiss, M. A.</creatorcontrib><collection>Wiley Open Access</collection><collection>Wiley Online Library Free Content</collection><collection>CrossRef</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Technology Research Database</collection><collection>Aerospace Database</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Space Weather</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rüdisser, H. T.</au><au>Windisch, A.</au><au>Amerstorfer, U. V.</au><au>Möstl, C.</au><au>Amerstorfer, T.</au><au>Bailey, R. L.</au><au>Reiss, M. A.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data</atitle><jtitle>Space Weather</jtitle><date>2022-10</date><risdate>2022</risdate><volume>20</volume><issue>10</issue><epage>n/a</epage><issn>1542-7390</issn><issn>1539-4964</issn><eissn>1542-7390</eissn><abstract>Interplanetary coronal mass ejections (ICMEs) are one of the main drivers for space weather disturbances. In the past, different approaches have been used to automatically detect events in existing time series resulting from solar wind in situ observations. However, accurate and fast detection still remains a challenge when facing the large amount of data from different instruments. For the automatic detection of ICMEs we propose a pipeline using a method that has recently proven successful in medical image segmentation. Comparing it to an existing method, we find that while achieving similar results, our model outperforms the baseline regarding training time by a factor of approximately 20, thus making it more applicable for other datasets. The method has been tested on in situ data from the Wind spacecraft between 1997 and 2015 with a True Skill Statistic of 0.64. Out of the 640 ICMEs, 466 were detected correctly by our algorithm, producing a total of 254 false positives. Additionally, it produced reasonable results on datasets with fewer features and smaller training sets from Wind, STEREO‐A, and STEREO‐B with TSSs of 0.56, 0.57, and 0.53, respectively. Our pipeline manages to find the start of an ICME with a mean absolute error (MAE) of around 2 hr and 56 min, and the end time with a MAE of 3 hr and 20 min. The relatively fast training allows straightforward tuning of hyperparameters and could therefore easily be used to detect other structures and phenomena in solar wind data, such as corotating interaction regions.
Plain Language Summary
Interplanetary coronal mass ejections (ICMEs) are part of space weather and can have severe effects on human technology. Since the detection of these events is often difficult, experts are usually needed to detect them in time series from different spacecraft. Even though, there have been attempts to solve this problem using machine learning, it is far from being solved. We propose a machine learning model, that manages to find the start and end times with improved accuracy and takes less time to train. Even though our results are quite promising, it is important to notice that there are many different catalogs documenting ICMEs, that do not always agree. Therefore, there is no unique solution to this problem, which makes it difficult for a machine learning method to learn the features of an ICME. Nevertheless, our model can be expected to make a substantial contribution to the area of space weather forecast in the future.
Key Points
We automatically detect interplanetary coronal mass ejections in solar wind in situ data
We achieve a True Skill Statistic of 0.64, Recall of 0.67 and Precision of 0.70 on data from Wind
We propose a pipeline generally applicable to time series event detection problems</abstract><cop>Washington</cop><pub>John Wiley & Sons, Inc</pub><doi>10.1029/2022SW003149</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0001-9024-6706</orcidid><orcidid>https://orcid.org/0000-0002-2559-2669</orcidid><orcidid>https://orcid.org/0000-0003-1516-5441</orcidid><orcidid>https://orcid.org/0000-0003-2021-6557</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1542-7390 |
ispartof | Space Weather, 2022-10, Vol.20 (10), p.n/a |
issn | 1542-7390 1539-4964 1542-7390 |
language | eng |
recordid | cdi_proquest_journals_2728486223 |
source | Wiley Open Access; Alma/SFX Local Collection |
subjects | Algorithms Coronal mass ejection Corotating Interaction Regions (CIR) Datasets Image segmentation Machine learning Medical imaging Solar corona Solar wind Space weather Spacecraft Time series Training Weather forecasting Wind data Wind spacecraft |
title | Automatic Detection of Interplanetary Coronal Mass Ejections in Solar Wind In Situ Data |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T00%3A10%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Automatic%20Detection%20of%20Interplanetary%20Coronal%20Mass%20Ejections%20in%20Solar%20Wind%20In%20Situ%20Data&rft.jtitle=Space%20Weather&rft.au=R%C3%BCdisser,%20H.%20T.&rft.date=2022-10&rft.volume=20&rft.issue=10&rft.epage=n/a&rft.issn=1542-7390&rft.eissn=1542-7390&rft_id=info:doi/10.1029/2022SW003149&rft_dat=%3Cproquest_cross%3E2728486223%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c3687-14d6210e68ef3cecb71c39ec6d5dea82d441b3e6548ad5a82e27e82fcfc8a9a53%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2728486223&rft_id=info:pmid/&rfr_iscdi=true |