Loading…
Median based robust correlation coefficient
Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been...
Saved in:
Main Authors: | , , , , |
---|---|
Format: | Conference Proceeding |
Language: | English |
Subjects: | |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | |
---|---|
cites | |
container_end_page | |
container_issue | 1 |
container_start_page | |
container_title | |
container_volume | 1905 |
creator | Ahad, Nor Aishah Abdullah, Suhaida Zakaria, Nur Amira Yahaya, Sharipah Soaad Syed Yusof, Norhayati |
description | Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient. |
doi_str_mv | 10.1063/1.5012221 |
format | conference_proceeding |
fullrecord | <record><control><sourceid>proquest_scita</sourceid><recordid>TN_cdi_proquest_journals_2116025381</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2116025381</sourcerecordid><originalsourceid>FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853</originalsourceid><addsrcrecordid>eNp9kE1LxDAYhIMoWFcP_oOCN6Vr3nw1PcriF6x4UfAW0uYNZFnbmqSC_97qLnjzNHN4mBmGkHOgS6CKX8NSUmCMwQEpQEqoagXqkBSUNqJigr8dk5OUNpSypq51Qa6e0AXbl61N6Mo4tFPKZTfEiFubw9DPHr0PXcA-n5Ijb7cJz_a6IK93ty-rh2r9fP-4ullXI5M8V8q3tVQWUEjLJAD3TlgqtPWIHqXtaq6tA9_weQVjmqFvHDJsOLYotOQLcrHLHePwMWHKZjNMsZ8rDQNQdG7RMFOXOyp1If9uNWMM7zZ-GaDm5wwDZn_Gf_DnEP9AMzrPvwEsd17Y</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype><pqid>2116025381</pqid></control><display><type>conference_proceeding</type><title>Median based robust correlation coefficient</title><source>American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list)</source><creator>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati</creator><contributor>Zulkepli, Jafri ; Nawawi, Mohd Kamal Mohd ; Aziz, Nazrina ; Rohni, Azizah Mohd ; Ibrahim, Haslinda</contributor><creatorcontrib>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati ; Zulkepli, Jafri ; Nawawi, Mohd Kamal Mohd ; Aziz, Nazrina ; Rohni, Azizah Mohd ; Ibrahim, Haslinda</creatorcontrib><description>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</description><identifier>ISSN: 0094-243X</identifier><identifier>EISSN: 1551-7616</identifier><identifier>DOI: 10.1063/1.5012221</identifier><identifier>CODEN: APCPCS</identifier><language>eng</language><publisher>Melville: American Institute of Physics</publisher><subject>Bivariate analysis ; Computer simulation ; Contamination ; Correlation analysis ; Correlation coefficients ; Median (statistics) ; Outliers (statistics) ; Robustness ; Standard error</subject><ispartof>AIP conference proceedings, 2017, Vol.1905 (1)</ispartof><rights>Author(s)</rights><rights>2017 Author(s). Published by AIP Publishing.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>309,310,314,780,784,789,790,23929,23930,25139,27923,27924</link.rule.ids></links><search><contributor>Zulkepli, Jafri</contributor><contributor>Nawawi, Mohd Kamal Mohd</contributor><contributor>Aziz, Nazrina</contributor><contributor>Rohni, Azizah Mohd</contributor><contributor>Ibrahim, Haslinda</contributor><creatorcontrib>Ahad, Nor Aishah</creatorcontrib><creatorcontrib>Abdullah, Suhaida</creatorcontrib><creatorcontrib>Zakaria, Nur Amira</creatorcontrib><creatorcontrib>Yahaya, Sharipah Soaad Syed</creatorcontrib><creatorcontrib>Yusof, Norhayati</creatorcontrib><title>Median based robust correlation coefficient</title><title>AIP conference proceedings</title><description>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</description><subject>Bivariate analysis</subject><subject>Computer simulation</subject><subject>Contamination</subject><subject>Correlation analysis</subject><subject>Correlation coefficients</subject><subject>Median (statistics)</subject><subject>Outliers (statistics)</subject><subject>Robustness</subject><subject>Standard error</subject><issn>0094-243X</issn><issn>1551-7616</issn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2017</creationdate><recordtype>conference_proceeding</recordtype><recordid>eNp9kE1LxDAYhIMoWFcP_oOCN6Vr3nw1PcriF6x4UfAW0uYNZFnbmqSC_97qLnjzNHN4mBmGkHOgS6CKX8NSUmCMwQEpQEqoagXqkBSUNqJigr8dk5OUNpSypq51Qa6e0AXbl61N6Mo4tFPKZTfEiFubw9DPHr0PXcA-n5Ijb7cJz_a6IK93ty-rh2r9fP-4ullXI5M8V8q3tVQWUEjLJAD3TlgqtPWIHqXtaq6tA9_weQVjmqFvHDJsOLYotOQLcrHLHePwMWHKZjNMsZ8rDQNQdG7RMFOXOyp1If9uNWMM7zZ-GaDm5wwDZn_Gf_DnEP9AMzrPvwEsd17Y</recordid><startdate>20171122</startdate><enddate>20171122</enddate><creator>Ahad, Nor Aishah</creator><creator>Abdullah, Suhaida</creator><creator>Zakaria, Nur Amira</creator><creator>Yahaya, Sharipah Soaad Syed</creator><creator>Yusof, Norhayati</creator><general>American Institute of Physics</general><scope>8FD</scope><scope>H8D</scope><scope>L7M</scope></search><sort><creationdate>20171122</creationdate><title>Median based robust correlation coefficient</title><author>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Bivariate analysis</topic><topic>Computer simulation</topic><topic>Contamination</topic><topic>Correlation analysis</topic><topic>Correlation coefficients</topic><topic>Median (statistics)</topic><topic>Outliers (statistics)</topic><topic>Robustness</topic><topic>Standard error</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ahad, Nor Aishah</creatorcontrib><creatorcontrib>Abdullah, Suhaida</creatorcontrib><creatorcontrib>Zakaria, Nur Amira</creatorcontrib><creatorcontrib>Yahaya, Sharipah Soaad Syed</creatorcontrib><creatorcontrib>Yusof, Norhayati</creatorcontrib><collection>Technology Research Database</collection><collection>Aerospace Database</collection><collection>Advanced Technologies Database with Aerospace</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ahad, Nor Aishah</au><au>Abdullah, Suhaida</au><au>Zakaria, Nur Amira</au><au>Yahaya, Sharipah Soaad Syed</au><au>Yusof, Norhayati</au><au>Zulkepli, Jafri</au><au>Nawawi, Mohd Kamal Mohd</au><au>Aziz, Nazrina</au><au>Rohni, Azizah Mohd</au><au>Ibrahim, Haslinda</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Median based robust correlation coefficient</atitle><btitle>AIP conference proceedings</btitle><date>2017-11-22</date><risdate>2017</risdate><volume>1905</volume><issue>1</issue><issn>0094-243X</issn><eissn>1551-7616</eissn><coden>APCPCS</coden><abstract>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</abstract><cop>Melville</cop><pub>American Institute of Physics</pub><doi>10.1063/1.5012221</doi><tpages>5</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0094-243X |
ispartof | AIP conference proceedings, 2017, Vol.1905 (1) |
issn | 0094-243X 1551-7616 |
language | eng |
recordid | cdi_proquest_journals_2116025381 |
source | American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list) |
subjects | Bivariate analysis Computer simulation Contamination Correlation analysis Correlation coefficients Median (statistics) Outliers (statistics) Robustness Standard error |
title | Median based robust correlation coefficient |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-11T02%3A01%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_scita&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Median%20based%20robust%20correlation%20coefficient&rft.btitle=AIP%20conference%20proceedings&rft.au=Ahad,%20Nor%20Aishah&rft.date=2017-11-22&rft.volume=1905&rft.issue=1&rft.issn=0094-243X&rft.eissn=1551-7616&rft.coden=APCPCS&rft_id=info:doi/10.1063/1.5012221&rft_dat=%3Cproquest_scita%3E2116025381%3C/proquest_scita%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2116025381&rft_id=info:pmid/&rfr_iscdi=true |