Loading…

Median based robust correlation coefficient

Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been...

Full description

Saved in:
Bibliographic Details
Main Authors: Ahad, Nor Aishah, Abdullah, Suhaida, Zakaria, Nur Amira, Yahaya, Sharipah Soaad Syed, Yusof, Norhayati
Format: Conference Proceeding
Language:English
Subjects:
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites
container_end_page
container_issue 1
container_start_page
container_title
container_volume 1905
creator Ahad, Nor Aishah
Abdullah, Suhaida
Zakaria, Nur Amira
Yahaya, Sharipah Soaad Syed
Yusof, Norhayati
description Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.
doi_str_mv 10.1063/1.5012221
format conference_proceeding
fullrecord <record><control><sourceid>proquest_scita</sourceid><recordid>TN_cdi_proquest_journals_2116025381</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2116025381</sourcerecordid><originalsourceid>FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853</originalsourceid><addsrcrecordid>eNp9kE1LxDAYhIMoWFcP_oOCN6Vr3nw1PcriF6x4UfAW0uYNZFnbmqSC_97qLnjzNHN4mBmGkHOgS6CKX8NSUmCMwQEpQEqoagXqkBSUNqJigr8dk5OUNpSypq51Qa6e0AXbl61N6Mo4tFPKZTfEiFubw9DPHr0PXcA-n5Ijb7cJz_a6IK93ty-rh2r9fP-4ullXI5M8V8q3tVQWUEjLJAD3TlgqtPWIHqXtaq6tA9_weQVjmqFvHDJsOLYotOQLcrHLHePwMWHKZjNMsZ8rDQNQdG7RMFOXOyp1If9uNWMM7zZ-GaDm5wwDZn_Gf_DnEP9AMzrPvwEsd17Y</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype><pqid>2116025381</pqid></control><display><type>conference_proceeding</type><title>Median based robust correlation coefficient</title><source>American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list)</source><creator>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati</creator><contributor>Zulkepli, Jafri ; Nawawi, Mohd Kamal Mohd ; Aziz, Nazrina ; Rohni, Azizah Mohd ; Ibrahim, Haslinda</contributor><creatorcontrib>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati ; Zulkepli, Jafri ; Nawawi, Mohd Kamal Mohd ; Aziz, Nazrina ; Rohni, Azizah Mohd ; Ibrahim, Haslinda</creatorcontrib><description>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</description><identifier>ISSN: 0094-243X</identifier><identifier>EISSN: 1551-7616</identifier><identifier>DOI: 10.1063/1.5012221</identifier><identifier>CODEN: APCPCS</identifier><language>eng</language><publisher>Melville: American Institute of Physics</publisher><subject>Bivariate analysis ; Computer simulation ; Contamination ; Correlation analysis ; Correlation coefficients ; Median (statistics) ; Outliers (statistics) ; Robustness ; Standard error</subject><ispartof>AIP conference proceedings, 2017, Vol.1905 (1)</ispartof><rights>Author(s)</rights><rights>2017 Author(s). Published by AIP Publishing.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>309,310,314,780,784,789,790,23929,23930,25139,27923,27924</link.rule.ids></links><search><contributor>Zulkepli, Jafri</contributor><contributor>Nawawi, Mohd Kamal Mohd</contributor><contributor>Aziz, Nazrina</contributor><contributor>Rohni, Azizah Mohd</contributor><contributor>Ibrahim, Haslinda</contributor><creatorcontrib>Ahad, Nor Aishah</creatorcontrib><creatorcontrib>Abdullah, Suhaida</creatorcontrib><creatorcontrib>Zakaria, Nur Amira</creatorcontrib><creatorcontrib>Yahaya, Sharipah Soaad Syed</creatorcontrib><creatorcontrib>Yusof, Norhayati</creatorcontrib><title>Median based robust correlation coefficient</title><title>AIP conference proceedings</title><description>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</description><subject>Bivariate analysis</subject><subject>Computer simulation</subject><subject>Contamination</subject><subject>Correlation analysis</subject><subject>Correlation coefficients</subject><subject>Median (statistics)</subject><subject>Outliers (statistics)</subject><subject>Robustness</subject><subject>Standard error</subject><issn>0094-243X</issn><issn>1551-7616</issn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2017</creationdate><recordtype>conference_proceeding</recordtype><recordid>eNp9kE1LxDAYhIMoWFcP_oOCN6Vr3nw1PcriF6x4UfAW0uYNZFnbmqSC_97qLnjzNHN4mBmGkHOgS6CKX8NSUmCMwQEpQEqoagXqkBSUNqJigr8dk5OUNpSypq51Qa6e0AXbl61N6Mo4tFPKZTfEiFubw9DPHr0PXcA-n5Ijb7cJz_a6IK93ty-rh2r9fP-4ullXI5M8V8q3tVQWUEjLJAD3TlgqtPWIHqXtaq6tA9_weQVjmqFvHDJsOLYotOQLcrHLHePwMWHKZjNMsZ8rDQNQdG7RMFOXOyp1If9uNWMM7zZ-GaDm5wwDZn_Gf_DnEP9AMzrPvwEsd17Y</recordid><startdate>20171122</startdate><enddate>20171122</enddate><creator>Ahad, Nor Aishah</creator><creator>Abdullah, Suhaida</creator><creator>Zakaria, Nur Amira</creator><creator>Yahaya, Sharipah Soaad Syed</creator><creator>Yusof, Norhayati</creator><general>American Institute of Physics</general><scope>8FD</scope><scope>H8D</scope><scope>L7M</scope></search><sort><creationdate>20171122</creationdate><title>Median based robust correlation coefficient</title><author>Ahad, Nor Aishah ; Abdullah, Suhaida ; Zakaria, Nur Amira ; Yahaya, Sharipah Soaad Syed ; Yusof, Norhayati</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2017</creationdate><topic>Bivariate analysis</topic><topic>Computer simulation</topic><topic>Contamination</topic><topic>Correlation analysis</topic><topic>Correlation coefficients</topic><topic>Median (statistics)</topic><topic>Outliers (statistics)</topic><topic>Robustness</topic><topic>Standard error</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ahad, Nor Aishah</creatorcontrib><creatorcontrib>Abdullah, Suhaida</creatorcontrib><creatorcontrib>Zakaria, Nur Amira</creatorcontrib><creatorcontrib>Yahaya, Sharipah Soaad Syed</creatorcontrib><creatorcontrib>Yusof, Norhayati</creatorcontrib><collection>Technology Research Database</collection><collection>Aerospace Database</collection><collection>Advanced Technologies Database with Aerospace</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Ahad, Nor Aishah</au><au>Abdullah, Suhaida</au><au>Zakaria, Nur Amira</au><au>Yahaya, Sharipah Soaad Syed</au><au>Yusof, Norhayati</au><au>Zulkepli, Jafri</au><au>Nawawi, Mohd Kamal Mohd</au><au>Aziz, Nazrina</au><au>Rohni, Azizah Mohd</au><au>Ibrahim, Haslinda</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Median based robust correlation coefficient</atitle><btitle>AIP conference proceedings</btitle><date>2017-11-22</date><risdate>2017</risdate><volume>1905</volume><issue>1</issue><issn>0094-243X</issn><eissn>1551-7616</eissn><coden>APCPCS</coden><abstract>Real datasets usually include a fraction of outliers and other contaminations. The classical correlation coefficient is much affected by these outliers and often gives misleading results. The problem of computing the correlation estimate from bivariate data containing a portion of outliers has been deliberated in this study. The classical correlation uses non-robust mean and standard deviation as the location and scale estimator respectively. In this study, two robust correlation coefficients based on high breakdown point median estimator were examined. The performance of the classical correlation together with the robust correlation coefficient was measured and compared in terms of the correlation value, average bias and standard error for the clean and contaminated data. Simulation studies reveal that all correlation coefficients perform well for clean data. However, under contaminated data, the findings show that median based robust correlation coefficient gives better results as compared to the classical correlation coefficient.</abstract><cop>Melville</cop><pub>American Institute of Physics</pub><doi>10.1063/1.5012221</doi><tpages>5</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0094-243X
ispartof AIP conference proceedings, 2017, Vol.1905 (1)
issn 0094-243X
1551-7616
language eng
recordid cdi_proquest_journals_2116025381
source American Institute of Physics:Jisc Collections:Transitional Journals Agreement 2021-23 (Reading list)
subjects Bivariate analysis
Computer simulation
Contamination
Correlation analysis
Correlation coefficients
Median (statistics)
Outliers (statistics)
Robustness
Standard error
title Median based robust correlation coefficient
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-11T02%3A01%3A02IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_scita&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Median%20based%20robust%20correlation%20coefficient&rft.btitle=AIP%20conference%20proceedings&rft.au=Ahad,%20Nor%20Aishah&rft.date=2017-11-22&rft.volume=1905&rft.issue=1&rft.issn=0094-243X&rft.eissn=1551-7616&rft.coden=APCPCS&rft_id=info:doi/10.1063/1.5012221&rft_dat=%3Cproquest_scita%3E2116025381%3C/proquest_scita%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-p253t-6fb756a1e45a25113fd4a048afeefe5ac738ad1f930022282ef9de2e93ebe4853%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2116025381&rft_id=info:pmid/&rfr_iscdi=true