Loading…

Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines

AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an...

Full description

Saved in:
Bibliographic Details
Published in:Journal of construction engineering and management 2019-10, Vol.145 (10)
Main Authors: El-adaway, Islam H, Ali, Gasser, Assaad, Rayan, Elsayegh, Amr, Abotaleb, Ibrahim S
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743
cites cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743
container_end_page
container_issue 10
container_start_page
container_title Journal of construction engineering and management
container_volume 145
creator El-adaway, Islam H
Ali, Gasser
Assaad, Rayan
Elsayegh, Amr
Abotaleb, Ibrahim S
description AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality
doi_str_mv 10.1061/(ASCE)CO.1943-7862.0001705
format article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2268993210</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2268993210</sourcerecordid><originalsourceid>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</originalsourceid><addsrcrecordid>eNp1kctOwzAURC0EEqXwDxZsYJFi5-HE7KrQAlJRF4W1dXGc1ih1iu206ufwp7iU14aFZWnunFnMIHROyYASRq8vh7NydFVOB5SnSZQXLB4QQmhOsgPU-9EOUY_kSRLxhKXH6MS51-BJGc966H1ooNl6LfF0rexaqw1ua1xqD163Bj8qb7V0WBvsFyroa93gkZlro5TVZo5v2yWE40b7BR63snM4UGVrnLed_Iz46wZT4UcwMFdLZTyerZTU0PgtHloFn9cH7_Cse6m0k3rVBNCdoqMaGqfOvv4-eh6Pnsr7aDK9eyiHkwiSIvORTKXklBSQZRkroFJc0SBBUeWEJS9FXYSX1hWLGY-hppRKWvMqBiCU0TxN-uhin7uy7VunnBevbWdDO07EMSs4T2JKgutm75K2dc6qWqysXoLdCkrEbhIhdpOIcip29Ytd_eJrkgCzPQxOqt_4b_J_8AP9eZL_</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2268993210</pqid></control><display><type>article</type><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><source>ASCE Journals</source><creator>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</creator><creatorcontrib>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</creatorcontrib><description>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</description><identifier>ISSN: 0733-9364</identifier><identifier>EISSN: 1943-7862</identifier><identifier>DOI: 10.1061/(ASCE)CO.1943-7862.0001705</identifier><language>eng</language><publisher>New York: American Society of Civil Engineers</publisher><subject>Aerospace engineering ; Archiving ; Citation analysis ; Civil engineering ; Construction engineering ; Documents ; Engineering education ; Hirsch index ; Interdisciplinary aspects ; Mathematical analysis ; Parameters ; Qualitative research ; Quality ; Quality assessment ; Schedules ; Technical Papers</subject><ispartof>Journal of construction engineering and management, 2019-10, Vol.145 (10)</ispartof><rights>2019 American Society of Civil Engineers</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</citedby><cites>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</cites><orcidid>0000-0002-7306-6380</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttp://ascelibrary.org/doi/pdf/10.1061/(ASCE)CO.1943-7862.0001705$$EPDF$$P50$$Gasce$$H</linktopdf><linktohtml>$$Uhttp://ascelibrary.org/doi/abs/10.1061/(ASCE)CO.1943-7862.0001705$$EHTML$$P50$$Gasce$$H</linktohtml><link.rule.ids>314,780,784,3252,10068,27924,27925,76191,76199</link.rule.ids></links><search><creatorcontrib>El-adaway, Islam H</creatorcontrib><creatorcontrib>Ali, Gasser</creatorcontrib><creatorcontrib>Assaad, Rayan</creatorcontrib><creatorcontrib>Elsayegh, Amr</creatorcontrib><creatorcontrib>Abotaleb, Ibrahim S</creatorcontrib><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><title>Journal of construction engineering and management</title><description>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</description><subject>Aerospace engineering</subject><subject>Archiving</subject><subject>Citation analysis</subject><subject>Civil engineering</subject><subject>Construction engineering</subject><subject>Documents</subject><subject>Engineering education</subject><subject>Hirsch index</subject><subject>Interdisciplinary aspects</subject><subject>Mathematical analysis</subject><subject>Parameters</subject><subject>Qualitative research</subject><subject>Quality</subject><subject>Quality assessment</subject><subject>Schedules</subject><subject>Technical Papers</subject><issn>0733-9364</issn><issn>1943-7862</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp1kctOwzAURC0EEqXwDxZsYJFi5-HE7KrQAlJRF4W1dXGc1ih1iu206ufwp7iU14aFZWnunFnMIHROyYASRq8vh7NydFVOB5SnSZQXLB4QQmhOsgPU-9EOUY_kSRLxhKXH6MS51-BJGc966H1ooNl6LfF0rexaqw1ua1xqD163Bj8qb7V0WBvsFyroa93gkZlro5TVZo5v2yWE40b7BR63snM4UGVrnLed_Iz46wZT4UcwMFdLZTyerZTU0PgtHloFn9cH7_Cse6m0k3rVBNCdoqMaGqfOvv4-eh6Pnsr7aDK9eyiHkwiSIvORTKXklBSQZRkroFJc0SBBUeWEJS9FXYSX1hWLGY-hppRKWvMqBiCU0TxN-uhin7uy7VunnBevbWdDO07EMSs4T2JKgutm75K2dc6qWqysXoLdCkrEbhIhdpOIcip29Ytd_eJrkgCzPQxOqt_4b_J_8AP9eZL_</recordid><startdate>20191001</startdate><enddate>20191001</enddate><creator>El-adaway, Islam H</creator><creator>Ali, Gasser</creator><creator>Assaad, Rayan</creator><creator>Elsayegh, Amr</creator><creator>Abotaleb, Ibrahim S</creator><general>American Society of Civil Engineers</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><orcidid>https://orcid.org/0000-0002-7306-6380</orcidid></search><sort><creationdate>20191001</creationdate><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><author>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Aerospace engineering</topic><topic>Archiving</topic><topic>Citation analysis</topic><topic>Civil engineering</topic><topic>Construction engineering</topic><topic>Documents</topic><topic>Engineering education</topic><topic>Hirsch index</topic><topic>Interdisciplinary aspects</topic><topic>Mathematical analysis</topic><topic>Parameters</topic><topic>Qualitative research</topic><topic>Quality</topic><topic>Quality assessment</topic><topic>Schedules</topic><topic>Technical Papers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>El-adaway, Islam H</creatorcontrib><creatorcontrib>Ali, Gasser</creatorcontrib><creatorcontrib>Assaad, Rayan</creatorcontrib><creatorcontrib>Elsayegh, Amr</creatorcontrib><creatorcontrib>Abotaleb, Ibrahim S</creatorcontrib><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><jtitle>Journal of construction engineering and management</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>El-adaway, Islam H</au><au>Ali, Gasser</au><au>Assaad, Rayan</au><au>Elsayegh, Amr</au><au>Abotaleb, Ibrahim S</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</atitle><jtitle>Journal of construction engineering and management</jtitle><date>2019-10-01</date><risdate>2019</risdate><volume>145</volume><issue>10</issue><issn>0733-9364</issn><eissn>1943-7862</eissn><abstract>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</abstract><cop>New York</cop><pub>American Society of Civil Engineers</pub><doi>10.1061/(ASCE)CO.1943-7862.0001705</doi><orcidid>https://orcid.org/0000-0002-7306-6380</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0733-9364
ispartof Journal of construction engineering and management, 2019-10, Vol.145 (10)
issn 0733-9364
1943-7862
language eng
recordid cdi_proquest_journals_2268993210
source ASCE Journals
subjects Aerospace engineering
Archiving
Citation analysis
Civil engineering
Construction engineering
Documents
Engineering education
Hirsch index
Interdisciplinary aspects
Mathematical analysis
Parameters
Qualitative research
Quality
Quality assessment
Schedules
Technical Papers
title Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T15%3A42%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Analytic%20Overview%20of%20Citation%20Metrics%20in%20the%20Civil%20Engineering%20Domain%20with%20Focus%20on%20Construction%20Engineering%20and%20Management%20Specialty%20Area%20and%20Its%20Subdisciplines&rft.jtitle=Journal%20of%20construction%20engineering%20and%20management&rft.au=El-adaway,%20Islam%20H&rft.date=2019-10-01&rft.volume=145&rft.issue=10&rft.issn=0733-9364&rft.eissn=1943-7862&rft_id=info:doi/10.1061/(ASCE)CO.1943-7862.0001705&rft_dat=%3Cproquest_cross%3E2268993210%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2268993210&rft_id=info:pmid/&rfr_iscdi=true