Loading…
Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines
AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an...
Saved in:
Published in: | Journal of construction engineering and management 2019-10, Vol.145 (10) |
---|---|
Main Authors: | , , , , |
Format: | Article |
Language: | English |
Subjects: | |
Citations: | Items that this one cites Items that cite this one |
Online Access: | Get full text |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
cited_by | cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743 |
---|---|
cites | cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743 |
container_end_page | |
container_issue | 10 |
container_start_page | |
container_title | Journal of construction engineering and management |
container_volume | 145 |
creator | El-adaway, Islam H Ali, Gasser Assaad, Rayan Elsayegh, Amr Abotaleb, Ibrahim S |
description | AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality |
doi_str_mv | 10.1061/(ASCE)CO.1943-7862.0001705 |
format | article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2268993210</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2268993210</sourcerecordid><originalsourceid>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</originalsourceid><addsrcrecordid>eNp1kctOwzAURC0EEqXwDxZsYJFi5-HE7KrQAlJRF4W1dXGc1ih1iu206ufwp7iU14aFZWnunFnMIHROyYASRq8vh7NydFVOB5SnSZQXLB4QQmhOsgPU-9EOUY_kSRLxhKXH6MS51-BJGc966H1ooNl6LfF0rexaqw1ua1xqD163Bj8qb7V0WBvsFyroa93gkZlro5TVZo5v2yWE40b7BR63snM4UGVrnLed_Iz46wZT4UcwMFdLZTyerZTU0PgtHloFn9cH7_Cse6m0k3rVBNCdoqMaGqfOvv4-eh6Pnsr7aDK9eyiHkwiSIvORTKXklBSQZRkroFJc0SBBUeWEJS9FXYSX1hWLGY-hppRKWvMqBiCU0TxN-uhin7uy7VunnBevbWdDO07EMSs4T2JKgutm75K2dc6qWqysXoLdCkrEbhIhdpOIcip29Ytd_eJrkgCzPQxOqt_4b_J_8AP9eZL_</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2268993210</pqid></control><display><type>article</type><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><source>ASCE Journals</source><creator>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</creator><creatorcontrib>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</creatorcontrib><description>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</description><identifier>ISSN: 0733-9364</identifier><identifier>EISSN: 1943-7862</identifier><identifier>DOI: 10.1061/(ASCE)CO.1943-7862.0001705</identifier><language>eng</language><publisher>New York: American Society of Civil Engineers</publisher><subject>Aerospace engineering ; Archiving ; Citation analysis ; Civil engineering ; Construction engineering ; Documents ; Engineering education ; Hirsch index ; Interdisciplinary aspects ; Mathematical analysis ; Parameters ; Qualitative research ; Quality ; Quality assessment ; Schedules ; Technical Papers</subject><ispartof>Journal of construction engineering and management, 2019-10, Vol.145 (10)</ispartof><rights>2019 American Society of Civil Engineers</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</citedby><cites>FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</cites><orcidid>0000-0002-7306-6380</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttp://ascelibrary.org/doi/pdf/10.1061/(ASCE)CO.1943-7862.0001705$$EPDF$$P50$$Gasce$$H</linktopdf><linktohtml>$$Uhttp://ascelibrary.org/doi/abs/10.1061/(ASCE)CO.1943-7862.0001705$$EHTML$$P50$$Gasce$$H</linktohtml><link.rule.ids>314,780,784,3252,10068,27924,27925,76191,76199</link.rule.ids></links><search><creatorcontrib>El-adaway, Islam H</creatorcontrib><creatorcontrib>Ali, Gasser</creatorcontrib><creatorcontrib>Assaad, Rayan</creatorcontrib><creatorcontrib>Elsayegh, Amr</creatorcontrib><creatorcontrib>Abotaleb, Ibrahim S</creatorcontrib><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><title>Journal of construction engineering and management</title><description>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</description><subject>Aerospace engineering</subject><subject>Archiving</subject><subject>Citation analysis</subject><subject>Civil engineering</subject><subject>Construction engineering</subject><subject>Documents</subject><subject>Engineering education</subject><subject>Hirsch index</subject><subject>Interdisciplinary aspects</subject><subject>Mathematical analysis</subject><subject>Parameters</subject><subject>Qualitative research</subject><subject>Quality</subject><subject>Quality assessment</subject><subject>Schedules</subject><subject>Technical Papers</subject><issn>0733-9364</issn><issn>1943-7862</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><recordid>eNp1kctOwzAURC0EEqXwDxZsYJFi5-HE7KrQAlJRF4W1dXGc1ih1iu206ufwp7iU14aFZWnunFnMIHROyYASRq8vh7NydFVOB5SnSZQXLB4QQmhOsgPU-9EOUY_kSRLxhKXH6MS51-BJGc966H1ooNl6LfF0rexaqw1ua1xqD163Bj8qb7V0WBvsFyroa93gkZlro5TVZo5v2yWE40b7BR63snM4UGVrnLed_Iz46wZT4UcwMFdLZTyerZTU0PgtHloFn9cH7_Cse6m0k3rVBNCdoqMaGqfOvv4-eh6Pnsr7aDK9eyiHkwiSIvORTKXklBSQZRkroFJc0SBBUeWEJS9FXYSX1hWLGY-hppRKWvMqBiCU0TxN-uhin7uy7VunnBevbWdDO07EMSs4T2JKgutm75K2dc6qWqysXoLdCkrEbhIhdpOIcip29Ytd_eJrkgCzPQxOqt_4b_J_8AP9eZL_</recordid><startdate>20191001</startdate><enddate>20191001</enddate><creator>El-adaway, Islam H</creator><creator>Ali, Gasser</creator><creator>Assaad, Rayan</creator><creator>Elsayegh, Amr</creator><creator>Abotaleb, Ibrahim S</creator><general>American Society of Civil Engineers</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><orcidid>https://orcid.org/0000-0002-7306-6380</orcidid></search><sort><creationdate>20191001</creationdate><title>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</title><author>El-adaway, Islam H ; Ali, Gasser ; Assaad, Rayan ; Elsayegh, Amr ; Abotaleb, Ibrahim S</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Aerospace engineering</topic><topic>Archiving</topic><topic>Citation analysis</topic><topic>Civil engineering</topic><topic>Construction engineering</topic><topic>Documents</topic><topic>Engineering education</topic><topic>Hirsch index</topic><topic>Interdisciplinary aspects</topic><topic>Mathematical analysis</topic><topic>Parameters</topic><topic>Qualitative research</topic><topic>Quality</topic><topic>Quality assessment</topic><topic>Schedules</topic><topic>Technical Papers</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>El-adaway, Islam H</creatorcontrib><creatorcontrib>Ali, Gasser</creatorcontrib><creatorcontrib>Assaad, Rayan</creatorcontrib><creatorcontrib>Elsayegh, Amr</creatorcontrib><creatorcontrib>Abotaleb, Ibrahim S</creatorcontrib><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><jtitle>Journal of construction engineering and management</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>El-adaway, Islam H</au><au>Ali, Gasser</au><au>Assaad, Rayan</au><au>Elsayegh, Amr</au><au>Abotaleb, Ibrahim S</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines</atitle><jtitle>Journal of construction engineering and management</jtitle><date>2019-10-01</date><risdate>2019</risdate><volume>145</volume><issue>10</issue><issn>0733-9364</issn><eissn>1943-7862</eissn><abstract>AbstractSeveral data-based metrics have been developed to evaluate the quality of research output, including h-index, impact factor, and others. Considerable debates have focused on whether the aforementioned metrics represent effective and efficient indications of research impact or just provide an imperfect reflection. Because the academic community is witnessing a growing trend where most of the tangible rewards are related to publications and their quality, there is a dire necessity to obtain a more realistic and holistic understanding of such evaluation indicators. As such, the goal of this paper is to investigate the parameters associated with the citation metrics used to assess the quality and impact of research publications in the broad civil engineering (CE) domain with a focus on the construction engineering and management (CEM) specialty area and its subdisciplines. To this end, the authors (1) analyzed the different CE research areas—including CEM—with respect to the number of publications, community size, and potential ties with other interdisciplinary fields; (2) studied the citation metrics of the most-cited as well as award-winning peer-reviewed publications in both CE and CEM while examining the effect of the availability of research funds as well as the nature of the research—quantitative or qualitative—on the average number of citations for most-cited publications across the different CE specialty areas; and (3) investigated the impact of multiple factors on the citation metrics. Based on a thorough survey and analysis of 67,800 journal publications, it was found that both number of publications and citation metrics for the CEM specialty area is significantly lower compared with other CE specialty areas. Along the same vein, the citations across the various CEM subdisciplines are all different, where labor and personnel (306 average citations per paper) and contracting (266 average citations per paper) are the most cited, but cost and schedule (47 average citations per paper) and legal and contractual (23 average citations per paper) are the least cited. Also, with the exception of aerospace engineering as well as engineering education and practices, CEM was the least funded, had the highest percentage of qualitative research, and the least average number of citations for funded/unfunded projects as well as qualitative/quantitative research. Further, it was revealed that award-winning papers—which supposedly represent the highest quality—are not highly cited and in fact have way below average citation numbers. Ultimately, it was found that several factors such as research community size, trendiness of research field, amount of research output, connection with other interdisciplinary fields, characteristics and attributes of coauthors, timing of checking an h-index, publication access type, and the criteria adopted by the various archiving databases collectively affect the citation metrics for papers and authors. As such, citation metrics like h-index should not be used solely to assess the quality and impact of an author but rather be utilized as a single piece of information within a more holistic and broader context. This study furnishes various parameters and considerations that should be normalized before attempting to compare citations of papers and/or authors across the CE domain.</abstract><cop>New York</cop><pub>American Society of Civil Engineers</pub><doi>10.1061/(ASCE)CO.1943-7862.0001705</doi><orcidid>https://orcid.org/0000-0002-7306-6380</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0733-9364 |
ispartof | Journal of construction engineering and management, 2019-10, Vol.145 (10) |
issn | 0733-9364 1943-7862 |
language | eng |
recordid | cdi_proquest_journals_2268993210 |
source | ASCE Journals |
subjects | Aerospace engineering Archiving Citation analysis Civil engineering Construction engineering Documents Engineering education Hirsch index Interdisciplinary aspects Mathematical analysis Parameters Qualitative research Quality Quality assessment Schedules Technical Papers |
title | Analytic Overview of Citation Metrics in the Civil Engineering Domain with Focus on Construction Engineering and Management Specialty Area and Its Subdisciplines |
url | http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T15%3A42%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Analytic%20Overview%20of%20Citation%20Metrics%20in%20the%20Civil%20Engineering%20Domain%20with%20Focus%20on%20Construction%20Engineering%20and%20Management%20Specialty%20Area%20and%20Its%20Subdisciplines&rft.jtitle=Journal%20of%20construction%20engineering%20and%20management&rft.au=El-adaway,%20Islam%20H&rft.date=2019-10-01&rft.volume=145&rft.issue=10&rft.issn=0733-9364&rft.eissn=1943-7862&rft_id=info:doi/10.1061/(ASCE)CO.1943-7862.0001705&rft_dat=%3Cproquest_cross%3E2268993210%3C/proquest_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-a385t-c4cc9108a55568ade9e14cca8d7063b8f8b8f4fd62692af111c1f9d2aa0161743%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=2268993210&rft_id=info:pmid/&rfr_iscdi=true |