TY - GEN
T1 - Decade-long Utilization Patterns of ICSE Technical Papers and Associated Artifacts
AU - Ahmed, Sharif
AU - Ortiz, Rey
AU - Eisty, Nasir U.
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Context: Annually, ICSE acknowledges a range of papers, a subset of which are paired with research artifacts such as source code, datasets, and supplementary materials, adhering to the Open Science Policy. However, no prior systematic inquiry dives into gauging the influence of ICSE papers using artifact attributes. Objective: We explore the mutual impact between artifacts and their associated papers presented at ICSE over ten years. Method: We collect data on usage attributes from papers and their artifacts, conduct a statistical assessment to identify differences, and analyze the top five papers in each attribute category. Results: There is a significant difference between paper citations and the usage of associated artifacts. While statistical analyses show no notable difference between paper citations and GitHub stars, variations exist in views and/or downloads of papers and artifacts. Conclusion: We provide a thorough overview of ICSE's accepted papers from the last decade, emphasizing the intricate relationship between research papers and their artifacts. To enhance the assessment of artifact influence in software research, we recommend considering key attributes that may be present in one platform but not in another.
AB - Context: Annually, ICSE acknowledges a range of papers, a subset of which are paired with research artifacts such as source code, datasets, and supplementary materials, adhering to the Open Science Policy. However, no prior systematic inquiry dives into gauging the influence of ICSE papers using artifact attributes. Objective: We explore the mutual impact between artifacts and their associated papers presented at ICSE over ten years. Method: We collect data on usage attributes from papers and their artifacts, conduct a statistical assessment to identify differences, and analyze the top five papers in each attribute category. Results: There is a significant difference between paper citations and the usage of associated artifacts. While statistical analyses show no notable difference between paper citations and GitHub stars, variations exist in views and/or downloads of papers and artifacts. Conclusion: We provide a thorough overview of ICSE's accepted papers from the last decade, emphasizing the intricate relationship between research papers and their artifacts. To enhance the assessment of artifact influence in software research, we recommend considering key attributes that may be present in one platform but not in another.
KW - Artifact
KW - Citations
KW - ICSE Papers
KW - Software Engineering
KW - Usage
UR - http://www.scopus.com/inward/record.url?scp=85207069186&partnerID=8YFLogxK
U2 - 10.1109/SERA61261.2024.10685638
DO - 10.1109/SERA61261.2024.10685638
M3 - Conference contribution
AN - SCOPUS:85207069186
T3 - 2024 IEEE/ACIS 22nd International Conference on Software Engineering Research, Management and Applications, SERA 2024 - Proceedings
SP - 166
EP - 173
BT - 2024 IEEE/ACIS 22nd International Conference on Software Engineering Research, Management and Applications, SERA 2024 - Proceedings
A2 - Hochin, Teruhisa
A2 - Ma, Jixin
A2 - Mizuno, Osamu
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 22nd IEEE/ACIS International Conference on Software Engineering Research, Management and Applications, SERA 2024
Y2 - 30 May 2024 through 1 June 2024
ER -