Título: Research artifacts for human-oriented experiments in software engineering: An ACM badges-driven structure proposal.

Autor(es): GUEVARA VEGA CATHY PAMELA, AMADOR DURÁN, ANTONIO RUIZ CORTÉS, BEATRIZ BERNÁRDEZ, MAGARITA CRUZ, MARTIN SOLARI

Fecha de publicación: 28-aug-2024

Resumen: Context: The Open Science (OS) movement promotes the value of making public the research artifacts (datasets, analysis scripts, guidelines, etc.) used during empirical studies. OS is widely known in areas such as Medicine or Biology, where the process of sharing research artifacts is subject to strict protocols. Unfortunately, in Software Engineering (SE), this process is carried out in a non-systematic way, resulting in incomplete or inaccurate material shared by researchers, which hinders the reproducibility and replicability of empirical studies. Nevertheless, in recent years, it seems that the Empirical Software Engineering (ESE) community is embracing some of the proposed OS initiatives, such as the one proposed by the Association for Computing Machinery (ACM), which provides a badge system to evaluate the quality of a research artifact. This badge system has been adopted by several SE conferences as a method of assessing research artifacts.

Palabras clave: Research artifactLaboratory packageReplication packageEmpirical software engineeringHuman-oriented experimentsOpen scienceACM (Association for Computing Machinery)Badging policy

DOI: https://doi.org/10.1016/j.jss.2024.112187

ISSN: 0164-1212

Tipo publicación: Artículo