| 1 |
Boettiger, Carl (2015). An introduction to docker for reproducible research |
documentation, code deposit, dependency resolution, path resolution, computing environment |
| 2 |
Santana-Perez, Idafen; Pérez-Hernández, María S. (2015). Towards reproducibility in scientific workflows: an infrastructure-based approach |
dependency resolution, computing environment |
| 3 |
Stodden, Victoria (2015). Reproducing statistical results |
documentation, license, code deposit, data deposit, artifacts longevity/sustainability, computing environment, version control |
| 4 |
Oxvig, Christian; Arildsen, Thomas; Larsen, Torben (2016). Storing reproducible results from computational experiments using scientific python packages |
documentation, data provenance, version control |
| 5 |
Chirigati, Fernando; Rampin, Rémi; Shasha, Dennis et al. (2016). ReproZip: computational reproducibility with ease |
code deposit, data deposit, dependency resolution, computing environment |
| 6 |
Weller, Katrin; Kinder-Kurlanda, Katharina E. (2016). A manifesto for data sharing in social media research |
documentation, data provenance, code deposit, data deposit |
| 7 |
Piccolo, Stephen R.; Frampton, Michael B. (2016). Tools and techniques for computational reproducibility |
documentation, code deposit, dependency resolution, computing environment |
| 8 |
de la Guardia, Fernando Hoces (2017). How transparency and reproducibility can increase credibility in policy analysis: a case study of the minimum wage policy estimate |
— |
| 9 |
Steeves, Vicky; Rampin, Rémi; Chirigati, Fernando (2017). Using ReproZip for reproducibility and library services |
documentation, data provenance, dependency resolution, computing environment |
| 10 |
Rougier, Nicolas P.; Hinsen, Konrad; Alexandre, Frédéric et al. (2017). Sustainable computational science: the ReScience initiative |
code deposit, dependency resolution, computing environment, code annotation, codes consistent with claims, numerical output match |
| 11 |
That, Dai Hai Ton; Fils, Gabriel; Yuan, Zhihao et al. (2017). Sciunits: reusable research objects |
code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 12 |
Edo Pellizzari; Kathleen Lohr; Alan Blatecky et al. (2017). Reproducibility: a primer on semantics and implications for research |
documentation, data provenance, code deposit, data deposit, computing environment, codes consistent with claims |
| 13 |
Hinsen, Konrad (2017). Reproducibility does not imply reproduction |
— |
| 14 |
Stodden, Victoria; Seiler, Jennifer; Ma, Zhaokun (2018). An empirical analysis of journal policy effectiveness for computational reproducibility |
documentation, data provenance, license, code deposit, data deposit, coding error handling, computing environment, numerical output match, table and figure match |
| 15 |
Chen, Christopher (2018). Coding be eR: assessing and improving the reproducibility of R-based research with containR |
data deposit, dependency resolution, path resolution |
| 16 |
Rampin, Remi; Chirigati, Fernando; Steeves, Vicky et al. (2018). ReproServer: making reproducibility easier and less intensive |
dependency resolution, computing environment |
| 17 |
Christensen, Garret; Miguel, Edward (2018). Transparency, reproducibility, and the credibility of economics research |
documentation, code deposit, data deposit, computing environment, codes consistent with claims |
| 18 |
Villhuber, Lars (2018). Reproducibility confidentiality data access |
documentation, data provenance, code deposit, data deposit, numerical output match |
| 19 |
Thorpe, Brandon (2019). The ReproRubric: evaluation criteria for the reproducibility of computational analyses |
documentation, data provenance, license, code deposit, data deposit, dependency resolution, computing environment, codes consistent with claims |
| 20 |
Liu, David M.; Salganik, Matthew J. (2019). Successes and struggles with computational reproducibility: lessons from the fragile families challenge |
documentation, license, code deposit, data deposit, dependency resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 21 |
Chard, Kyle; Gaffney, Niall; Jones, Matthew B. et al. (2019). Implementing computational reproducibility in the whole tale environment |
— |
| 22 |
Chard, Kyle; Gaffney, Niall; Jones, Matthew B. et al. (2019). Application of BagIt-serialized research object bundles for packaging and Re-execution of computational analyses |
— |
| 23 |
Blischak, John D.; Carbonetto, Peter; Stephens, Matthew (2019). Creating and sharing reproducible research code the workflowr way |
documentation, code deposit, path resolution, coding error handling, computing environment |
| 24 |
Hatton, Les; Van Genuchten, Michiel (2019). Computational reproducibility: the elephant in the room |
code deposit, numerical output match, table and figure match |
| 25 |
Kim, Jenna; Blake, Catherine; Darch, Peter T. (2019). Toward computational reproducibility: a doctoral student’s story of passing the baton |
documentation, code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 26 |
Krieger, Nikolas I.; Perzynski, Adam T.; Dalton, Jarrod E. (2019). Facilitating reproducible project management and manuscript development in team science: the projects R package |
documentation, data provenance, path resolution, version control |
| 27 |
Whitehouse, Tyler; Clark, Dav; Tsang, Emmy (2019). Rebooting reproducibility: From re-execution to replication |
dependency resolution, computing environment |
| 28 |
Quintana, Daniel S (2020). A synthetic dataset primer for the biobehavioural sciences to promote reproducibility and hypothesis generation |
code deposit, data deposit, computing environment, numerical output match |
| 29 |
Christian, Thu-Mai; Gooch, Amanda; Vision, Todd et al. (2020). Journal data policies: exploring how the understanding of editors and authors corresponds to the policies themselves |
data deposit |
| 30 |
Trisovic, Ana; Durbin, Philip; Schlatter, Tania et al. (2020). Advancing computational reproducibility in the dataverse data repository platform |
documentation, data provenance, code deposit, data deposit, path resolution, computing environment |
| 31 |
Steeves, Vicky; Rampin, Rémi; Chirigati, Fernando (2020). Reproducibility, preservation, and access to research with ReproZip and ReproServer |
documentation, data provenance, dependency resolution, computing environment |
| 32 |
Stodden, Victoria (2020). Beyond open data: a model for linking digital artifacts to enable reproducibility of scientific claims |
data provenance, license, code deposit, data deposit, computing environment |
| 33 |
Chuah, Jason; Deeds, Madeline; Malik, Tanu et al. (2020). Documenting computing environments for reproducible experiments |
documentation, computing environment |
| 34 |
Vilhuber, Lars (2020). Reproducibility and replicability in economics |
data provenance, license, code deposit, data deposit |
| 35 |
Willis, Craig (2020). Trust, but verify: an investigation of methods of verification and dissemination of computational research artifacts for transparency and reproducibility |
documentation, license, code deposit, data deposit, dependency resolution, computing environment, codes consistent with claims, numerical output match |
| 36 |
Pimentel, João Felipe; Freire, Juliana; Murta, Leonardo et al. (2020). A survey on collecting, managing, and analyzing provenance from scripts |
— |
| 37 |
Hinsen, Konrad (2020). The four possibilities of reproducible scientific computations |
code deposit, data deposit, computing environment, dynamic code inspection |
| 38 |
Nüst, Daniel; Sochat, Vanessa; Marwick, Ben et al. (2020). Ten simple rules for writing dockerfiles for reproducible data science |
documentation, license, code deposit, data deposit, artifacts longevity/sustainability, dependency resolution, computing environment, version control |
| 39 |
Orozco, Valérie; Bontemps, Christophe; Maigné, Elise et al. (2020). How to make a pie: reproducible research for empirical economics and econometrics |
documentation, data provenance, license, code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 40 |
Canon, R. Shane (2020). The role of containers in reproducibility |
dependency resolution, computing environment |
| 41 |
Hail, Luzi; Lang, Mark; Leuz, Christian (2020). Reproducibility in accounting research: views of the research community |
code deposit, data deposit |
| 42 |
Vilhuber, Lars (2021). AEA data and code availability policy |
documentation, data provenance, code deposit, data deposit, artifacts longevity/sustainability |
| 43 |
Vlaeminck, Sven (2021). Dawning of a new age? Economics journals’ data policies on the test bench |
documentation, data provenance, code deposit, data deposit |
| 44 |
Peer, Limor; Orr, Lilla V.; Coppock, Alexander (2021). Active maintenance: a proposal for the long-term computational reproducibility of scientific results |
documentation, code deposit, data deposit, artifacts longevity/sustainability, dependency resolution, coding error handling, computing environment |
| 45 |
Bahaidarah, Layan; Hung, Ethan; Oliveira, Andreas F. De Melo et al. (2021). Toward reusable science with readable code and reproducibility |
documentation, license, code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 46 |
Peikert, Aaron; Van Lissa, Caspar J.; Brandmaier, Andreas M. (2021). Reproducible research in R: a tutorial on how to do the same thing more than once |
documentation, code deposit, data deposit, dependency resolution, computing environment, code runs without manual intervention, numerical output match, table and figure match |
| 47 |
Freiling, Isabelle; Krause, Nicole M; Scheufele, Dietram A et al. (2021). The science of open (communication) science: toward an evidence-driven understanding of quality criteria in communication research |
documentation, code deposit, data deposit |
| 48 |
Peer, Limor; Arguillas, Florio; Honeyman, Tom et al. (2021). Challenges of curating for reproducible and FAIR research output |
documentation, data provenance, license, code deposit, data deposit, artifacts longevity/sustainability, dependency resolution, computing environment |
| 49 |
Gundersen, Odd Erik (2021). The fundamental principles of reproducibility |
— |
| 50 |
Mukherjee, Suchita; Almanza, Abigail; Rubio-González, Cindy (2021). Fixing dependency errors for python build reproducibility |
dependency resolution |
| 51 |
Peikert, Aaron; Brandmaier, Andreas M. (2021). A reproducible data analysis workflow with R Markdown, Git, Make, and Docker |
data provenance, license, code deposit, data deposit, dependency resolution, path resolution, computing environment, version control, numerical output match |
| 52 |
Nüst, Daniel; Eglen, Stephen J. (2021). CODECHECK: an open science initiative for the independent execution of computations underlying research articles during peer review to improve reproducibility |
documentation, license, code deposit, data deposit, coding error handling, computing environment, numerical output match, table and figure match |
| 53 |
Ghoshal, Devarshi; Bianchi, Ludovico; Essiari, Abdelilah et al. (2021). Science capsule: towards sharing and reproducibility of scientific workflows |
— |
| 54 |
Van Lissa, Caspar J.; Brandmaier, Andreas M.; Brinkman, Loek et al. (2021). WORCS: a workflow for open reproducible code in science |
documentation, data provenance, license, code deposit, data deposit, artifacts longevity/sustainability, dependency resolution, coding error handling, version control |
| 55 |
Sawchuk, Sandra L.; Khair, Shahira (2021). Computational reproducibility: a practical framework for data curators |
documentation, data provenance, license, code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 56 |
Niso Taxonomy, Definitions, And Recognition Badging Scheme Working Group (2021). Reproducibility badging and definitions |
documentation, license, code deposit, data deposit, numerical output match |
| 57 |
Stoudt, Sara; Vásquez, Váleri N.; Martinez, Ciera C. (2021). Principles for data analysis workflows |
documentation, license, dependency resolution |
| 58 |
Stewart, Andrew J.; Farran, Emily K.; Grange, James A. et al. (2021). Improving research quality: the view from the UK reproducibility network institutional leads for research improvement |
documentation, code deposit, data deposit, numerical output match |
| 59 |
Samuel, Sheeba; König-Ries, Birgitta (2021). Understanding experiments and research practices for reproducibility: an exploratory study |
documentation, data provenance, license, code deposit, data deposit |
| 60 |
Moody, James W.; Keister, Lisa A.; Ramos, Maria C. (2022). Reproducibility in the social sciences |
code deposit, data deposit, numerical output match, table and figure match |
| 61 |
Samuel, Sheeba; König-Ries, Birgitta (2022). A collaborative semantic-based provenance management platform for reproducibility |
documentation, data provenance, dependency resolution, computing environment, numerical output match, table and figure match |
| 62 |
Vanegas Ferro, Manuela; Lee, Allen; Pritchard, Calvin et al. (2022). Containerization for creating reusable model code |
documentation, license, code deposit, dependency resolution, computing environment |
| 63 |
Vallet, Nicolas; Michonneau, David; Tournier, Simon (2022). Toward practical transparent verifiable and long-term reproducible research using guix |
documentation, data provenance, computing environment, version control |
| 64 |
Akella, Akhil Pandey; Alhoori, Hamed; Koop, David (2022). Reproducibility signals in science: a preliminary analysis |
code deposit |
| 65 |
Federer, Lisa M. (2022). Long-term availability of data associated with articles in PLOS ONE |
data provenance, data deposit |
| 66 |
Peer, Limor; Biniossek, Claudia; Betz, Dirk et al. (2022). Reproducible research publication workflow: a canonical workflow framework and FAIR digital object approach to quality research output |
documentation, data provenance, license, code deposit, data deposit, coding error handling, codes consistent with claims, numerical output match |
| 67 |
Dogucu, Mine; Çetinkaya-Rundel, Mine (2022). Tools and recommendations for reproducible teaching |
documentation, data provenance, license, code deposit, data deposit, path resolution, computing environment |
| 68 |
Baldwin, Jessie R.; Pingault, Jean-Baptiste; Schoeler, Tabea et al. (2022). Protecting against researcher bias in secondary data analysis: challenges and potential solutions |
— |
| 69 |
Mikytuck, Alyssa; Nusser, Sarah; Korkmaz, Gizem (2022). The interdependence of data producers and data users: how researchers’ behaviors can support or hinder each other |
documentation, data provenance, license, code deposit, computing environment, version control |
| 70 |
Gayle, Vernon; Connelly, Roxanne (2022). The Stark realities of reproducible statistically orientated sociological research: Some newer rules of the sociological method |
documentation, data provenance, license, code deposit, data deposit, dependency resolution, code annotation, test code coverage |
| 71 |
Vilhuber, Lars; Son, Hyuk Harry; Welch, Meredith et al. (2022). Teaching for Large-Scale Reproducibility Verification |
documentation, data provenance, code deposit, data deposit, dependency resolution, computing environment, codes consistent with claims, numerical output match |
| 72 |
Krähmer, Daniel; Schächtele, Laura; Schneck, Andreas (2023). Care to share? Experimental evidence on code sharing behavior in the social sciences |
code deposit, data deposit |
| 73 |
Costa, Lázaro; Barbosa, Susana; Cunha, Jácome (2023). A backend platform for supporting the reproducibility of computational experiments |
documentation, code deposit, data deposit, dependency resolution, computing environment |
| 74 |
Wonsil, Joseph; Boufford, Nichole; Agrawal, Prakhar et al. (2023). Reproducibility as a service |
dependency resolution, path resolution, coding error handling, computing environment |
| 75 |
Vilhuber, Lars; Schmutte, Ian; Michuda, Aleksandr et al. (2023). Reinforcing reproducibility and replicability: an introduction |
documentation, data provenance, code deposit, data deposit |
| 76 |
Lerner, Barbara; Boose, Emery; Brand, Orenna et al. (2023). Making provenance work for you |
documentation, data provenance, code deposit, data deposit, computing environment |
| 77 |
Vilhuber, Lars (2023). Report of the AEA data editor |
documentation, data provenance, license, data deposit, dependency resolution |
| 78 |
Vilhuber, Lars (2023). CRRESS - session 4 - reproducibility and confidential data |
data provenance, code deposit, codes consistent with claims |
| 79 |
Hunt, Gregory; Gagnon-Bartsch, Johann (2023). A review of containerization for interactive and reproducible analysis |
code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 80 |
Oswald, Christian; Walterskirchen, Julian; Häffner, Sonja et al. (2023). Replication of the morning after: report from the nottingham replication games |
code deposit, data deposit, coding error handling, numerical output match |
| 81 |
Guiteras, Raymond P.; Kim, Ahnjeong; Quistorff, Brian et al. (2023). statacons: An SCons-based build tool for Stata |
code deposit, data deposit |
| 82 |
Hayden, Gabriele; Mentnech, Tisha; Rampin, Vicky (2023). Supporting reproducible research |
code deposit, data deposit, computing environment |
| 83 |
Vilhuber, Lars (2023). Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor |
documentation, data provenance, license, code deposit, data deposit, code annotation, codes consistent with claims |
| 84 |
Finger, Robert; Grebitus, Carola; Henningsen, Arne (2023). Replications in agricultural economics |
code deposit, data deposit |
| 85 |
Pérignon, Christophe (2024). The Role of Third-Party Verification in Research Reproducibility |
documentation, code deposit, data deposit, computing environment, numerical output match, table and figure match |
| 86 |
Chung-hong Chan; Tim Schatto-Eckrodt; Johannes Gruber (2024). What makes computational communication science (ir)reproducible? |
code deposit, data deposit, dependency resolution, path resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 87 |
Scoggins, Bermond; Robertson, Matthew P. (2024). Measuring transparency in the social sciences: political science and international relations |
code deposit, data deposit |
| 88 |
Fišar, Miloš; Greiner, Ben; Huber, Christoph et al. (2024). Reproducibility in Management Science |
documentation, data provenance, code deposit, data deposit, dependency resolution, computing environment, numerical output match, table and figure match |
| 89 |
Schoch, David; Chan, Chung-hong; Wagner, Claudia et al. (2024). Computational reproducibility in computational social science |
documentation, data provenance, code deposit, data deposit, dependency resolution, computing environment, codes consistent with claims, numerical output match |
| 90 |
Silverstein, Priya; Elman, Colin; Montoya, Amanda et al. (2024). A guide for social science journal editors on easing into open science |
code deposit, data deposit |
| 91 |
Siegel, Zachary S.; Kapoor, Sayash; Nagdir, Nitya et al. (2024). CORE-bench: fostering the credibility of published research through a computational reproducibility agent benchmark |
documentation, code deposit, data deposit, dependency resolution, path resolution, computing environment, numerical output match |
| 92 |
Lukito, Josephine; Greenfield, Jason; Yang, Yunkang et al. (2024). Audio-as-data tools: replicating computational data processing |
documentation |
| 93 |
Ottone, Nicholas; Peer, Limor (2024). Unintended code errors and computational reproducibility |
documentation, data provenance, license, code deposit, data deposit, path resolution, coding error handling, numerical output match, table and figure match |
| 94 |
Akella, Akhil Pandey; Choudhur, Sagnik Ray; Koop, David (2024). Navigating the landscape of reproducible research: a predictive modeling approach |
code deposit, data deposit |
| 95 |
Pérignon, Christophe; Akmansoy, Olivier; Hurlin, Christophe et al. (2024). Computational reproducibility in finance: evidence from 1,000 tests |
documentation, data provenance, code deposit, data deposit, dependency resolution, path resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 96 |
Costa, Lázaro; Barbosa, Susana; Cunha, Jácome (2024). Evaluating tools for enhancing reproducibility in computational scientific experiments |
— |
| 97 |
Peer, Limor (2024). Why and how we share reproducible research at yale university’s institution for social and policy studies |
documentation, code deposit, data deposit, numerical output match |
| 98 |
Brodeur, Abel; Mikola, Derek; Cook, Nikolai (2024). Mass reproducibility and replicability: a new hope |
code deposit, data deposit, coding error handling, codes consistent with claims, numerical output match |
| 99 |
Jones, Maria (2024). Introducing reproducible research standards at the world bank |
documentation, license, code deposit, data deposit, path resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 100 |
Oswald, Christian; Walterskirchen, Julian (2024). Computational and robustness reproducibility of “UN peacekeeping and democratization in conflict-affected countries” |
data provenance, code deposit, data deposit, coding error handling, numerical output match, table and figure match |
| 101 |
Luijken, K.; Lohmann, A.; Alter, U. et al. (2024). Replicability of simulation studies for the investigation of statistical methods: the RepliSims project |
documentation, code deposit, data deposit |
| 102 |
Gligorić, Kristina; Piccardi, Tiziano; Hofman, Jake M. et al. (2024). In-Class Data Analysis Replications: Teaching Students While Testing Science |
documentation, data provenance, computing environment |
| 103 |
Knöpfle, Philipp; Schatto-Eckrodt, Tim (2024). The Challenges of Replicating Volatile Platform-Data Studies: Replicating Schatto-Eckrodt et al. (2020) |
documentation, code deposit, data deposit, dependency resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 104 |
Herbert, Sylvérie; Kingi, Hautahi; Stanchi, Flavio et al. (2024). Reproduce to validate: a comprehensive study on the reproducibility of economics research |
documentation, data provenance, code deposit, data deposit, path resolution, coding error handling, computing environment, numerical output match, table and figure match |
| 105 |
Brodeur, Abel; Esterling, Kevin; Ankel-Peters, Jörg et al. (2024). Promoting reproducibility and replicability in political science |
data provenance, code deposit, data deposit, dependency resolution, path resolution, numerical output match |
| 106 |
Rainey, Carlisle; Roe, Harley (2024). The data availability policies of political science journals |
documentation, code deposit, data deposit, numerical output match |
| 107 |
Bauer, Gerrit; Breznau, Nate; Gereke, Johanna et al. (2025). Teaching constructive replications in the behavioral and social sciences using quantitative data |
documentation, code deposit, data deposit, dependency resolution, path resolution, numerical output match |
| 108 |
Momeni, Fakhri; Khan, Muhammad Taimoor; Kiesel, Johannes et al. (2025). Checklists for computational reproducibility in social sciences: insights from literature and survey evaluation |
documentation, data provenance, license, code deposit, data deposit, dependency resolution, computing environment, code annotation, version control, commands logs traceability |
| 109 |
Ankel-Peters, Jörg; Brodeur, Abel; Dreber, Anna et al. (2025). A protocol for structured robustness reproductions and replicability assessments |
code deposit, data deposit, coding error handling, codes consistent with claims, numerical output match, table and figure match |
| 110 |
Rainey, Carlisle; Roe, Harley; Wang, Qing et al. (2025). Data and code availability in political science publications from 1995 to 2022 |
data provenance, code deposit, data deposit, numerical output match |
| 111 |
Fink, Lukas; Marcus, Jan (2025). Replication code availability over time and across fields: evidence from the german socio-economic panel |
— |
| 112 |
Hu, Chuxuan; Zhang, Liyun; Lim, Yeji et al. (2025). REPRO-bench: can agentic AI systems assess the reproducibility of social science research? |
dependency resolution, path resolution, numerical output match |
| 113 |
Costa, Lázaro; Barbosa, Susana; Cunha, Jácome (2025). Let’s talk about it: making scientific computational reproducibility easier |
documentation, code deposit, data deposit, dependency resolution, coding error handling, numerical output match |
| 114 |
Costa, Lázaro; Barbosa, Susana; Cunhá, Jacome (2025). SciConv: a conversational tool for reproducibility |
dependency resolution, computing environment |
| 115 |
A S M Shahadat Hossain; Colin Brown; David Koop et al. (2025). Similarity-based assessment of computational reproducibility in jupyter notebooks |
coding error handling |
| 116 |
Zhao, Xuanie; Sang, Zillin; Li, Yuxuan et al. (2025). AutoReproduce: automatic AI experiment reproduction with paper lineage |
coding error handling, code runs without manual intervention, codes consistent with claims |
| 117 |
Saju, Lorraine; Holtdirk, Tobias; Mangroliya, Meetkumar P et al. (2025). Computational reproducibility of R code supplements on OSF |
documentation, code deposit, data deposit, dependency resolution, path resolution, computing environment, code runs without manual intervention, version control |
| 118 |
Peng, Roger (2025). Tooling for reproducible research: considerations for the past and future of data analysis |
code deposit, data deposit, dependency resolution, coding error handling |
| 119 |
Illmer, Viktor J. (2025). “Works on my machine”: a case study of replicability challenges inComputational humanities research |
documentation, code deposit, artifacts longevity/sustainability, dependency resolution, path resolution, computing environment |
| 120 |
Rogers, Pablo (2025). Reproducibility spectrum for applied social sciences: conceptual taxonomy and recommended tools |
documentation, license, code deposit, data deposit, dependency resolution, computing environment, version control |
| 121 |
Simkus, Andrea; Coolen-Maturi, Tahani; Coolen, Frank P. A. et al. (2025). Statistical perspectives on reproducibility: definitions and challenges |
documentation, data provenance, code deposit, data deposit |
| 122 |
Zeng, Qiuhai; Jin, Claire; Wang, Xinyue et al. (2025). AIRepr: an analyst-inspector framework for evaluating reproducibility of LLMs in data science |
code runs without manual intervention |
| 123 |
Hinsen, Konrad (2025). Why computational reproducibility matters |
computing environment, numerical output match |
| 124 |
Hasso, Tim; Brosnan, Mark; Ali, Searat et al. (2025). Perceived problems, causes, and solutions of finance research reproducibility and replicability: a pre-registered report |
code deposit, data deposit |
| 125 |
Denly, Michael; Helms, Benjamin (2025). A report on “corruption and Co-optation in autocracy: evidence from Russia” |
code deposit, data deposit, dependency resolution, path resolution, computing environment |
| 126 |
Brandmaier, Andreas M.; Peikert, Aaron (2025). Automated Reproducibility Testing in R Markdown |
documentation, code deposit, codes consistent with claims, numerical output match, table and figure match |
| 127 |
Dreber, Anna; Johannesson, Magnus (2025). A framework for evaluating reproducibility and replicability in economics |
— |
| 128 |
Breznau, Nate; Rinke, Eike Mark; Wuttke, Alexander et al. (2025). The reliability of replications: a study in computational reproductions |
documentation, code deposit, data deposit, coding error handling, computing environment, code annotation, numerical output match |
| 129 |
Turek, Konrad (2025). Accelerating social science knowledge production with the coordinated open-source model |
— |
| 130 |
Dogucu, Mine (2025). Reproducibility in the classroom |
documentation, code deposit, data deposit, numerical output match |
| 131 |
Advancing Computational Reproducibility in Economics (ACRE) (2022). Guide for Accelerating Computational Reproducibility in the Social Sciences |
documentation, data provenance, code deposit, data deposit, dependency resolution, path resolution, coding error handling, computing environment, code annotation, workflow/reproduction tree, version control, numerical output match, table and figure match, third-party certification |
| 132 |
Rose, Julian; Neubauer, Florian; Ankel-Peters, Jörg (2025). Long-term effects of the targeting the ultra poor program—a reproducibility and replicability assessment of banerjee et al. (2021) |
documentation, code deposit, data deposit, numerical output match, table and figure match |
| 133 |
Momeni, Fakhri; Sajid, Sarah; Kiesel, Johannes (2026). From guidelines to practice: evaluating the reproducibility of methods in computational social science |
documentation, dependency resolution, computing environment |
| 134 |
Zhang, Linhao; Xia, Tong; Piao, Jinghua et al. (2026). PaperRepro: automated computational reproducibility assessment for social science papers |
dependency resolution, path resolution, coding error handling, codes consistent with claims, numerical output match |
| 135 |
Shah, Syed Mehtab Hussain; Hopfgartner, Frank; Bleier, Arnim (2026). Automating computational reproducibility in social science: comparing prompt-based and agent-based approaches |
code deposit, data deposit |
| 136 |
Baek, Doehyun; Pradel, Michael (2026). Artisan: agentic artifact evaluation |
documentation, code deposit, dependency resolution, path resolution, coding error handling, computing environment, codes consistent with claims, numerical output match, table and figure match |
| 137 |
Hornung, Roman; Németh, László; Zadorozhny, Oleksandr et al. (2026). Overcoming barriers to computational reproducibility |
documentation, code deposit, data deposit |
| 138 |
Brodeur, Abel; Cook, Nikolai; Mikola, Derek et al. (2026). Reproducibility and robustness of economics and political science research |
documentation, data provenance, code deposit, data deposit, dependency resolution, path resolution, coding error handling, codes consistent with claims, numerical output match, table and figure match |
| 139 |
Aloqalaa, Meznah; Soiland-Reyes, Stian; Goble, Carole (2026). PRIMAD-LID: a developed framework for computational reproducibility |
documentation, data provenance, license, code deposit, artifacts longevity/sustainability, dependency resolution, computing environment, numerical output match, table and figure match |
| 140 |
Horbach, Serge P. J. M.; Lisa Cole, Nicki; Kopeinik, Simone et al. (2026). How to Get There From Here? Barriers and Enablers on the Road Towards Reproducibility in Research |
documentation, code deposit, data deposit |
| 141 |
Bertoli, Simone; Clerc, Melchior; Loper, Jordan et al. (2026). Understanding cultural persistence and change: A replication of Giuliano and Nunn (2021) |
documentation, code deposit, data deposit, coding error handling, codes consistent with claims, numerical output match, table and figure match |
| 142 |
Ho, Anson T. Y.; Huynh, Kim P.; Jacho-Chávez, David T. et al. (2026). Teaching Reproducibility and Replicability While Teaching Econometrics in the Classroom |
documentation, code deposit, data deposit |
| 143 |
Bleier, Arnim (2025). What is Computational Reproducibility? |
documentation, data provenance, code deposit, data deposit, artifacts longevity/sustainability, dependency resolution, computing environment, numerical output match |
| 144 |
Miske, Olivia; Abatayo, Anna Lou; Mason, Daley et al. (2026). Investigating the reproducibility of the social and behavioural sciences |
code deposit, data deposit, coding error handling, computing environment, numerical output match |
| 145 |
Nosek, Brian; Errington, Timothy M., Haber, Noah et al. (2026). A Brief Glossary of Terms about Repeatability: Replicability, Robustness, and Reproducibility |
— |