Code runs without manual intervention

Tier 2 · Executable - Silver recommended

The full analysis runs from a single entry point (e.g. a master script or Makefile) in the correct order and non-interactively, with no manual steps, GUI clicks or copying of results between scripts.

Rating

Met

A single entry point (e.g. a master script, Makefile, Quarto/R Markdown document, or one command stated in the README) runs the full analysis in the correct order, non-interactively, with no manual steps, GUI clicks, prompts or copying of results between scripts.

Partially met

All steps are scripted, but they must be launched one by one in an order given in the README, or a few documented manual steps remain (e.g. setting the working directory, uncommenting a line, answering an interactive prompt).

Not met

No run order is given, and/or the analysis depends on undocumented manual steps such as GUI menu operations or hand-copying intermediate results between scripts or into the manuscript.

Based on: #117 non-interactive, no GUI functions, #46 results inserted on rendering (vs. copied by hand), #122 inexecutable = irreproducible.

Not applicable

Never.

Prerequisites

Check order: 0

Builds on

No core prerequisites.

Prerequisite for

Numerical output match (1 source)
Table and figure match (1 source)

In the corpus

Sources	Injunctive	Descriptive	Tacit	Automatable	Manual check	Automation unclear	LLM sources
4	50%	0%	50%	100%	0%	0%	2

Text evidence (4 quotes)

Show quotes

#46 Reproducible research in R: a tutorial on how to do the same thing more than once · tacit

“Upon rendering the document, the code blocks are executed, and their output is dynamically inserted into the document.” (p. 839)

#116 AutoReproduce: automatic AI experiment reproduction with paper lineage · tacit

“We assess the generated code by measuring its execution rate (Exec Rate) and the final experimental performance (Perf Gap)” (p.7, lines 8–10)

#117 Computational reproducibility of R code supplements on OSF · injunctive

“Finally, to support execution in automated or containerised environments, scripts should run non-interactively and avoid GUI-based functions in favor of programmatic alternatives, enabling full execution without manual intervention.” (p. 4)

#122 AIRepr: an analyst-inspector framework for evaluating reproducibility of LLMs in data science · injunctive

“Solutions with inexecutable code are automatically marked as inaccurate and irreproducible.” (p.10174)