Skip to content
Demonstrator · items marked Example are invented · what exists today
E2ER

Templates · paper-review

Paper review

By E2ER contributors

Six reviewer specialists review a paper in parallel after a number check and a citation check; a three-rule verdict merges their reports.

PlannedRuns today as the review phase of the empirical template; running it on its own is plannedreview
Anyone can contribute. Improve this template Contribute a template
Input
A paper with the result files and bibliography it was written from
Output
Six reviewer reports and a verdict (accept, minor or major revision, reject)

Description

Data model
Discipline
General
Method family
Review
Design
not specified
Research stage
Review
Contributors
E2ER contributors (Software, Methodology)
Usage
not used in published research yet
Source
E2ER repository · src/core/strategist/runner.py · @3b91f0e
Record
template:paper-review · JSON

Solid tags are declared by the source or mapped from its terms; dashed tags are inferred by a published rule. Hover a tag for its provenance.

Steps

  1. 1
    number check
    Every number in the tables is compared with the result file it came from; failures block the review.
    check
  2. 2
    citation check
    Every citation must resolve in the bibliography and in OpenAlex, Semantic Scholar or Crossref.
    check
  3. 3
    review
    Each reviewer writes its own report: mechanism, technical, literature, writing, data and identification. The data reviewer is skipped for theoretical papers.
    mechanism_reviewertechnical_reviewerliterature_reviewerwriting_reviewerdata_revieweridentification_reviewer
    specialists, parallel
  4. 4
    verdict
    Three rules: a mechanism score below 5 fails the paper; any score below 4 rejects it; otherwise a weighted average decides (technical and identification weigh most).
    check

Versions and evaluations

Planned

No versions yet.

Adapt this template Evaluate this template Report a failure
Cite this template
Persistent identifiers planned 
@software{e2ercontributors2026e2erpaperreviewtemplate,
  title   = {E2ER paper review template},
  author  = {E2ER contributors},
  year    = {2026},
  note    = {E2ER template. Persistent identifier planned},
  url     = {https://e2er.org/templates/paper-review}
}

Connectors this template can use

What a run of this template can reach outside your machine, and what each sends out.

coarse referee reportplannedLeaves your machine: The paper's text

Checks on this template

  • ✓Output contracts · Every step produced the artifact it declared, in the declared form
    Required of every template.
  • ✓Execution reliability · Analysis code ran and wrote a parseable, non-empty result
    Required of every template.
  • –Numbers · Every number in tables and text matches the output of executed code
    Not applicable. This method produces no computed numbers to match.
  • ○Citations · Every reference resolves to an existing publication via OpenAlex, Semantic Scholar or Crossref
    Proposed. Proposed for the floor; runs log it but may not block on it.
  • ○Verbatim passages · Every claim about a source points to a passage found word for word in that source
    Proposed. Proposed for the floor; runs log it but may not block on it.

Runs of this template

No runs yet.