Skip to content
Demonstrator · items marked Example are invented · what exists today
E2ER

Evaluations · ev-0003

systematic-review@0.1.0: benchmark test

Recall of included studies 0.91; precision 0.62. Most misses were conference papers without abstracts.

Example with invented datatemplatebenchmark

Record

block:        systematic-review@0.1.0
test:         benchmark
material:     Search and screening of a published review, compared with its list of included studies
model:        a named model and version
runs:         10 in total, 1 failed, 0 aborted
result:       Recall of included studies 0.91; precision 0.62. Most misses were conference papers without abstracts.
evaluator:    Noor Haddad, contributor role "validation"
scope:        One review in one field; recall in other fields is untested.
date:         2027-03-03

The record counts failed and aborted runs, because reporting only successful runs overstates performance.

Cite this evaluation record
Persistent identifiers planned
@software{noorhaddad2027evaluationofsystematicre,
  title   = {Evaluation of systematic-review@0.1.0 (benchmark)},
  author  = {Noor Haddad},
  year    = {2027},
  note    = {E2ER evaluation record. Persistent identifier planned},
  url     = {https://e2er.org/evaluations/ev-0003}
}
Report a failure

Add a record

Another corpus, model or test type needs its own record.

Evaluate this block