Skip to content
Demonstrator · items marked Example are invented · what exists today
E2ER

Evaluations · ev-0004

codebook-development@0.2.0: expert assessment test

Mean rubric score 3.8 of 5. Raters reported two failures: overlapping codes and missing exclusion criteria.

Example with invented dataskillexpert assessment

Record

block:        codebook-development@0.2.0
test:         expert assessment
material:     Three codebooks drafted with the skill, rated by three qualitative researchers against a shared rubric
model:        a named model and version
runs:         9 in total, 0 failed, 0 aborted
result:       Mean rubric score 3.8 of 5. Raters reported two failures: overlapping codes and missing exclusion criteria.
evaluator:    Ines Varga, contributor role "validation"
scope:        Interview studies in organisation science.
date:         2027-02-20

The record counts failed and aborted runs, because reporting only successful runs overstates performance.

Cite this evaluation record
Persistent identifiers planned
@software{inesvarga2027evaluationofcodebookdeve,
  title   = {Evaluation of codebook-development@0.2.0 (expert assessment)},
  author  = {Ines Varga},
  year    = {2027},
  note    = {E2ER evaluation record. Persistent identifier planned},
  url     = {https://e2er.org/evaluations/ev-0004}
}
Report a failure

Versions of codebook-development

0.2.0in reviewAdds exclusion criteria to every code.ev-0004
0.1.0deprecatedRetired; runs that used it keep citing it.

Add a record

Another corpus, model or test type needs its own record.

Evaluate this block