Evaluations · ev-0001
qualitative-coding@0.3.1: stress test
Agreement with human coders stays above the declared threshold of 0.75 up to 11,000 words per transcript.
Example with invented datatemplatestress
Record
block: qualitative-coding@0.3.1 test: stress material: Interview corpus, 240 transcripts, coded by two humans model: a named model and version runs: 36 in total, 4 failed, 1 aborted result: Agreement with human coders stays above the declared threshold of 0.75 up to 11,000 words per transcript. breaking: Agreement falls below 0.75 at about 12,000 words. evaluator: Demo contributor, contributor role "validation" scope: Valid for this corpus; other corpora need their own record. date: 2027-02-14
The record counts failed and aborted runs, because reporting only successful runs overstates performance.