Q26, run 2026-11-06-0206-sonnet

← back to the run

Does W23 count towards Kesting University's research output?

Tests: Retractions: a retracted work is not research output.

Expected: counts = no

✅ R1 csv run 1 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

❌ R1 csv run 2 graded by code

Yes by my convention. W23 is an ART at I07 but is flagged `is_retracted`, so it would drop out if retractions are excluded.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R1 csv run 3 graded by code

Yes. W23 is an ART from I07 and is flagged retracted but not removed. I counted it, though this rests on my assumption about retractions.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

✅ R1 csv run 4 graded by code

No. W23 is retracted, so it is excluded under the assumption above.

JSON: {"counts": "no"}

✅ R1 csv run 5 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R3 csv+padding run 1 graded by code

No. W23 is flagged `is_retracted` = true.

JSON: {"counts": "no"}

❌ R3 csv+padding run 2 graded by code

Yes. W23 is retracted but remains a flagged article in the data. Whether to exclude it is a policy choice the data does not settle.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 3 graded by code

Yes. W23 is an ART from I07; its retraction flag does not change its type.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 4 graded by code

Yes. W23 is a retracted ART at I07 that is still a published record, so it counts. Excluding retractions would change that.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 5 graded by code

Yes. W23 is an article in I07's output, and its retraction is a flag rather than a document type. If you exclude retracted works, it drops out.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

✅ R4 csv+markdown run 1 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 2 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 3 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 4 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 5 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 1 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 2 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 3 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 4 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 5 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 1 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 2 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 3 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 4 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 5 graded by code

No. W23 is retracted, so it is not research output, even though it is credited to I07.

JSON: {"counts": "no"}