Q26, run 2026-11-05-1234-sonnet

← back to the run

Does W23 count towards Kesting University's research output?

Tests: Retractions: a retracted work is not research output.

Expected: counts = no

❌ R1 csv run 1 graded by code

Depends. W23 is an ART from I07, but it is flagged `is_retracted`, and the data gives no rule for retractions.

JSON: {"counts": "depends"}

Why: counts: expected no, got depends

❌ R1 csv run 2 graded by code

Depends. W23 is an article credited to I07, but it is flagged `is_retracted`, and the data doesn't say whether retractions are excluded.

JSON: {"counts": "depends"}

Why: counts: expected no, got depends

❌ R1 csv run 3 graded by code

Depends. W23 is an article but is flagged `is_retracted=true`, and the data gives no rule on whether retracted works count. My counts above include it.

JSON: {"counts": "depends"}

Why: counts: expected no, got depends

✅ R1 csv run 4 graded by code

No. W23 is flagged `is_retracted`, so I excluded it. The data gives no explicit rule, so this is a convention.

JSON: {"counts": "no"}

✅ R1 csv run 5 graded by code

No. W23 is flagged `is_retracted`. This rests on a retracted-work exclusion that the data does not define.

JSON: {"counts": "no"}

❌ R2 rdf run 1 graded by code

Yes. W23 is an article, and its retracted flag does not change its type. The data does not say retractions are excluded.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R2 rdf run 2 graded by code

Yes. W23 is an ART record. The retraction flag does not change its type, and the data states no exclusion rule. Some analyses may exclude it.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R2 rdf run 3 graded by code

Yes. W23 is an article; the retraction flag does not change its type, though a stricter policy might exclude it.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

✅ R2 rdf run 4 graded by code

No. W23 is flagged retracted, which I treated as excluded.

JSON: {"counts": "no"}

❌ R2 rdf run 5 graded by code

Yes. W23 is a retracted article, but the data has no rule excluding retracted works.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

✅ R6 rdf+ontology run 1 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R6 rdf+ontology run 2 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R6 rdf+ontology run 3 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R6 rdf+ontology run 4 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R6 rdf+ontology run 5 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 1 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 2 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 3 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 4 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}

✅ R5 csv+ontology run 5 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 1 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 2 graded by code

No, because W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 3 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 4 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

✅ R4 csv+markdown run 5 graded by code

No. W23 is retracted.

JSON: {"counts": "no"}

❌ R3 csv+padding run 1 graded by code

Yes. W23 is a retracted ART, still counted but flagged (`is_retracted` = true).

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 2 graded by code

Depends. W23 is an ART from I07, but it is retracted, and the data gives no rule on whether retracted works count. I counted it in the numbers above.

JSON: {"counts": "depends"}

Why: counts: expected no, got depends

❌ R3 csv+padding run 3 graded by code

Yes. W23 is an ART from I07, and its retraction flag does not change its type, though some counts might exclude retracted works.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 4 graded by code

Yes. W23 is a retracted article, but nothing in the data excludes retracted works from the count.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

❌ R3 csv+padding run 5 graded by code

Yes. W23 is a published article, though it is flagged `is_retracted`. A policy that excludes retracted works would change this.

JSON: {"counts": "yes"}

Why: counts: expected no, got yes

✅ R10 executed run 1 graded by code

No. W23 is retracted and not research output. Its citing work W39 isn't counted either.

JSON: {"counts": "no"}

✅ R10 executed run 2 graded by code

No. W23 is retracted and is not research output.

JSON: {"counts": "no"}

✅ R10 executed run 3 graded by code

No. W23 is retracted and not research output.

JSON: {"counts": "no"}

✅ R10 executed run 4 graded by code

No. W23 is retracted and not research output.

JSON: {"counts": "no"}

✅ R10 executed run 5 graded by code

No. W23 is retracted, so it is not research output.

JSON: {"counts": "no"}