Q43, run 2026-11-04-2035-haiku

← back to the run

Is W07 research output?

Tests: Local code: an article in a delisted source.

Expected: research = no

❌ R1 csv run 1 graded by code

Yes. W07 is an ART in S04.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 2 graded by code

Yes. **Reasoning:** W07 is typed ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 3 graded by code

Yes. W07 is an article (ART).

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 4 graded by code

Yes. W07 is an ART record, not retracted.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 5 graded by code

Yes. W07 is an ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

✅ R10 executed run 1 graded by code

No. W07's research_output is no because its source S04 is delisted.

JSON: {"research": "no"}

✅ R10 executed run 2 graded by code

No. W07 is in delisted source S04, so research_output is "no".

JSON: {"research": "no"}

✅ R10 executed run 3 graded by code

No. W07 is in delisted source S04 and is marked research_output "no".

JSON: {"research": "no"}

✅ R10 executed run 4 graded by code

No. W07's source S04 is delisted.

JSON: {"research": "no"}

✅ R10 executed run 5 graded by code

No. W07's research_output is "no" (S04 is delisted).

JSON: {"research": "no"}