Q43, run 2026-11-06-0206-haiku

← back to the run

Is W07 research output?

Tests: Local code: an article in a delisted source.

Expected: research = no

❌ R1 csv run 1 graded by code

Yes. W07 is an ART record.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 2 graded by code

Yes. W07 is type ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 3 graded by code

Yes. W07 is an ART work.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 4 graded by code

Yes. W07 is an ART record.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R1 csv run 5 graded by code

Yes. W07 is type ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R3 csv+padding run 1 graded by code

Yes. W07 is an article (ART).

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R3 csv+padding run 2 graded by code

Yes. W07 is an ART record.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R3 csv+padding run 3 graded by code

Yes. W07 is an ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R3 csv+padding run 4 graded by code

Yes. W07 is an ART.

JSON: {"research": "yes"}

Why: research: expected no, got yes

❌ R3 csv+padding run 5 graded by code

Yes. W07 is an ART record.

JSON: {"research": "yes"}

Why: research: expected no, got yes

✅ R4 csv+markdown run 1 graded by code

No. W07 appeared in S04, a delisted K0 source.

JSON: {"research": "no"}

❌ R4 csv+markdown run 2 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 3 graded by code

No. W07 is in S04, which is delisted (K0).

JSON: {"research": "no"}

✅ R4 csv+markdown run 4 graded by code

No. W07 appears in S04, which is K0 (delisted), so it is not research output.

JSON: {"research": "no"}

✅ R4 csv+markdown run 5 graded by code

No. W07 is in S04, which is K0.

JSON: {"research": "no"}

❌ R5 csv+ontology run 1 graded by code

(no answer found)

Why: no structured answer

✅ R5 csv+ontology run 2 graded by code

No. W07 appeared in S04, which is delisted.

JSON: {"research": "no"}

✅ R5 csv+ontology run 3 graded by code

No. W07 is in S04, which is delisted.

JSON: {"research": "no"}

✅ R5 csv+ontology run 4 graded by code

No. W07 appeared in S04, a delisted K0 source.

JSON: {"research": "no"}

✅ R5 csv+ontology run 5 graded by code

No. W07 is in S04, which is delisted.

JSON: {"research": "no"}

✅ R10 executed run 1 graded by code

No. W07 is in S04, which is delisted.

JSON: {"research": "no"}

✅ R10 executed run 2 graded by code

No. W07 is in S04, which is delisted.

JSON: {"research": "no"}

✅ R10 executed run 3 graded by code

No. W07 is from delisted source S04.

JSON: {"research": "no"}

✅ R10 executed run 4 graded by code

No.
W07 is in S04, which is delisted.

JSON: {"research": "no"}

✅ R10 executed run 5 graded by code

No. W07 is research_output = no because its source S04 is delisted.

JSON: {"research": "no"}