Q17, run 2026-11-04-2035-haiku

← back to the run

Which of Mara Ellison's works are not research output because of their document type?

Tests: Document types: an editorial and an erratum, under two author records.

Expected: works = ['W04', 'W05']

✅ R1 csv run 1 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 2 graded by code

W04, W05. **Reasoning:** W04 is an editorial (EDT) and W05 is an erratum (ERR), so neither is research output.

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 3 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 4 graded by code

W04 (EDT, editorial) and W05 (ERR, erratum).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 5 graded by code

W04 (EDT) and W05 (ERR). A02 and A03's works are all ART or PPR.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 1 graded by code

W04 and W05 (editorial and erratum types). W07 is excluded because its source S04 is delisted, not because of its type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 2 graded by code

W04 and W05. These are research_output "no" because of document type (EDT, ERR). W07 is excluded because its source is delisted, not because of type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 3 graded by code

W04 (EDT) and W05 (ERR). W07 is excluded for its delisted source, not its type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 4 graded by code

W04 (EDT, editorial) and W05 (ERR, erratum). W07 is excluded for source reasons, not type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 5 graded by code

W04 and W05. These are the editorial and the erratum. W07 is excluded for its delisted source, not its type.

JSON: {"works": ["W04", "W05"]}