Q17, run 2026-11-05-1234-sonnet

← back to the run

Which of Mara Ellison's works are not research output because of their document type?

Tests: Document types: an editorial and an erratum, under two author records.

Expected: works = ['W04', 'W05']

✅ R1 csv run 1 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 2 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 3 graded by code

W04 (editorial, EDT) and W05 (erratum, ERR).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 4 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

✅ R1 csv run 5 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

❌ R2 rdf run 1 graded by code

W02 (preprint), W04 (editorial), W05 (erratum).

JSON: {"works": ["W02", "W04", "W05"]}

Why: works: expected ['W04', 'W05'], got ['W02', 'W04', 'W05']

❌ R2 rdf run 2 graded by code

W02 (PPR), W04 (EDT), W05 (ERR).

JSON: {"works": ["W02", "W04", "W05"]}

Why: works: expected ['W04', 'W05'], got ['W02', 'W04', 'W05']

❌ R2 rdf run 3 graded by code

W02 (preprint), W04 (editorial) and W05 (erratum).

JSON: {"works": ["W02", "W04", "W05"]}

Why: works: expected ['W04', 'W05'], got ['W02', 'W04', 'W05']

❌ R2 rdf run 4 graded by code

W02 (preprint), W04 (editorial), W05 (erratum).

JSON: {"works": ["W02", "W04", "W05"]}

Why: works: expected ['W04', 'W05'], got ['W02', 'W04', 'W05']

✅ R2 rdf run 5 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R6 rdf+ontology run 1 graded by code

W04 (editorial) and W05 (erratum). W07 is excluded for its delisted source, not its type.

JSON: {"works": ["W04", "W05"]}

✅ R6 rdf+ontology run 2 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R6 rdf+ontology run 3 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R6 rdf+ontology run 4 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R6 rdf+ontology run 5 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R5 csv+ontology run 1 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R5 csv+ontology run 2 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R5 csv+ontology run 3 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R5 csv+ontology run 4 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R5 csv+ontology run 5 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R4 csv+markdown run 1 graded by code

W04 (editorial) and W05 (erratum). W07 is excluded because its source is delisted, not because of its type.

JSON: {"works": ["W04", "W05"]}

✅ R4 csv+markdown run 2 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R4 csv+markdown run 3 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R4 csv+markdown run 4 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R4 csv+markdown run 5 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R3 csv+padding run 1 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R3 csv+padding run 2 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R3 csv+padding run 3 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R3 csv+padding run 4 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

✅ R3 csv+padding run 5 graded by code

W04 (editorial) and W05 (erratum).

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 1 graded by code

W04 (editorial) and W05 (erratum). W07 is excluded for a different reason, its delisted source.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 2 graded by code

W04 (EDT) and W05 (ERR).

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 3 graded by code

W04 (editorial) and W05 (erratum). W07 is excluded because its source is delisted, not because of its type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 4 graded by code

W04 (editorial) and W05 (erratum). W07 is excluded for its delisted source, not its type.

JSON: {"works": ["W04", "W05"]}

✅ R10 executed run 5 graded by code

W04 (editorial) and W05 (erratum). W07 fails because its source S04 is delisted, not because of its type.

JSON: {"works": ["W04", "W05"]}