Q17, run 2026-11-06-0206-sonnet

← back to the run

Which of Mara Ellison's works are not research output because of their document type?

Tests: Document types: an editorial and an erratum, under two author records.

Expected: works = ['W04', 'W05', 'W271', 'W813', 'W936', 'W949']

✅ R1 csv run 1 graded by code

W04, W05, W271, W813, W936 and W949. They are editorials (EDT) and errata (ERR).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R1 csv run 2 graded by code

W04, W05, W271, W813, W936 and W949. The first, third and fifth are EDT; the others are ERR.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R1 csv run 3 graded by code

W04, W05, W271, W813, W936 and W949 are editorials or errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R1 csv run 4 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R1 csv run 5 graded by code

W04, W05, W271, W813, W936 and W949. These are the editorials and errata. W374 is excluded for being retracted, not for its type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R3 csv+padding run 1 graded by code

W04, W05, W271, W813, W936, W949. W04, W271 and W936 are editorials, and W05, W813 and W949 are errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R3 csv+padding run 2 graded by code

W04, W05, W271, W813, W936 and W949 (editorials and errata).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R3 csv+padding run 3 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R3 csv+padding run 4 graded by code

W04, W05, W271, W813, W936 and W949. W04, W271 and W936 are editorials; W05, W813 and W949 are errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R3 csv+padding run 5 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials (EDT) and errata (ERR).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R4 csv+markdown run 1 graded by code

W04, W05, W271, W813, W936 and W949. These are the editorials (EDT) and errata (ERR) among her works.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R4 csv+markdown run 2 graded by code

W04, W05, W271, W813, W936 and W949 are editorials and errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R4 csv+markdown run 3 graded by code

W04, W05 and W271 are editorials, and W813, W936 and W949 are errata. W07, W374, W449 and W763 fail for other reasons (delisted source, retraction), not document type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R4 csv+markdown run 4 graded by code

W04, W05, W271, W813, W936 and W949 are editorials or errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R4 csv+markdown run 5 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R5 csv+ontology run 1 graded by code

W04, W05, W271, W813, W936 and W949 (editorials and errata). W07 and W449 are excluded as K0, and W374 as retracted, not by type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R5 csv+ontology run 2 graded by code

W04, W05, W271, W813, W936, W949. These are editorials (EDT) and errata (ERR).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R5 csv+ontology run 3 graded by code

The six non-research types are W04, W05, W271, W813, W936 and W949 (editorials and errata).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R5 csv+ontology run 4 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata. W07, W374 and W763 are excluded for other reasons.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R5 csv+ontology run 5 graded by code

W04, W05, W271, W813, W936 and W949. The editorials are W04, W271 and W936; the errata are W05, W813 and W949.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R10 executed run 1 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata. Her other non-research works (W07, W374, W449, W763) are excluded for other reasons (delisted source or retraction).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R10 executed run 2 graded by code

W04, W05, W271, W813, W936 and W949 (editorials and errata). W07, W374, W449 and W763 fail for other reasons: a delisted source or a retraction.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R10 executed run 3 graded by code

W04, W05, W271, W813, W936 and W949. These are editorials and errata. W07, W374, W449 and W763 are excluded for other reasons (delisted source or retraction), not document type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R10 executed run 4 graded by code

W04, W05, W271, W813, W936 and W949 are editorials or errata. W07, W374, W449 and W763 fail for other reasons (delisted source or retraction), not document type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ R10 executed run 5 graded by code

W04, W05, W271, W813, W936 and W949 are editorials or errata. W07 and W449 are excluded because of their delisted source, and W374 because it was retracted, not because of their type.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}