Q17, run 2026-11-06-0519-sonnet-query

← back to the run

Which of Mara Ellison's works are not research output because of their document type?

Tests: Document types: an editorial and an erratum, under two author records.

Expected: works = ['W04', 'W05', 'W271', 'W813', 'W936', 'W949']

✅ D1 sql run 1 graded by code · query session

W04, W271 and W936 are editorials, and W05, W813 and W949 are errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

❌ D1 sql run 2 graded by code · query session

W02, W663, W612 (preprints), W04, W271, W936 (editorials) and W05, W813, W949 (errata). W374 is excluded from this list because it is retracted, not because of its type.

JSON: {"works": ["W02", "W04", "W05", "W271", "W612", "W663", "W813", "W936", "W949"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W02', 'W04', 'W05', 'W271', 'W612', 'W663', 'W813', 'W936', 'W949']

❌ D1 sql run 3 graded by code · query session

Nine works are not research by document type. These are the editorials W04, W271, W936, the errata W05, W813, W949, and the preprints W02, W612, W663.

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949", "W02", "W612", "W663"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W04', 'W271', 'W936', 'W05', 'W813', 'W949', 'W02', 'W612', 'W663']

✅ D1 sql run 4 graded by code · query session

W04, W271 and W936 are editorials; W05, W813 and W949 are errata.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

❌ D1 sql run 5 graded by code · query session

W04, W612, W663, W271, W949, W02, W813, W05, W936. They are EDT, PPR and ERR types, which are not research output.

JSON: {"works": ["W04", "W612", "W663", "W271", "W949", "W02", "W813", "W05", "W936"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W04', 'W612', 'W663', 'W271', 'W949', 'W02', 'W813', 'W05', 'W936']

✅ D2 sql+markdown run 1 graded by code · query session

W04, W271 and W936 are editorials, and W05, W813 and W949 are errata. W07, W449 and W763 are also not research output, but because they appeared in delisted sources, not because of their type.

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949"]}

✅ D2 sql+markdown run 2 graded by code · query session

W04, W271 and W936 (editorials), and W05, W813 and W949 (errata).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

❌ D2 sql+markdown run 3 graded by code · query session

W04 (editorial) and W06 (erratum).

JSON: {"works": ["W04", "W06"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W04', 'W06']

✅ D2 sql+markdown run 4 graded by code · query session

W04, W05, W271, W813, W936 and W949. W04, W271 and W936 are editorials and W05, W813 and W949 are errata. W936 is recorded under A101, the same person.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D2 sql+markdown run 5 graded by code · query session

W04, W271 and W936 are editorials. W05, W813 and W949 are errata.

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949"]}

✅ D3 sql+executed run 1 graded by code · query session

W04, W05, W271, W813, W936 and W949. These are editorials and errata. W07, W449 and W763 are excluded because their sources are delisted, and W374 because it is retracted.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D3 sql+executed run 2 graded by code · query session

W04, W05, W271, W813, W936 and W949. These are editorials (EDT) and errata (ERR). W07, W374, W449 and W763 are excluded for other reasons (delisted source or retraction).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D3 sql+executed run 3 graded by code · query session

W04, W05, W271, W813, W936 and W949, which are editorials and errata. W07, W449 and W763 fail because their sources are delisted, and W374 because it is retracted, so none of those is a document-type exclusion.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D3 sql+executed run 4 graded by code · query session

W04, W05, W271, W813, W936 and W949. These are editorials and errata. Her other non-research works are excluded for other reasons: W07, W449 and W763 are in delisted sources, and W374 is retracted.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D3 sql+executed run 5 graded by code · query session

W271, W05, W936, W04, W813, W949. These are editorials and errata. Other non-research works of hers (e.g. W07, W374) are excluded for other reasons, such as a delisted source or retraction.

JSON: {"works": ["W271", "W05", "W936", "W04", "W813", "W949"]}

✅ D4 sparql run 1 graded by code · query session

W04, W05, W271, W813, W936 and W949. They are editorials (EDT) and errata (ERR).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D4 sparql run 2 graded by code · query session

The editorials W04, W271 and W936, and the errata W05, W813 and W949, by document type.

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949"]}

✅ D4 sparql run 3 graded by code · query session

W04, W271, W936 (editorials) and W05, W813, W949 (errata).

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949"]}

❌ D4 sparql run 4 graded by code · query session

W02, W612, W663 (preprints), W04, W271, W936 (editorials) and W05, W813, W949 (errata).

JSON: {"works": ["W02", "W04", "W05", "W271", "W612", "W663", "W813", "W936", "W949"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W02', 'W04', 'W05', 'W271', 'W612', 'W663', 'W813', 'W936', 'W949']

❌ D4 sparql run 5 graded by code · query session

W04 (editorial), W271 (editorial), W05, W813 and W949 (errata). W374 is retracted, but that is not a document-type reason.

JSON: {"works": ["W04", "W271", "W05", "W813", "W949"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W04', 'W271', 'W05', 'W813', 'W949']

✅ D5 sparql+ontology run 1 graded by code · query session

W04, W05, W271, W813, W936 and W949, which are editorials and errata. The list may be incomplete because the result was truncated.

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

❌ D5 sparql+ontology run 2 graded by code · query session

W04 (editorial) and W05 (erratum). Any further non-research items on A101 were not visible.

JSON: {"works": ["W04", "W05"]}

Why: works: expected ['W04', 'W05', 'W271', 'W813', 'W936', 'W949'], got ['W04', 'W05']

✅ D5 sparql+ontology run 3 graded by code · query session

W04 (EDT), W05 (ERR), W271 (EDT), W813 (ERR), W936 (EDT), W949 (ERR).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D5 sparql+ontology run 4 graded by code · query session

The non-research works by document type are W04 and W271 and W936 (editorials), and W05, W813 and W949 (errata).

JSON: {"works": ["W04", "W05", "W271", "W813", "W936", "W949"]}

✅ D5 sparql+ontology run 5 graded by code · query session

W04, W271, W936 (editorials) and W05, W813, W949 (errata).

JSON: {"works": ["W04", "W271", "W936", "W05", "W813", "W949"]}