Q2, run 2026-11-05-1235-haiku

← back to the run

List every work, of any type, that Mara Ellison (A01) is an author of.

Tests: Identity: her works are spread over three author records, and A04's works (W08, W16) are not hers.

Expected: works = ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R1 csv run 1 graded by code

W01, W04, W05, W06, W12. These are the works with A01 in authorships.csv.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R1 csv run 2 graded by code

W01, W04, W05, W06, W12.
*Reasoning:* These are the authorship rows with A01 (W02, W03 and W07 are A02/A03, so they are excluded by ID).

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R1 csv run 3 graded by code

W01, W04, W05, W06, W12. These are the A01 authorship rows. A02 and A03 (same ORCID) add W02, W03, W07 and W19.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R1 csv run 4 graded by code

W01, W04, W05, W06, W12. These are the works in authorships.csv with A01.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R1 csv run 5 graded by code

W01, W04, W05, W06, W12. These are all of A01's authorships. W04 and W05 are of type EDT and ERR.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R2 rdf run 1 graded by code

W01, W04, W05, W06, W12. These are all the works with an AS record linking A01.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R2 rdf run 2 graded by code

W01, W04, W05, W06, W12. These are the works with an authorship record for A01.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R2 rdf run 3 graded by code

W01, W04, W05, W06, W12. These are the works of A01 in AS-W01-A01-1, AS-W04-A01-1, AS-W05-A01-1, AS-W06-A01-1 and AS-W12-A01-1.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R2 rdf run 4 graded by code

W01, W04, W05, W06, W12. These are all of A01's authorship records, of any type.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R2 rdf run 5 graded by code

W01, W04, W05, W06, W12. These are the works with authorship records AS-W01-A01-1, AS-W04-A01-1, AS-W05-A01-1, AS-W06-A01-1 and AS-W12-A01-1.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

✅ R6 rdf+ontology run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are all the works on authorship records A01, A02 and A03, which are the same person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of all three records for that ORCID (A01, A02, A03), since the same person's records count together. Restricted to the A01 record alone, the list would be W01, W04, W05, W06, W12.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Authorships on A01 (W01, W04, W05, W06, W12), A02 (W02, W07, W19) and A03 (W03) all belong to the same ORCID, so they are one person's works.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are A01's works, plus A02's (W02, W07, W19) and A03's (W03), since all three records share one ORCID.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These include A02's and A03's records, which carry Mara Ellison's ORCID and so belong to the same person as A01.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are all works on records A01, A02 and A03 (same ORCID). A04 has a different ORCID and is excluded.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Under the ORCID rule, Mara Ellison's works include those of A02 (W02, W07, W19) and A03 (W03) as well as A01's own (W01, W04, W05, W06, W12).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Per the ORCID rule I included A02's and A03's works, which are the same person as A01 (W02, W07, W19 via A02; W03 via A03). If you meant the A01 record alone, the list is W01, W04, W05, W06, W12.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Per the ontology, every work recorded against any record with ORCID 0000-0002-9841-6229 (A01, A02, A03) is hers.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01, A02 and A03 share an ORCID and so are one person; A04 has a different ORCID and is excluded.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, which are one person by ORCID.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of all three records of the same ORCID (A01, A02, A03), counted as one person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01 and of A02 and A03, which share her ORCID. "Any type" means preprints, editorials and errata are included.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Person-level: A01, A02 and A03 are one person. W02 is a preprint of W03, but both records are listed because the question asks for any type.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Counted by person (ORCID), so A02's W02, W07, W19 and A03's W03 are included. A01's records alone are W01, W04, W05, W06, W12.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

❌ R3 csv+padding run 1 graded by code

W01, W04, W05, W06, W12. These are all of A01's authorship rows.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R3 csv+padding run 2 graded by code

W01, W04, W05, W06, W12. These are all of A01's authorship rows, including the editorial W04 and erratum W05.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R3 csv+padding run 3 graded by code

W01, W04, W05, W06, W12. These are A01's authorship rows, of any type.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

❌ R3 csv+padding run 4 graded by code

W01, W04, W05, W06, W12. These are A01's authorships; A02 and A03 are the same person by ORCID and add W02, W03, W07, W19.

JSON: {"works": ["W01", "W04", "W05", "W06", "W12"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W04', 'W05', 'W06', 'W12']

✅ R3 csv+padding run 5 graded by code

Nine works across A01, A02 and A03: W01, W02, W03, W04, W05, W06, W07, W12, W19. The A01 record alone gives W01, W04, W05, W06, W12.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

❌ R10 executed run 1 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are every work with a credit to A01 in credits.csv.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 2 graded by code

Eight works: W01, W03, W04, W05, W06, W07, W12 and W19, all credited to A01 in credits.csv.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 3 graded by code

Eight works: W01, W03, W04, W05, W06, W07, W12, W19, all credited to A01.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 4 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are all works credited to A01 in credits.csv.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 5 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are the works with credit to A01.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']