Q2, run 2026-11-05-1234-sonnet

← back to the run

List every work, of any type, that Mara Ellison (A01) is an author of.

Tests: Identity: her works are spread over three author records, and A04's works (W08, W16) are not hers.

Expected: works = ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

✅ R1 csv run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. This takes A01, A02 and A03 together as one person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R1 csv run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These come from A01 (W01, W04, W05, W06, W12), A02 (W02, W07, W19) and A03 (W03).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R1 csv run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Mara Ellison's records A01, A02 (W02, W07, W19) and A03 (W03) are the same person. A04's W08 and W16 are not hers.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R1 csv run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 (W02, W07, W19) and A03 (W03).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R1 csv run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works under A01, A02 and A03, the same person. W08 and W16 belong to A04, a different person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R2 rdf run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19, across A01, A02 and A03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R2 rdf run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01 authored W01, W04, W05, W06 and W12. The aliases A02 (W02, W07, W19) and A03 (W03) are the same person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R2 rdf run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the authorships of A01 (W01, W04, W05, W06, W12), A02 (W02, W07, W19) and A03 (W03).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R2 rdf run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, who are one person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R2 rdf run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01 (W01, W04, W05, W06, W12), A02 (W02, W07, W19) and A03 (W03). A04's works (W08, W16) are excluded.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01 wrote W01, W04, W05, W06 and W12, A02 wrote W02, W07 and W19, and A03 wrote W03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. Records A01, A02 and A03 are the same person and cover all nine.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works recorded against A01, A02 and A03, which are the same person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01 covers W01, W04, W05, W06 and W12, A02 covers W02, W07 and W19, and A03 covers W03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R6 rdf+ontology run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01 has W01, W04, W05, W06, W12, A02 has W02, W07, W19, and A03 has W03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works recorded against A01, A02 and A03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are all the works with an authorship by A01, A02 or A03, whatever the type.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These come from records A01, A02 and A03, which are the same person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works on A01, A02 and A03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R5 csv+ontology run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works on A01, A02 and A03 (same person); W08 and W16 belong to A04, a different person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. A01, A02 and A03 are the same person, so their works all count. A04 has a different ORCID and is excluded.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03 combined.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 3 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03 together.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 4 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, the same person. A04's W08 and W16 are not hers.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R4 csv+markdown run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, which are one person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R3 csv+padding run 1 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19 (A01, A02 and A03 combined).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R3 csv+padding run 2 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, who are the same person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R3 csv+padding run 3 graded by code

W01–W07, W12 and W19. These are A01's records (W01, W04, W05, W06, W12), A02's (W02, W07, W19) and A03's (W03).

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R3 csv+padding run 4 graded by code

Nine works: W01, W02, W03, W04, W05, W06, W07, W12, W19. A01, A02 and A03 are one person, and W02, W07 and W19 sit under A02 and W03 under A03.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

✅ R3 csv+padding run 5 graded by code

W01, W02, W03, W04, W05, W06, W07, W12, W19. These are the works of A01, A02 and A03, who are one person.

JSON: {"works": ["W01", "W02", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

❌ R10 executed run 1 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are A01's credits, and W03 includes the merged record W02.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 2 graded by code

W01, W03, W04, W05, W06, W07, W12, W19 (credits for A01).

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 3 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are the works credited to A01. W03 also merges W02.

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 4 graded by code

W01, W03, W04, W05, W06, W07, W12, W19. These are all the credits to A01 (W03 also merges W02).

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']

❌ R10 executed run 5 graded by code

W01, W03, W04, W05, W06, W07, W12, W19 (A01's credits).

JSON: {"works": ["W01", "W03", "W04", "W05", "W06", "W07", "W12", "W19"]}

Why: works: expected ['W01', 'W02', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19'], got ['W01', 'W03', 'W04', 'W05', 'W06', 'W07', 'W12', 'W19']