Q1, run 2026-11-04-2035-haiku

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 2

❌ R1 csv run 1 graded by code

1 distinct person. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 2 graded by code

One person. **Reasoning:** A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 "M. Ellison" has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 5 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R10 executed run 1 graded by code

2 people (A01 and A04). "Mara Ellison" is person A01, which merges A01, A02 and A03; "M. Ellison" is A04 alone. The name "Ellison, Mara J." does not appear in people.csv, so I can't confirm which record it is.

JSON: {"count": 2}

✅ R10 executed run 2 graded by code

2 people (A01 and A04). A01 covers A01, A02 and A03, and A04 is separate because its ORCID differs. "Ellison, Mara J." does not appear by name in the data, so I could not confirm it is one of A02/A03.

JSON: {"count": 2}

✅ R10 executed run 3 graded by code

2 people: A01 (Mara Ellison) and A04 (M. Ellison). Their ORCIDs differ. "Ellison, Mara J." has no record in people.csv, so it can't be placed, though it may be a variant of A01 (whose author_ids include A02 and A03).

JSON: {"count": 2}

✅ R10 executed run 4 graded by code

Two people: A01 (Mara Ellison, merging A01–A03) and A04 (M. Ellison). They have different ORCIDs, and "Ellison, Mara J." does not appear in the data, so I can't place it. (people.csv)

JSON: {"count": 2}

✅ R10 executed run 5 graded by code

2. A01 (Mara Ellison, with A02 and A03 merged in) and A04 (M. Ellison) are separate people. "Ellison, Mara J." appears nowhere in people.csv, so the data cannot confirm it belongs to A01.

JSON: {"count": 2}