Q1, run 2026-11-06-0206-sonnet

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 3

✅ R1 csv run 1 graded by code

3. Four of the six name-matching records (A01, A02, A03, A101) share ORCID 0000-0002-9841-6229. A04 and A102 each have a different ORCID.

JSON: {"count": 3}

✅ R1 csv run 2 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. A04 (…8662-8360) and A102 (…4738-8328) are different people.

JSON: {"count": 3}

✅ R1 csv run 3 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. The other "M. Ellison" records A04 and A102 have different ORCIDs.

JSON: {"count": 3}

✅ R1 csv run 4 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. The "M. Ellison" records A04 and A102 carry different ORCIDs.

JSON: {"count": 3}

✅ R1 csv run 5 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. A04 (…8662-8360) and A102 (…4738-8328) are two other people.

JSON: {"count": 3}

✅ R3 csv+padding run 1 graded by code

3. The ORCID 0000-0002-9841-6229 covers A01, A02, A03 and A101, and A04 and A102 are different ORCIDs.

JSON: {"count": 3}

❌ R3 csv+padding run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

✅ R3 csv+padding run 3 graded by code

3. The ORCIDs are 0000-0002-9841-6229 (A01, A02, A03, A101), 0000-0004-8662-8360 (A04) and 0000-0008-4738-8328 (A102).

JSON: {"count": 3}

✅ R3 csv+padding run 4 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. A04 (…8662-8360) and A102 (…4738-8328) are different people.

JSON: {"count": 3}

✅ R3 csv+padding run 5 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. A04 (…8662-8360) and A102 (…4738-8328) are different people.

JSON: {"count": 3}

✅ R4 csv+markdown run 1 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229. The other "M. Ellison" records, A04 (…8662-8360) and A102 (…4738-8328), are different people.

JSON: {"count": 3}

❌ R4 csv+markdown run 2 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R4 csv+markdown run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R4 csv+markdown run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R4 csv+markdown run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R5 csv+ontology run 1 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R5 csv+ontology run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R5 csv+ontology run 3 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R5 csv+ontology run 4 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 3, got 1

❌ R5 csv+ontology run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 3, got 1

✅ R10 executed run 1 graded by code

3 people. "Mara Ellison" is A01, and "M. Ellison" is two separate people (A04, A102, different ORCIDs). The data has no author-record names, so I assumed "Ellison, Mara J." is a variant of A01.

JSON: {"count": 3}

✅ R10 executed run 2 graded by code

3. The data has Mara Ellison (A01), M. Ellison (A04) and M. Ellison (A102), with three different ORCIDs. "Ellison, Mara J." matches no person record, so I can't place it.

JSON: {"count": 3}

✅ R10 executed run 3 graded by code

3. The people table has Mara Ellison (A01, which merges A01–A03 and A101), M. Ellison (A04) and M. Ellison (A102), each with a different ORCID. "Ellison, Mara J." is not a person record, so I took it to be one of the author records merged into A01.

JSON: {"count": 3}

✅ R10 executed run 4 graded by code

3. The people table lists Mara Ellison (A01), M. Ellison (A04) and M. Ellison (A102) as separate people with different ORCIDs; "Ellison, Mara J." is not a name in the people table, so I treated it as one of the records merged into A01.

JSON: {"count": 3}

✅ R10 executed run 5 graded by code

3 people. "Mara Ellison" and "Ellison, Mara J." look like variants of A01. "M. Ellison" is two separate people, A04 and A102, with different ORCIDs. No record is named "Ellison, Mara J.", so that variant is inferred, not shown.

JSON: {"count": 3}