Q1, run 2026-11-06-0206-haiku

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 3

✅ R1 csv run 1 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, while A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) have different ORCIDs.

JSON: {"count": 3}

✅ R1 csv run 2 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, A04 has 0000-0004-8662-8360, and A102 has 0000-0008-4738-8328.

JSON: {"count": 3}

✅ R1 csv run 3 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 and A102 have their own ORCIDs (0000-0004-8662-8360 and 0000-0008-4738-8328).

JSON: {"count": 3}

✅ R1 csv run 4 graded by code

Three distinct people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, while A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) each have their own ORCID.

JSON: {"count": 3}

✅ R1 csv run 5 graded by code

(no answer found)

JSON: {"count": 3}

❌ R3 csv+padding run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. (A04 and A102 are other "M. Ellison" records with different ORCIDs.)

JSON: {"count": 1}

Why: count: expected 3, got 1

✅ R3 csv+padding run 2 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, A04 has 0000-0004-8662-8360, and A102 has 0000-0008-4738-8328.

JSON: {"count": 3}

✅ R3 csv+padding run 3 graded by code

3. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 and A102 have different ORCIDs.

JSON: {"count": 3}

✅ R3 csv+padding run 4 graded by code

(no answer found)

JSON: {"count": 3}

✅ R3 csv+padding run 5 graded by code

3 distinct people by ORCID. A01, A02, A03 and A101 share 0000-0002-9841-6229; A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) are separate. Name strings alone can't settle this.

JSON: {"count": 3}

✅ R4 csv+markdown run 1 graded by code

3 people. The name-matched records split by ORCID: 0000-0002-9841-6229 (A01, A02, A03, A101), 0000-0004-8662-8360 (A04) and 0000-0008-4738-8328 (A102).

JSON: {"count": 3}

✅ R4 csv+markdown run 2 graded by code

3 people. The three names match A01, A02, A03, A04, A101 and A102, which carry three ORCIDs: 0000-0002-9841-6229 (A01, A02, A03, A101), 0000-0004-8662-8360 (A04) and 0000-0008-4738-8328 (A102).

JSON: {"count": 3}

✅ R4 csv+markdown run 3 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) are two other people named "M. Ellison".

JSON: {"count": 3}

✅ R4 csv+markdown run 4 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) each stand for someone else.

JSON: {"count": 3}

✅ R4 csv+markdown run 5 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 (0000-0004-8662-8360) and A102 (0000-0008-4738-8328) each have their own ORCID.

JSON: {"count": 3}

✅ R5 csv+ontology run 1 graded by code

3 people. Records A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, A04 has 0000-0004-8662-8360, and A102 has 0000-0008-4738-8328.

JSON: {"count": 3}

❌ R5 csv+ontology run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 3, got 1

✅ R5 csv+ontology run 3 graded by code

3 people. A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229, A04 has a different ORCID, and A102 has a third. Citing only A01 as the person would be 1; the name alone does not settle it.

JSON: {"count": 3}

❌ R5 csv+ontology run 4 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 3, got 1

✅ R5 csv+ontology run 5 graded by code

3 people. Records A01, A02, A03 and A101 share ORCID 0000-0002-9841-6229; A04 and A102 have their own ORCIDs.

JSON: {"count": 3}

✅ R10 executed run 1 graded by code

3 people: A01, A04 and A102. "Ellison, Mara J." has no record in people.csv, so it adds nothing. A01 and A04 have different ORCIDs, and A102 is separate too.

JSON: {"count": 3}

✅ R10 executed run 2 graded by code

3 people. The "M. Ellison" records are two different people (A04 and A102, with different ORCIDs), and "Ellison, Mara J." has no record in people.csv, so it cannot be placed. A01 is Mara Ellison.

JSON: {"count": 3}

✅ R10 executed run 3 graded by code

3. Mara Ellison (A01), M. Ellison (A04) and M. Ellison (A102) are three people. No "Ellison, Mara J." record appears in people.csv.

JSON: {"count": 3}

✅ R10 executed run 4 graded by code

3 person records (A01, A04, A102).
Mara Ellison is A01; the two "M. Ellison" records, A04 and A102, have different ORCIDs. No "Ellison, Mara J." record appears.

JSON: {"count": 3}

✅ R10 executed run 5 graded by code

3 distinct people: A01, A04 and A102. Their ORCIDs differ, and "Ellison, Mara J." does not appear in people.csv.

JSON: {"count": 3}