Q1, run 2026-11-04-1752-haiku

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 2

❌ R1 csv run 1 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 2 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229; A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 has a different ORCID (0000-0004-8662-8360).

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 4 graded by code

1 person. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229; A04 ("M. Ellison") has a different ORCID, so it is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 5 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 has a different ORCID. [A01, A02, A03]

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R2 rdf run 1 graded by code

2 people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 ("M. Ellison") has ORCID 0000-0004-8662-8360.

JSON: {"count": 2}

✅ R2 rdf run 2 graded by code

2 people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 ("M. Ellison") has 0000-0004-8662-8360.

JSON: {"count": 2}

✅ R2 rdf run 3 graded by code

Two people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 ("M. Ellison") has ORCID 0000-0004-8662-8360.

JSON: {"count": 2}

✅ R2 rdf run 4 graded by code

2 distinct people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person, while A04 ("M. Ellison") has a different ORCID (0000-0004-8662-8360).

JSON: {"count": 2}

✅ R2 rdf run 5 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229 (one person). A04 ("M. Ellison") has a different ORCID, 0000-0004-8662-8360, so it is a second person.

JSON: {"count": 2}

❌ R6 rdf+ontology run 1 graded by code

1 distinct person. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 ("M. Ellison") has a different ORCID, so it is a different person and is not among the three named records.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R6 rdf+ontology run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person (Mara Ellison).

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R6 rdf+ontology run 3 graded by code

2 people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person; A04 ("M. Ellison") has a different ORCID, 0000-0004-8662-8360.

JSON: {"count": 2}

❌ R6 rdf+ontology run 4 graded by code

1 person. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person (the same ORCID means the same person).

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R6 rdf+ontology run 5 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229; A04 ("M. Ellison") has a different ORCID, so it is another person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person; A04 ("M. Ellison", different ORCID) is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 2 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229; A04 ("M. Ellison", different ORCID) is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person; A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 4 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person; A04 (M. Ellison, different ORCID) is not in the named set. (The A04 record is also a different person from the named set.)

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 5 graded by code

1 person. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 1 graded by code

1. All three records share ORCID 0000-0002-9841-6229 (A01, A02, A03). A04 is "M. Ellison" with a different ORCID, so it is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R4 csv+markdown run 3 graded by code

2 people. A01, A02 and A03 share ORCID 0000-0002-9841-6229 and are one person; A04 has a different ORCID (0000-0004-8662-8360).

JSON: {"count": 2}

❌ R4 csv+markdown run 4 graded by code

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 5 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R3 csv+padding run 1 graded by code

2 people. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 has a different ORCID (0000-0004-8662-8360) and is a separate person.

JSON: {"count": 2}

❌ R3 csv+padding run 2 graded by code

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229; A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 is also "M. Ellison" but has a different ORCID (0000-0004-8662-8360), so the bare name is ambiguous.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R3 csv+padding run 4 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID (0000-0004-8662-8360), so it is a separate person.

JSON: {"count": 2}

❌ R3 csv+padding run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1