Q1, run 2026-11-04-2010-sonnet

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 2

❌ R1 csv run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 is a different "M. Ellison" with a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R1 csv run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. The other "M. Ellison" (A04) has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R1 csv run 4 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 (also "M. Ellison") has a different ORCID.

JSON: {"count": 2}

❌ R1 csv run 5 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID and is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R2 rdf run 1 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 "M. Ellison" has a different ORCID (0000-0004-8662-8360) and a different institution (I07).

JSON: {"count": 2}

✅ R2 rdf run 2 graded by code

2. A01 "Mara Ellison", A02 "M. Ellison" and A03 "Ellison, Mara J." share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison" (A04) has a different ORCID, so it is a second person.

JSON: {"count": 2}

✅ R2 rdf run 3 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison" (A04) has a different ORCID.

JSON: {"count": 2}

✅ R2 rdf run 4 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison", A04, has a different ORCID (0000-0004-8662-8360) and is a different person.

JSON: {"count": 2}

✅ R2 rdf run 5 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, while A04 "M. Ellison" has a different ORCID (0000-0004-8662-8360).

JSON: {"count": 2}

✅ R6 rdf+ontology run 1 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison" (A04) has a different ORCID.

JSON: {"count": 2}

❌ R6 rdf+ontology run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229; A04 "M. Ellison" has a different ORCID and is not among the three names asked about.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R6 rdf+ontology run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 "M. Ellison" has a different ORCID and is not included.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R6 rdf+ontology run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 "M. Ellison" has a different ORCID and is not included.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ R6 rdf+ontology run 5 graded by code

2. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID, so it is a second person.

JSON: {"count": 2}

❌ R5 csv+ontology run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person (A04 has a different ORCID).

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison" record, A04, has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 "M. Ellison" has a different ORCID and is someone else.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R5 csv+ontology run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person (A04 is a different person).

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 is a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R4 csv+markdown run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 1 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 has a different ORCID, so it is a different person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 2 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. The other "M. Ellison" (A04) has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 3 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 is also "M. Ellison" but has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 4 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 ("M. Ellison") has a different ORCID, so it is someone else.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ R3 csv+padding run 5 graded by code

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 is a different M. Ellison, with a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1