Q1, run 2026-11-06-0808-sonnet-query

← back to the run

How many distinct people do the author records named "Mara Ellison", "M. Ellison" and "Ellison, Mara J." stand for?

Tests: Identity: A01, A02 and A03 share an ORCID; A04, also 'M. Ellison', has another.

Expected: count = 2

❌ D1 sql run 1 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D1 sql run 2 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D1 sql run 3 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D1 sql run 4 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229. The other "M. Ellison" (A04) has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D1 sql run 5 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D2 sql+markdown run 1 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D2 sql+markdown run 2 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D2 sql+markdown run 3 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D2 sql+markdown run 4 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D2 sql+markdown run 5 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ D3 sql+executed run 1 graded by code · query session

2. A01 merges the author records A01, A02 and A03 (Mara Ellison and "Ellison, Mara J."). "M. Ellison" is a separate person, A04, with a different ORCID.

JSON: {"count": 2}

✅ D3 sql+executed run 2 graded by code · query session

2. A01, A02 and A03 are merged into person A01 (Mara Ellison), and "M. Ellison" is a separate person, A04, with a different ORCID.

JSON: {"count": 2}

✅ D3 sql+executed run 3 graded by code · query session

2. A01, A02 and A03 are merged into one person (A01), and "M. Ellison" is a separate person (A04).

JSON: {"count": 2}

✅ D3 sql+executed run 4 graded by code · query session

2. The records A01, A02 and A03 are merged into person A01, which has one ORCID. "M. Ellison" is person A04, with a different ORCID.

JSON: {"count": 2}

✅ D3 sql+executed run 5 graded by code · query session

2. A01 merges "Mara Ellison" and "Ellison, Mara J." (author_ids A01 A02 A03), and "M. Ellison" is A04 with a different ORCID.

JSON: {"count": 2}

❌ D4 sparql run 1 graded by code · query session

1. A01, A02 and A03 all share ORCID 0000-0002-9841-6229, so they are one person (A04 "M. Ellison" has a different ORCID).

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D4 sparql run 2 graded by code · query session

(no answer found)

Why: no structured answer

❌ D4 sparql run 3 graded by code · query session

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229; A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

✅ D4 sparql run 4 graded by code · query session

2. A02 "M. Ellison" and A03 "Ellison, Mara J." share ORCID 0000-0002-9841-6229, so they are one person, and I assumed A01 (whose ORCID I didn't see) is the same. A04 "M. Ellison" has a different ORCID, so it is a second person.

JSON: {"count": 2}

❌ D4 sparql run 5 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D5 sparql+ontology run 1 graded by code · query session

1. A01, A02 and A03 all carry ORCID 0000-0002-9841-6229, so they are one person. A04 ("M. Ellison") has a different ORCID.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D5 sparql+ontology run 2 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D5 sparql+ontology run 3 graded by code · query session

1. A01, A02 and A03 all share ORCID 0000-0002-9841-6229, so they are one person.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D5 sparql+ontology run 4 graded by code · query session

1 person. A01, A02 and A03 share ORCID 0000-0002-9841-6229.

JSON: {"count": 1}

Why: count: expected 2, got 1

❌ D5 sparql+ontology run 5 graded by code · query session

1. A01, A02 and A03 share ORCID 0000-0002-9841-6229, so they are one person (A04 "M. Ellison" has a different ORCID).

JSON: {"count": 1}

Why: count: expected 2, got 1