Q5, run 2026-11-06-0206-haiku

← back to the run

Is the M. Ellison who wrote W08 the same person as the Mara Ellison who wrote W01?

Tests: Identity: a name variant shared with a different person.

Expected: same = no

✅ R1 csv run 1 graded by code

No. W08's author A04 has ORCID 0000-0004-8662-8360, while A01 has 0000-0002-9841-6229.

JSON: {"same": "no"}

✅ R1 csv run 2 graded by code

No. The M. Ellison of W08 is A04 (ORCID 0000-0004-8662-8360), and Mara Ellison of W01 is A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R1 csv run 3 graded by code

No. W08 is by A04 (ORCID 0000-0004-8662-8360) and W01 is by A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R1 csv run 4 graded by code

No. The M. Ellison on W08 is A04 (ORCID 0000-0004-8662-8360), and the Mara Ellison on W01 is A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

❌ R1 csv run 5 graded by code

(no answer found)

JSON: {"counts": "no"}

Why: same: expected no, got None

✅ R3 csv+padding run 1 graded by code

No. W08 is by A04 (ORCID 0000-0004-8662-8360) and W01 by A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R3 csv+padding run 2 graded by code

No. A04 (0000-0004-8662-8360) and A01 (0000-0002-9841-6229) have different ORCIDs.

JSON: {"same": "no"}

✅ R3 csv+padding run 3 graded by code

No. A04 (ORCID 0000-0004-8662-8360) differs from A01 (0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R3 csv+padding run 4 graded by code

No. M. Ellison on W08 is A04 (ORCID 0000-0004-8662-8360), while Mara Ellison on W01 is A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R3 csv+padding run 5 graded by code

No. A04 (ORCID 0000-0004-8662-8360) wrote W08, and A01 (ORCID 0000-0002-9841-6229) wrote W01.

JSON: {"same": "no"}

✅ R4 csv+markdown run 1 graded by code

No. M. Ellison (A04, ORCID 0000-0004-8662-8360) and Mara Ellison (A01, ORCID 0000-0002-9841-6229) have different ORCIDs.

JSON: {"same": "no"}

✅ R4 csv+markdown run 2 graded by code

No. W08 is by A04 (ORCID 0000-0004-8662-8360) and W01 is by A01 (ORCID 0000-0002-9841-6229), which are different people.

JSON: {"same": "no"}

✅ R4 csv+markdown run 3 graded by code

No. W08 is by A04 (ORCID …8662-8360) and W01 by A01 (ORCID …9841-6229).

JSON: {"same": "no"}

✅ R4 csv+markdown run 4 graded by code

No. W08's M. Ellison is A04 (ORCID 0000-0004-8662-8360), while W01's Mara Ellison is A01 (0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R4 csv+markdown run 5 graded by code

No. A04 (0000-0004-8662-8360) and A01 (0000-0002-9841-6229) are different people.

JSON: {"same": "no"}

✅ R5 csv+ontology run 1 graded by code

No. W08 is by A04 (ORCID 0000-0004-8662-8360) and W01 by A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R5 csv+ontology run 2 graded by code

No. M. Ellison (A04, ORCID …8662-8360) and Mara Ellison (A01, ORCID …9841-6229) have different ORCIDs.

JSON: {"same": "no"}

✅ R5 csv+ontology run 3 graded by code

No. W08's M. Ellison is A04 (ORCID 0000-0004-8662-8360), not the W01 author (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R5 csv+ontology run 4 graded by code

No. M. Ellison (A04, ORCID 0000-0004-8662-8360) and Mara Ellison (A01, ORCID 0000-0002-9841-6229) have different ORCIDs.

JSON: {"same": "no"}

✅ R5 csv+ontology run 5 graded by code

No. M. Ellison on W08 is A04 (ORCID 0000-0004-8662-8360), and Mara Ellison on W01 is A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R10 executed run 1 graded by code

No. W08 credits A04 and W01 credits A01, which are different people.

JSON: {"same": "no"}

✅ R10 executed run 2 graded by code

No. W08 is credited to A04 (M. Ellison, ORCID 0000-0004-8662-8360) and W01 to A01 (Mara Ellison).

JSON: {"same": "no"}

✅ R10 executed run 3 graded by code

No. W08 credits A04 (ORCID 0000-0004-8662-8360), while W01 credits A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}

✅ R10 executed run 4 graded by code

No.
W08 is credited to A04 and W01 to A01, and their ORCIDs differ (0004-8662-8360 vs 0002-9841-6229).

JSON: {"same": "no"}

✅ R10 executed run 5 graded by code

No. W08's author A04 (ORCID 0000-0004-8662-8360) differs from A01 (ORCID 0000-0002-9841-6229).

JSON: {"same": "no"}