Q7, run 2026-11-04-2010-sonnet

← back to the run

How many research works has Mara Ellison authored?

Tests: Everything at once: identity, versions (W02 is W03), document types (W04, W05) and the delisted source (W07).

Expected: count = 5

❌ R1 csv run 1 graded by code

6 (W01, W03, W06, W07, W12, W19). W02 is a preprint of W03 and counts once. W04 (editorial) and W05 (erratum) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 2 graded by code

6 (W01, W03, W06, W07, W12, W19). W04 and W05 are not research, and W02 is a preprint of W03.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 3 graded by code

6. They are W01, W03 (with W02 as its preprint), W06, W07, W12 and W19. W04 (EDT) and W05 (ERR) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 4 graded by code

6. I excluded W04 (editorial) and W05 (erratum), and counted the preprint W02 and its published version W03 once.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 5 graded by code

6. W01, W03/W02 (counted once), W06, W07, W12 and W19. The editorial W04 and erratum W05 are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 1 graded by code

6. The preprint W02 is a version of W03 and counts once, and W04 (editorial) and W05 (erratum) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 2 graded by code

6. Her research works are W01, W03, W06, W07, W12 and W19. I count preprint W02 as the same work as W03 (`versionOf`), and W04 (editorial) and W05 (erratum) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 3 graded by code

6. These are W01, W02/W03 (one work, since W02 is a preprint version of W03), W06, W07, W12 and W19. W04 (editorial) and W05 (erratum) are excluded by type.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 4 graded by code

6. W04 is an editorial and W05 an erratum, so both are excluded. W02 is a preprint version of W03 and is not counted separately.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 5 graded by code

6. These are W01, W03, W06, W07, W12 and W19. W02 is a preprint of W03 and is merged with it, while W04 (editorial) and W05 (erratum) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ R6 rdf+ontology run 1 graded by code

5. W02 merges into W03, W07 is in a delisted source (S04, K0), and W04 and W05 are an editorial and an erratum.

JSON: {"count": 5}

✅ R6 rdf+ontology run 2 graded by code

5: W01, W03 (W02 is its preprint), W06, W12, W19. W07 is in a delisted source, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R6 rdf+ontology run 3 graded by code

5. W01, W03 (W02 is its preprint), W06, W12 and W19 count. W04 (editorial) and W05 (erratum) are not research, and W07 is in S04, which is delisted (K0).

JSON: {"count": 5}

✅ R6 rdf+ontology run 4 graded by code

5 (W01, W03/W02, W06, W12, W19). W04 is an editorial, W05 an erratum, and W07 is in the delisted source S04.

JSON: {"count": 5}

✅ R6 rdf+ontology run 5 graded by code

5. W04 and W05 are not research types, and W07 is in a delisted source (S04, K0).

JSON: {"count": 5}

✅ R5 csv+ontology run 1 graded by code

5. These are W01, W03 (W02 is its preprint), W06, W12 and W19; W07 is in the delisted source S04, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R5 csv+ontology run 2 graded by code

5. Her research works are W01, W03 (counted once with its preprint W02), W06, W12 and W19. W07 is in a delisted source, and W04 and W05 are an editorial and an erratum.

JSON: {"count": 5}

✅ R5 csv+ontology run 3 graded by code

5. The works are W01, W03 (which counts W02 with it), W06, W12 and W19. W07 is excluded because S04 is delisted (K0), and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R5 csv+ontology run 4 graded by code

5: W01, W03, W06, W12, W19. W02 merges into W03, W07 is in a delisted source, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R5 csv+ontology run 5 graded by code

5: W01, W03 (with preprint W02), W06, W12 and W19. W07 is excluded because S04 is delisted (K0), and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R4 csv+markdown run 1 graded by code

5. They are W01, W03 (with its preprint W02), W06, W12 and W19. W07 is in a delisted source (K0), and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R4 csv+markdown run 2 graded by code

5. W02 is a preprint of W03, and W07 is in the delisted source S04. W04 and W05 are not research output.

JSON: {"count": 5}

✅ R4 csv+markdown run 3 graded by code

5: W01, W03 (which includes preprint W02), W06, W12, W19. W04 and W05 are not research types, and W07 is in a delisted source (S04, K0).

JSON: {"count": 5}

✅ R4 csv+markdown run 4 graded by code

5. Her research works are W01, W03 (W02 merged into it), W06, W12 and W19. W04 and W05 are not research types, and W07 is in a delisted source.

JSON: {"count": 5}

✅ R4 csv+markdown run 5 graded by code

5: W01, W03, W06, W12, W19. W02 is merged into W03, W07 is in a delisted source, and W04 and W05 are not research types.

JSON: {"count": 5}

❌ R3 csv+padding run 1 graded by code

6. These are W01, W03 (merged with its preprint W02), W06, W07, W12 and W19. W04 and W05 are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 2 graded by code

6. The research works are W01, W03 (with its preprint W02 merged in), W06, W07, W12 and W19. The editorial W04 and erratum W05 are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 3 graded by code

6. These are W01, W03, W06, W07, W12 and W19, counting the preprint W02 together with its published version W03.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 4 graded by code

6. The nine works in Q2 include the editorial W04 and erratum W05, which are not research. W02 is the preprint of W03, so it is not counted separately.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 5 graded by code

6. W01, W03 (merged with preprint W02), W06, W07, W12 and W19; the editorial W04 and erratum W05 are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6