Q7, run 2026-11-05-1234-sonnet

← back to the run

How many research works has Mara Ellison authored?

Tests: Everything at once: identity, versions (W02 is W03), document types (W04, W05) and the delisted source (W07).

Expected: count = 5

❌ R1 csv run 1 graded by code

6 (W01, W03, W06, W07, W12, W19). W02 is a preprint of W03, so it is not counted separately.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 2 graded by code

6. The research works are W01, W03, W06, W07, W12 and W19. W02 is a preprint of W03, so it is the same work. W04 (editorial) and W05 (erratum) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 3 graded by code

6: W01, W03, W06, W07, W12, W19. I did not count W02 because it is a preprint of W03, and W04 and W05 are not research types.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 4 graded by code

6. These are W01, W03, W06, W07, W12 and W19. W02 is a preprint of W03, so it is not counted separately.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 5 graded by code

6. These are W01, W03 (with its preprint W02 merged in), W06, W07, W12 and W19. Editorial W04 and erratum W05 are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 1 graded by code

6 (W01, W03, W06, W07, W12, W19).

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 2 graded by code

6. The works are W01, W03, W06, W07, W12 and W19. W02 (PPR), W04 (EDT) and W05 (ERR) are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 3 graded by code

6. I counted articles and reviews only. W02 is a preprint of W03, W04 is an editorial and W05 an erratum.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 4 graded by code

6 (W01, W03, W06, W07, W12, W19). W04 is an editorial, W05 an erratum and W02 a preprint.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R2 rdf run 5 graded by code

6. The research works are W01, W03, W06, W07, W12 and W19. W04 (editorial) and W05 (erratum) are excluded, and preprint W02 is a version of W03.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ R6 rdf+ontology run 1 graded by code

5: W01, W03 (which includes its preprint W02), W06, W12 and W19. W04 is an editorial, W05 an erratum, and W07 is in S04, which is delisted (K0).

JSON: {"count": 5}

✅ R6 rdf+ontology run 2 graded by code

5. These are W01, W03, W06, W12 and W19. W04 is an editorial and W05 an erratum, and W07 is in S04, which is delisted (K0). W02 is a preprint of W03 and counts once.

JSON: {"count": 5}

✅ R6 rdf+ontology run 3 graded by code

5. W01, W03 (with W02), W06, W12 and W19 count. W04 is an editorial and W05 an erratum. W07 appeared in S04, a delisted source (K0).

JSON: {"count": 5}

✅ R6 rdf+ontology run 4 graded by code

5: W01, W03 (W02 is its preprint), W06, W12 and W19. W04 is an editorial, W05 an erratum, and W07 is in the delisted S04.

JSON: {"count": 5}

✅ R6 rdf+ontology run 5 graded by code

5 (W01, W03, W06, W12, W19). W02 is merged into W03, W04 is an editorial, W05 an erratum, and W07 is in the delisted source S04.

JSON: {"count": 5}

✅ R5 csv+ontology run 1 graded by code

5. They are W01, W03 (with W02), W06, W12 and W19. W04 and W05 are not research types, and W07 is in the delisted source S04.

JSON: {"count": 5}

✅ R5 csv+ontology run 2 graded by code

5. Her research works are W01, W03 (which includes preprint W02), W06, W12 and W19. W04 and W05 are not research output, and W07 is in delisted S04.

JSON: {"count": 5}

✅ R5 csv+ontology run 3 graded by code

5 (W01, W03, W06, W12, W19). W02 is the preprint of W03 and counts once. W07 is in the delisted source S04, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R5 csv+ontology run 4 graded by code

5. These are W01, W03 (with its preprint W02), W06, W12 and W19. W07 is in the delisted source S04, and W04 and W05 are an editorial and an erratum.

JSON: {"count": 5}

✅ R5 csv+ontology run 5 graded by code

5. These are W01, W03 (with its preprint W02), W06, W12 and W19. W04 and W05 are not research types, and W07 is in the delisted S04.

JSON: {"count": 5}

✅ R4 csv+markdown run 1 graded by code

5. These are W01, W03 (which includes preprint W02), W06, W12 and W19. W07 is in the delisted source S04, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R4 csv+markdown run 2 graded by code

5: W01, W03 (with its preprint W02), W06, W12, W19. W04 and W05 are not research types, and W07 is in a K0 source.

JSON: {"count": 5}

✅ R4 csv+markdown run 3 graded by code

5. These are W01, W03 (merged with preprint W02), W06, W12 and W19. W07 is excluded because it is in delisted S04.

JSON: {"count": 5}

✅ R4 csv+markdown run 4 graded by code

5 (W01, W03, W06, W12, W19). W02 is the preprint of W03, W07 is in the delisted S04, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ R4 csv+markdown run 5 graded by code

5. The works are W01, W03 (W02 is its preprint), W06, W12 and W19. W04 and W05 are not research types, and W07 is in a K0 source.

JSON: {"count": 5}

❌ R3 csv+padding run 1 graded by code

6. W02 is the preprint of W03, and W04 (EDT) and W05 (ERR) are not research.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 2 graded by code

6. The works are W01, W03 (W02 is its preprint), W06, W07, W12 and W19. W04 and W05 are not research works.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 3 graded by code

6. These are W01, W03 (with its preprint W02), W06, W07, W12 and W19; W04 is an editorial and W05 an erratum.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 4 graded by code

6. W04 (editorial) and W05 (erratum) are not research, and W02 is the preprint version of W03.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R3 csv+padding run 5 graded by code

6. W02 is a preprint version of W03, so the two count once.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ R10 executed run 1 graded by code

5. These are W01, W03, W06, W12 and W19. W04 and W05 are not research output, and W07 is excluded because S04 is delisted.

JSON: {"count": 5}

✅ R10 executed run 2 graded by code

5 (W01, W03, W06, W12, W19). W04 and W05 are not research by type, and W07 is not because its source is delisted.

JSON: {"count": 5}

✅ R10 executed run 3 graded by code

5. These are W01, W03, W06, W12 and W19. W04, W05 and W07 are not research output.

JSON: {"count": 5}

✅ R10 executed run 4 graded by code

5. These are W01, W03, W06, W12 and W19. W04 and W05 are not research by type, and W07 is not because its source is delisted.

JSON: {"count": 5}

✅ R10 executed run 5 graded by code

5 (W01, W03, W06, W12, W19). W04, W05 and W07 are not research output.

JSON: {"count": 5}