Q7, run 2026-11-04-2053-sonnet

← back to the run

How many research works has Mara Ellison authored?

Tests: Everything at once: identity, versions (W02 is W03), document types (W04, W05) and the delisted source (W07).

Expected: count = 5

❌ R1 csv run 1 graded by code

6. The works are W01, W03 (with its preprint W02, counted once), W06, W07, W12 and W19. The editorial W04 and the erratum W05 are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 2 graded by code

6. W02 is a preprint of W03 and counts once, so the works are W01, W03, W06, W07, W12 and W19.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 3 graded by code

6. W02 is the preprint of W03, so the two count once.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 4 graded by code

6. The research works are W01, W03 (with its preprint W02, counted once), W06, W07, W12 and W19. W04 (EDT) and W05 (ERR) are excluded.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 5 graded by code

6 (W01, W03, W06, W07, W12, W19). W02 is the preprint of W03, so it is counted once.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ R10 executed run 1 graded by code

5. These are W01, W03, W06, W12 and W19. W04 and W05 are not research, W07 is in a delisted source, and W08 belongs to A04.

JSON: {"count": 5}

✅ R10 executed run 2 graded by code

5. These are W01, W03, W06, W12 and W19; W04, W05 and W07 are not research output.

JSON: {"count": 5}

✅ R10 executed run 3 graded by code

5 (W01, W03, W06, W12, W19). W04, W05 and W07 are not research output.

JSON: {"count": 5}

✅ R10 executed run 4 graded by code

5 (W01, W03, W06, W12, W19). W04 and W05 are not research output, W07 is in a delisted source, and W08 belongs to A04.

JSON: {"count": 5}

✅ R10 executed run 5 graded by code

5. These are W01, W03, W06, W12 and W19. W04 and W05 are not research output by type, and W07 is not because its source S04 is delisted.

JSON: {"count": 5}