Q7, run 2026-11-06-0808-sonnet-query

← back to the run

How many research works has Mara Ellison authored?

Tests: Everything at once: identity, versions (W02 is W03), document types (W04, W05) and the delisted source (W07).

Expected: count = 5

❌ D1 sql run 1 graded by code · query session

6. W02 is a preprint of W03 and counted once; W04 and W05 are not research types.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D1 sql run 2 graded by code · query session

6. W02 is a preprint of W03 and is merged with it; W04 and W05 are excluded by type.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D1 sql run 3 graded by code · query session

6 (W01, W03, W06, W07, W12, W19). W02 is a preprint version of W03 and is counted once, and W04 and W05 are not research types.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D1 sql run 4 graded by code · query session

6 (W01, W03, W06, W07, W12, W19). I counted the preprint W02 as a version of W03, not a separate work.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D1 sql run 5 graded by code · query session

6. W02 is a preprint of W03, so the pair counts once.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ D2 sql+markdown run 1 graded by code · query session

5. They are W01, W03 (which also counts W02), W06, W12 and W19. W04 and W05 are not research types, W07 is in a delisted source, and W08 is another person's.

JSON: {"count": 5}

✅ D2 sql+markdown run 2 graded by code · query session

5: W01, W03 (W02 is its preprint), W06, W12, W19. W07 is excluded because S04 is delisted.

JSON: {"count": 5}

✅ D2 sql+markdown run 3 graded by code · query session

5: W01, W03 (with W02), W06, W12 and W19. W07 is excluded because S04 is delisted (K0).

JSON: {"count": 5}

✅ D2 sql+markdown run 4 graded by code · query session

5. W07 is excluded because S04 is delisted (K0), and W02 is counted under W03.

JSON: {"count": 5}

✅ D2 sql+markdown run 5 graded by code · query session

5. They are W01, W03 (which includes the preprint W02), W06, W12 and W19. W07 is in the delisted source S04, and W04 and W05 are not research types.

JSON: {"count": 5}

✅ D3 sql+executed run 1 graded by code · query session

5. A01's research works are W01, W03, W06, W12 and W19.

JSON: {"count": 5}

✅ D3 sql+executed run 2 graded by code · query session

5. The research works are W01, W03, W06, W12 and W19; W04, W05 and W07 are not research output.

JSON: {"count": 5}

✅ D3 sql+executed run 3 graded by code · query session

5. Mara Ellison's research works are W01, W03, W06, W12 and W19.

JSON: {"count": 5}

✅ D3 sql+executed run 4 graded by code · query session

5. These are W01, W03, W06, W12 and W19. W04 and W05 are not research output by type, and W07 is not because S04 is delisted.

JSON: {"count": 5}

✅ D3 sql+executed run 5 graded by code · query session

5 (W01, W03, W06, W12, W19).

JSON: {"count": 5}

❌ D4 sparql run 1 graded by code · query session

6. These are W01, W03 (with W02 as its preprint), W06, W07, W12 and W19. W04 (editorial) and W05 (erratum) are excluded by type.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D4 sparql run 2 graded by code · query session

(no answer found)

Why: no structured answer

❌ D4 sparql run 3 graded by code · query session

6. This counts articles and reviews and collapses the preprint W02 into W03.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D4 sparql run 4 graded by code · query session

6. The preprint W02 is counted once with W03, and the editorial W04 and erratum W05 are excluded by type.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ D4 sparql run 5 graded by code · query session

6: W01, W02/W03 (one work, preprint plus published version), W06, W07, W12, W19.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ D5 sparql+ontology run 1 graded by code · query session

5. These are W01, W03, W06, W12 and W19. W02 is the preprint of W03 and counts once, W04 and W05 are an editorial and an erratum, and W07 is in a delisted source.

JSON: {"count": 5}

✅ D5 sparql+ontology run 2 graded by code · query session

5. These are W01, W03 (with its preprint W02 counted once), W06, W12 and W19. W07 is in the delisted source S04, W04 is an editorial and W05 is an erratum, so none of them count.

JSON: {"count": 5}

❌ D5 sparql+ontology run 3 graded by code · query session

(no answer found)

JSON: {"count": null}

Why: count: expected 5, got None

✅ D5 sparql+ontology run 4 graded by code · query session

5. These are W01, W03 (merged with preprint W02), W06, W12 and W19; W07 is excluded because S04 is delisted (K0).

JSON: {"count": 5}

✅ D5 sparql+ontology run 5 graded by code · query session

5: W01, W03 (W02 counted under it), W06, W12, W19. W04 and W05 are the wrong type, and W07 is in a delisted source.

JSON: {"count": 5}