Q18, run 2026-11-04-2053-sonnet

← back to the run

How many distinct research works has Priya Ramanathan (A07) authored?

Tests: Versions: W02 is the preprint of W03; also the erratum W05 is not a work of research.

Expected: count = 4

✅ R1 csv run 1 graded by code

4: W01, W03 (with W02), W13, W72. The erratum W05 is excluded.

JSON: {"count": 4}

✅ R1 csv run 2 graded by code

4: W01, W03 (with W02), W13, W72. W05 is ERR.

JSON: {"count": 4}

✅ R1 csv run 3 graded by code

4 (W01, W03/W02, W13, W72). W05 is an erratum.

JSON: {"count": 4}

✅ R1 csv run 4 graded by code

4 (W01, W03/W02, W13, W72).

JSON: {"count": 4}

✅ R1 csv run 5 graded by code

4 (W01, W03, W13, W72). W02 duplicates W03 and W05 is an erratum.

JSON: {"count": 4}

✅ R10 executed run 1 graded by code

4: W01, W03, W13, W72. W05 is an erratum and does not count.

JSON: {"count": 4}

✅ R10 executed run 2 graded by code

4. They are W01, W03, W13 and W72.

JSON: {"count": 4}

✅ R10 executed run 3 graded by code

4 (W01, W03, W13, W72).

JSON: {"count": 4}

✅ R10 executed run 4 graded by code

4 (W01, W03, W13, W72).

JSON: {"count": 4}

✅ R10 executed run 5 graded by code

4: W01, W03, W13, W72. W05 is an erratum and not research output.

JSON: {"count": 4}