Q16, run 2026-11-04-2035-haiku

← back to the run

How many research works appeared in the Journal of Marine Autonomy (S01)?

Tests: Document types: an editorial (W04) and paratext (W09) are not research output; also a test record (W91).

Expected: count = 10

❌ R1 csv run 1 graded by code

11. S01's research works are W01, W08, W13, W20, W29, W31, W32, W52, W71, W74 and W91; W04 and W09 are excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R1 csv run 2 graded by code

11. **Reasoning:** S01 research works are W01, W08, W13, W20, W29, W31, W32, W52, W71, W74 and W91; W04 (editorial) and W09 (issue information) are excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R1 csv run 3 graded by code

11. W01, W08, W13, W20, W29, W31, W32, W52, W71, W74 and W91. W04 and W09 are excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R1 csv run 4 graded by code

11. S01 has 13 records, and W04 (EDT) and W09 (PTX) are excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R1 csv run 5 graded by code

11. S01 has 13 works, of which EDT W04 and PTX W09 are excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

✅ R10 executed run 1 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R10 executed run 2 graded by code

10. The research works from S01 are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R10 executed run 3 graded by code

10. S01 research works are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R10 executed run 4 graded by code

Ten: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74.

JSON: {"count": 10}

✅ R10 executed run 5 graded by code

10. S01 research works are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}