Q16, run 2026-11-05-1234-sonnet

← back to the run

How many research works appeared in the Journal of Marine Autonomy (S01)?

Tests: Document types: an editorial (W04) and paratext (W09) are not research output; also a test record (W91).

Expected: count = 10

✅ R1 csv run 1 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R1 csv run 2 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. W91 is staging, and W04 and W09 are not research.

JSON: {"count": 10}

✅ R1 csv run 3 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. I excluded W04 (editorial), W09 (PTX) and W91 (STG).

JSON: {"count": 10}

✅ R1 csv run 4 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. I excluded W04 (EDT), W09 (PTX) and W91 (STG).

JSON: {"count": 10}

✅ R1 csv run 5 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

❌ R2 rdf run 1 graded by code

11 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74, W91).

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R2 rdf run 2 graded by code

11. These are W01, W08, W13, W20, W29, W31, W32, W52, W71, W74, W91, with W04 (EDT) and W09 (PTX) excluded.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R2 rdf run 3 graded by code

11: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74, W91.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R2 rdf run 4 graded by code

11: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74, W91.

JSON: {"count": 11}

Why: count: expected 10, got 11

❌ R2 rdf run 5 graded by code

11. S01 has 13 works, minus the editorial W04 and the issue information W09.

JSON: {"count": 11}

Why: count: expected 10, got 11

✅ R6 rdf+ontology run 1 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74.

JSON: {"count": 10}

✅ R6 rdf+ontology run 2 graded by code

10. These are W01, W08, W13, W20, W29, W31 (W42 merged in), W32, W52, W71 and W74. W09 and W04 are not research output and W91 is staging.

JSON: {"count": 10}

✅ R6 rdf+ontology run 3 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. The preprint W42 counts under W31.

JSON: {"count": 10}

✅ R6 rdf+ontology run 4 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74. W04 is an editorial and W91 is a staging record.

JSON: {"count": 10}

✅ R6 rdf+ontology run 5 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74). W42 is a preprint of W31 and counts under W31.

JSON: {"count": 10}

✅ R5 csv+ontology run 1 graded by code

10. They are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R5 csv+ontology run 2 graded by code

10. The works are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74. Editorial W04, paratext W09 and staging record W91 are excluded.

JSON: {"count": 10}

✅ R5 csv+ontology run 3 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R5 csv+ontology run 4 graded by code

10. They are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74. W04 and W09 are not research, and W91 is a staging record.

JSON: {"count": 10}

✅ R5 csv+ontology run 5 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. W04 is an editorial, W09 is paratext, and W91 is a staging record.

JSON: {"count": 10}

✅ R4 csv+markdown run 1 graded by code

10. They are W01, W08, W13, W20, W29, W31 (which includes preprint W42), W32, W52, W71 and W74. W91 is a staging record, and W04 and W09 are not research types.

JSON: {"count": 10}

✅ R4 csv+markdown run 2 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74.

JSON: {"count": 10}

✅ R4 csv+markdown run 3 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74. W04 and W09 are not research works, W91 is a staging record, and W42 is merged into W31.

JSON: {"count": 10}

✅ R4 csv+markdown run 4 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R4 csv+markdown run 5 graded by code

10. They are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R3 csv+padding run 1 graded by code

10: W01, W08, W13, W20, W29, W31, W32, W52, W71, W74.

JSON: {"count": 10}

✅ R3 csv+padding run 2 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R3 csv+padding run 3 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R3 csv+padding run 4 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R3 csv+padding run 5 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R10 executed run 1 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74. W04 and W09 are not research output.

JSON: {"count": 10}

✅ R10 executed run 2 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}

✅ R10 executed run 3 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R10 executed run 4 graded by code

10. These are W01, W08, W13, W20, W29, W31, W32, W52, W71 and W74.

JSON: {"count": 10}

✅ R10 executed run 5 graded by code

10 (W01, W08, W13, W20, W29, W31, W32, W52, W71, W74).

JSON: {"count": 10}