Q19, run 2026-11-06-0206-sonnet

← back to the run

How many distinct works cite "Drift-aware mapping with low-cost sonar", in either of its versions?

Tests: Versions: citations to the preprint W02 and to W03 are citations of one work; W15 cites both and counts once.

Expected: count = 27

❌ R1 csv run 1 graded by code

29. W02 is cited by W15 and W18, and the rest cite W03, with W15 appearing once.

JSON: {"count": 29}

Why: count: expected 27, got 29

❌ R1 csv run 2 graded by code

30 distinct citing works, citing W02 or W03.

JSON: {"count": 30}

Why: count: expected 27, got 30

❌ R1 csv run 3 graded by code

29. The 29 distinct citers of W02 or W03 include W17, W397 and W569, which are non-research or staging records.

JSON: {"count": 29}

Why: count: expected 27, got 29

❌ R1 csv run 4 graded by code

29 distinct citing works, from the citations of W02 and W03.

JSON: {"count": 29}

Why: count: expected 27, got 29

❌ R1 csv run 5 graded by code

28. These are the works citing W02 or W03, excluding the staging works W397 and W569.

JSON: {"count": 28}

Why: count: expected 27, got 28

✅ R3 csv+padding run 1 graded by code

27. The 29 citing works of W02 or W03 include W397 and W569, which are STG and so excluded.

JSON: {"count": 27}

❌ R3 csv+padding run 2 graded by code

28 works cite W03 or W02 (STG citers excluded).

JSON: {"count": 28}

Why: count: expected 27, got 28

❌ R3 csv+padding run 3 graded by code

28. Thirty works cite W02 or W03, but W397 and W569 are `STG` records.

JSON: {"count": 28}

Why: count: expected 27, got 28

✅ R3 csv+padding run 4 graded by code

27. W03 and W02 are cited by 29 works between them, and W397 and W569 are STG.

JSON: {"count": 27}

❌ R3 csv+padding run 5 graded by code

30. Distinct citers of W02 or W03.

JSON: {"count": 30}

Why: count: expected 27, got 30

❌ R4 csv+markdown run 1 graded by code

26 distinct citing works across W02 and W03, after excluding the STG works W397 and W569 and the retracted W973.

JSON: {"count": 26}

Why: count: expected 27, got 26

✅ R4 csv+markdown run 2 graded by code

27. This counts distinct valid works citing W02 or W03. I left out W397 and W569 (staging records) and W973 (retracted).

JSON: {"count": 27}

❌ R4 csv+markdown run 3 graded by code

26. W02 is a preprint of W03, and I excluded the staging works W397 and W569 and the retracted W973.

JSON: {"count": 26}

Why: count: expected 27, got 26

✅ R4 csv+markdown run 4 graded by code

27. W397 and W569 are STG records and W973 is retracted, so they are excluded.

JSON: {"count": 27}

❌ R4 csv+markdown run 5 graded by code

26 distinct works cite W02 or W03. Of 29 citing records, W397 and W569 are staging records and W973 is retracted, so they are excluded.

JSON: {"count": 26}

Why: count: expected 27, got 26

✅ R5 csv+ontology run 1 graded by code

27. Staging records W397 and W569 and retracted W973 are excluded from the 30 citing records.

JSON: {"count": 27}

❌ R5 csv+ontology run 2 graded by code

26. These are W03's and W02's citers, minus W397 and W569 (STG) and W973 (retracted).

JSON: {"count": 26}

Why: count: expected 27, got 26

❌ R5 csv+ontology run 3 graded by code

26. I excluded the test records W397 and W569 and the retracted W973.

JSON: {"count": 26}

Why: count: expected 27, got 26

✅ R5 csv+ontology run 4 graded by code

27. Thirty works cite W02 or W03; W397 and W569 are staging records and W973 is retracted.

JSON: {"count": 27}

❌ R5 csv+ontology run 5 graded by code

26. W02 and W03 are cited by 29 distinct works, and I dropped W397 and W569 (test records) and W973 (retracted).

JSON: {"count": 26}

Why: count: expected 27, got 26

❌ R10 executed run 1 graded by code

26 works cite W03, which already merges W02.

JSON: {"count": 26}

Why: count: expected 27, got 26

✅ R10 executed run 2 graded by code

27 works cite W03. W02 is merged into it, and W18 is included.

JSON: {"count": 27}

❌ R10 executed run 3 graded by code

26 works cite W03 or its preprint W02.

JSON: {"count": 26}

Why: count: expected 27, got 26

❌ R10 executed run 4 graded by code

26 distinct works cite W03, which already includes its merged preprint W02.

JSON: {"count": 26}

Why: count: expected 27, got 26

❌ R10 executed run 5 graded by code

26 works cite W03: W12–W17, W214, W273, W315, W349, W535, W544, W558, W598, W676, W711, W748, W761, W812, W833, W843, W889, W890, W931, W1048 and W1056. The merged W02 is already folded into W03.

JSON: {"count": 26}

Why: count: expected 27, got 26