Q22, run 2026-11-06-0206-haiku

← back to the run

Which has more citations, W30 or W31 (counting both versions of each): in total, and within its publication year and the two years after?

Tests: Citation windows: the older work has had more time; over the same span the newer one leads.

Expected: more_in_total = W30 more_in_window = W31

✅ R1 csv run 1 graded by code

W30 has more citations in total (18 vs 14). W31 has more within its window (14 vs 2), since W31's window is 2023–2025 and all its citations fall in it.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 2 graded by code

W30 has more citations in total (18 against 12 for W31 plus its version W42). W31 has more within its window, since all 12 of its citations fall in 2023–2025 against 2 of W30's in 2019–2021.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 3 graded by code

W30 has more total citations (18 against 13 for W31 plus W42). W31 has more in its window (13 against 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

❌ R1 csv run 4 graded by code

(no answer found)

Why: no structured answer

✅ R1 csv run 5 graded by code

(no answer found)

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 1 graded by code

W30 has more total citations (18 against 13 for W31). W31 has more within its window (13 against 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 2 graded by code

W30 has more citations in total (18 vs 14 for W31 counting both versions). W31 has more within 2023–2025 (14 vs 2 for W30 within 2019–2021).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 3 graded by code

W30 has more citations in total (18 vs 13 for W31 with its preprint W42). W31 has more within 2023–2025 (13 vs 2 for W30 in 2019–2021).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 4 graded by code

W30 has more citations in total (18 vs 13). W31 has more within its window, 2019–2021 for W30 vs 2023–2025 for W31 (13 vs 2).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 5 graded by code

More in total: W30 (18 citations vs 13 for W31 plus its version W42). More in the window: W31 (13 vs 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

❌ R4 csv+markdown run 1 graded by code

(no answer found)

Why: no structured answer

❌ R4 csv+markdown run 2 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 3 graded by code

W30 has more citations in total (16 vs 9). W31 has more in its window, 2023–2025 (9 vs 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

❌ R4 csv+markdown run 4 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 5 graded by code

W30 has more in total (16 vs 11). W31 has more within its window (11 vs 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

❌ R5 csv+ontology run 1 graded by code

(no answer found)

Why: no structured answer

✅ R5 csv+ontology run 2 graded by code

W30 has more in total (16 vs 8), and W31 has more in the window (8 vs 2).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 3 graded by code

W30 has more citations in total (16). W31 has more within its window (10 vs 2), and W31's total is 10. Both versions of W31 are counted, so W42 is included.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

❌ R5 csv+ontology run 4 graded by code

(no answer found)

JSON: {"more_in_total": null, "more_in_window": null}

Why: more_in_total: expected W30, got None; more_in_window: expected W31, got None

✅ R5 csv+ontology run 5 graded by code

W30 has more citations in total (16 vs 11). W31 has more within its window (11 vs 2), since its window of 2023–2025 contains all of its citers.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R10 executed run 1 graded by code

W30 has more citations in total, and W31 has more within its window. Total: W30 16 vs W31 11. Within 2019–2021 for W30 and 2023–2025 for W31: W30 2 vs W31 11.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R10 executed run 2 graded by code

W30 has more citations in total (16 vs 11). W31 has more within its window (11 vs 2), since its window is 2023–2025 and W30's is 2019–2021.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R10 executed run 3 graded by code

W30 has more citations in total (16 vs 11). W31 has more within its window (2023–2025: 11 vs 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R10 executed run 4 graded by code

W30 has more in total (16 vs 11); W31 has more in its window (11 vs 2).
W30's citers 2019–2021 are W60 and W988; W31's citers 2023–2025 are all 11 of its citers.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R10 executed run 5 graded by code

W30 has more citations in total (16 vs 11 for W31). W31 has more within its window (11 vs 2 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}