Q22, run 2026-11-04-2010-sonnet

← back to the run

Which has more citations, W30 or W31 (counting both versions of each): in total, and within its publication year and the two years after?

Tests: Citation windows: the older work has had more time; over the same span the newer one leads.

Expected: more_in_total = W30 more_in_window = W31

✅ R1 csv run 1 graded by code

Total: W30 (5 vs 4). Within the publication year and two years after: W31 (4 vs 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 2 graded by code

In total W30 has more citations (5 versus 4). Within its publication year and the next two years, W31 has more (4 versus 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 3 graded by code

In total, W30 has more citations (5 vs 4). Within its publication year and the two years after, W31 has more (4 vs 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 4 graded by code

W30 has more citations in total, and W31 has more within its window. W30 has 5 citations in total; W31 has 4 including W42's. In its window W30 has 1 and W31 has 4.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R1 csv run 5 graded by code

W30 has more in total (5 vs 4), and W31 has more within the window (4 vs 1). W31 has 4 citing works across both versions: W62, W65, W66 and W67. W30's citing works are W60–W64.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R2 rdf run 1 graded by code

More in total: W30 (5 against 4). More in the window: W31 (4 against 1). W31's count includes citations to its preprint W42.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R2 rdf run 2 graded by code

In total W30 has more citations (5 vs 4). Within the window W31 has more (4 vs 1). W30 is cited by W60 to W64. W31 plus its preprint W42 is cited by W62, W65, W66 and W67.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R2 rdf run 3 graded by code

In total, W30 has more citations (5 against 4). Within its publication year and the two years after, W31 has more (4 against 1). W30 is cited by W60–W64. W31 and its preprint W42 are cited by W62, W65, W66 and W67.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R2 rdf run 4 graded by code

More in total: W30 (5 citations against 4 for W31 and W42 together). Within the publication year and the two years after: W31 (4 against 1 for W30).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R2 rdf run 5 graded by code

In total, W30 has more (5 vs 4). Within the window, W31 has more (4 vs 1). W31 plus its version W42 are cited by W62, W65, W66 and W67.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R6 rdf+ontology run 1 graded by code

In total, W30 has more (5 against 4). Within its publication year and the two years after, W31 has more (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R6 rdf+ontology run 2 graded by code

W30 has more in total; W31 has more in the window.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R6 rdf+ontology run 3 graded by code

In total W30 has more citations (5 against 4). Within its publication year and the two years after, W31 has more (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R6 rdf+ontology run 4 graded by code

In total W30 has more (5 against 4). Within its publication year and the two years after, W31 has more (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R6 rdf+ontology run 5 graded by code

In total, W30 has more (5 against 4). Within its publication year and the two years after, W31 has more (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 1 graded by code

In total W30 has more, with 5 citations against 4 for W31. Within the 3-year window W31 has more, with 4 against 1 for W30.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 2 graded by code

In total W30 has more, with 5 against 4 for W31. In the window W31 has more, with 4 against 1 for W30.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 3 graded by code

In total, W30 has more: 5 against 4. Within the publication year plus two years, W31 has more: 4 against 1.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 4 graded by code

W30 has more in total (5 against 4). W31 has more within its window (4 against 1). W30 is cited by W60–W64, and W31 (with W42) by W62, W65, W66 and W67.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R5 csv+ontology run 5 graded by code

W30 has more in total, with 5 citations against 4 for W31 (W62, W65, W66, plus W67 via W42). W31 has more in the window, with 4 (2023–2025) against 1 for W30.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R4 csv+markdown run 1 graded by code

In total, W30 has more citations: 5 against 4. Within the publication year and two years after, W31 has more: 4 against 1.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R4 csv+markdown run 2 graded by code

More in total: W30, with 5 citations against 4 for W31. Within its publication year and the two years after: W31, with 4 against 1.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R4 csv+markdown run 3 graded by code

In total, W30 has more citations (5 against 4). Within the window, W31 has more (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R4 csv+markdown run 4 graded by code

More in total: W30. More in the window: W31. W30 has 5 citations in total (W60–W64) and W31 has 4 (W62, W65, W66, W67). In the three-year window, W30 has 1 (W60) and W31 has 4.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R4 csv+markdown run 5 graded by code

W30 has more in total (5 against 4). W31 has more in its window (4 against 1). W30 is cited by W60–W64. W31 is cited by W62, W65, W66, and by W67 through W42.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 1 graded by code

W30 has more in total (5 against 4). W31 has more within its window (4 against 1). W30 is cited by W60–W64, and the 2019–2021 window catches only W60. W31 plus W42 are cited by W62, W65, W66 and W67, all in 2023–2025.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 2 graded by code

In total W30 has more, with 5 citations against 4 for W31 across both versions. Within the publication year plus two years, W31 has more, with 4 (W62, W65, W66, W67) against 1 (W60) for W30.

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

✅ R3 csv+padding run 3 graded by code

W30 has more in total (5 against 4). W31 has more in the window (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}

🟡 R3 csv+padding run 4 graded by code

W31 has more in both cases. W30 has 5 citations in total and 1 in window (W60). W31 has 4 in total (W62, W65, W66, plus W67 via W42), and all 4 fall in 2023–2025.

JSON: {"more_in_total": "W31", "more_in_window": "W31"}

Why: more_in_total: expected W30, got W31

✅ R3 csv+padding run 5 graded by code

W30 has more in total (5 against 4). W31 has more within its window (4 against 1).

JSON: {"more_in_total": "W30", "more_in_window": "W31"}