Q23, run 2026-11-06-0206-haiku

← back to the run

How many citations has W30 received in total, and how many within its publication year and the two years after?

Tests: Citation windows: a citation's year is the citing work's year.

Expected: total = 16 in_window = 2

🟡 R1 csv run 1 graded by code

18 total, 2 in the 2019–2021 window (W60 and W988).

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R1 csv run 2 graded by code

W30 has 18 citations in total and 2 within 2019–2021 (W60 and W988).

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R1 csv run 3 graded by code

W30 has 18 citations in total and 2 in its window (2019–2021): W60 and W988.

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

❌ R1 csv run 4 graded by code

(no answer found)

Why: no structured answer

🟡 R1 csv run 5 graded by code

(no answer found)

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R3 csv+padding run 1 graded by code

W30 has 18 citations in total and 2 in 2019–2021 (W60, W988).

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R3 csv+padding run 2 graded by code

Total 18; within 2019–2021, 2.

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R3 csv+padding run 3 graded by code

W30 has 18 citations in total, and 2 within 2019–2021 (W60, W988).

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R3 csv+padding run 4 graded by code

W30 has 18 citations in total and 2 within 2019–2021.

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

🟡 R3 csv+padding run 5 graded by code

W30 has 18 citations in total and 2 within 2019–2021.

JSON: {"total": 18, "in_window": 2}

Why: total: expected 16, got 18

❌ R4 csv+markdown run 1 graded by code

(no answer found)

Why: no structured answer

❌ R4 csv+markdown run 2 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 3 graded by code

W30 has 16 citations in total and 2 in its window (2019–2021). W320 is retracted and excluded.

JSON: {"total": 16, "in_window": 2}

❌ R4 csv+markdown run 4 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 5 graded by code

W30: 16 in total; 2 in 2019–2021 (W60 in 2020, W988 in 2021).

JSON: {"total": 16, "in_window": 2}

❌ R5 csv+ontology run 1 graded by code

(no answer found)

Why: no structured answer

✅ R5 csv+ontology run 2 graded by code

Total 16; within 2019–2021, 2. Retracted W320 and STG W878 are excluded.

JSON: {"total": 16, "in_window": 2}

✅ R5 csv+ontology run 3 graded by code

W30: 16 total, 2 within 2019–2021.

JSON: {"total": 16, "in_window": 2}

❌ R5 csv+ontology run 4 graded by code

(no answer found)

JSON: {"total": null, "in_window": null}

Why: total: expected 16, got None; in_window: expected 2, got None

✅ R5 csv+ontology run 5 graded by code

W30 has 16 citations in total and 2 within 2019–2021 (W60 and W988).

JSON: {"total": 16, "in_window": 2}

✅ R10 executed run 1 graded by code

16 in total and 2 within 2019–2021 (W60 in 2020 and W988 in 2021).

JSON: {"total": 16, "in_window": 2}

✅ R10 executed run 2 graded by code

16 in total; 2 within 2019–2021 (W60 and W988).

JSON: {"total": 16, "in_window": 2}

✅ R10 executed run 3 graded by code

Total 16; within 2019–2021, 2. The citers are W60 (2020) and W988 (2021).

JSON: {"total": 16, "in_window": 2}

✅ R10 executed run 4 graded by code

Total 16; in window 2.
W30 is cited by 16 works, and only W60 (2020) and W988 (2021) fall within 2019–2021.

JSON: {"total": 16, "in_window": 2}

✅ R10 executed run 5 graded by code

W30 has 16 citations in total and 2 within 2019–2021 (W60, W988).

JSON: {"total": 16, "in_window": 2}