Q32, run 2026-11-06-0206-haiku

← back to the run

How many distinct works are within two citation hops of W01 (citing it, or citing a work that cites it)?

Tests: Two hops, counted once each.

Expected: count = 17

❌ R1 csv run 1 graded by code

20. The 8 direct citers of W01 plus 12 further distinct works two hops out.

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R1 csv run 2 graded by code

21 distinct works. That is the 8 direct citers of W01 plus 13 further works two hops away.

JSON: {"count": 21}

Why: count: expected 17, got 21

❌ R1 csv run 3 graded by code

20 distinct works are within two hops of W01.

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R1 csv run 4 graded by code

(no answer found)

Why: no structured answer

❌ R1 csv run 5 graded by code

(no answer found)

JSON: {"count": 21}

Why: count: expected 17, got 21

❌ R3 csv+padding run 1 graded by code

20. This is the 8 citers of W01 plus 14 citers of those, minus the 2 overlaps (W844, W895).

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R3 csv+padding run 2 graded by code

20 distinct works within two hops of W01 (8 direct citers and 14 second-hop citers, with W844 and W895 in both sets).

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R3 csv+padding run 3 graded by code

20 distinct works are within two hops of W01: the 8 direct citers plus 12 second-hop citers.

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R3 csv+padding run 4 graded by code

21 distinct works (8 direct citers of W01, plus 15 two-hop citers, minus 2 overlaps).

JSON: {"count": 21}

Why: count: expected 17, got 21

❌ R3 csv+padding run 5 graded by code

20 distinct works are within two hops of W01: 8 direct citers plus 12 second-hop citers.

JSON: {"count": 20}

Why: count: expected 17, got 20

❌ R4 csv+markdown run 1 graded by code

(no answer found)

Why: no structured answer

❌ R4 csv+markdown run 2 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 3 graded by code

17 works, within two citation hops of W01, excluding STG and retracted works.

JSON: {"count": 17}

❌ R4 csv+markdown run 4 graded by code

(no answer found)

Why: no structured answer

✅ R4 csv+markdown run 5 graded by code

17. Seven works cite W01 directly (W40, W41, W229, W602, W657, W660, W895), and 10 more cite those.

JSON: {"count": 17}

❌ R5 csv+ontology run 1 graded by code

(no answer found)

Why: no structured answer

✅ R5 csv+ontology run 2 graded by code

17. This is 7 works citing W01 (excluding STG W844) plus 11 works citing those, with W895 counted once.

JSON: {"count": 17}

❌ R5 csv+ontology run 3 graded by code

9 distinct works within two hops of W01 (5 direct citers plus 4 second-hop citers, excluding STG).

JSON: {"count": 9}

Why: count: expected 17, got 9

❌ R5 csv+ontology run 4 graded by code

(no answer found)

JSON: {"count": null}

Why: count: expected 17, got None

❌ R5 csv+ontology run 5 graded by code

18 works within two hops of W01, excluding STG and retracted records.

JSON: {"count": 18}

Why: count: expected 17, got 18

✅ R10 executed run 1 graded by code

17 works. Two hops give 7 citers of W01 (W40, W41, W229, W602, W657, W660, W895) and 10 citers of those, for 17 in total.

JSON: {"count": 17}

✅ R10 executed run 2 graded by code

17. Seven works cite W01 (W40, W41, W229, W602, W657, W660, W895), and 11 more are two hops away (from Q31). W895 is counted once.

JSON: {"count": 17}

✅ R10 executed run 3 graded by code

17. Within two hops: W40, W41, W229, W602, W657, W660, W895 (hop 1), plus W50, W51, W52, W337, W338, W396, W546, W682, W801, W1042 (hop 2).

JSON: {"count": 17}

✅ R10 executed run 4 graded by code

17.
Two-hop citers of W01 are the 7 direct citers (W40, W41, W229, W602, W657, W660, W895) plus 10 more (W50, W51, W52, W337, W338, W396, W546, W682, W801, W1042).

JSON: {"count": 17}

✅ R10 executed run 5 graded by code

17 works are within two citation hops of W01: W40, W41, W229, W602, W657, W660, W895 plus W50, W51, W52, W337, W338, W396, W546, W682, W801, W1042.

JSON: {"count": 17}