Q32, run 2026-11-04-2035-haiku

← back to the run

How many distinct works are within two citation hops of W01 (citing it, or citing a work that cites it)?

Tests: Two hops, counted once each.

Expected: count = 5

❌ R1 csv run 1 graded by code

6. Within two hops of W01 are W40 and W41 (hop 1), plus W50, W51, W52 and W90 (hop 2).

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 2 graded by code

6. **Reasoning:** One hop gives W40 and W41, and two hops add W50, W51, W52 and W90.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 3 graded by code

6. W40 and W41 cite W01, and W50, W51, W52 and W90 cite them.

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 4 graded by code

6. These are W40 and W41 (one hop), plus W50, W51, W52 and W90 (two hops).

JSON: {"count": 6}

Why: count: expected 5, got 6

❌ R1 csv run 5 graded by code

6. Hop 1 is W40 and W41; hop 2 is W50, W51, W52 and W90.

JSON: {"count": 6}

Why: count: expected 5, got 6

✅ R10 executed run 1 graded by code

5 (W40, W41, W50, W51, W52). Two are direct citers of W01 and three are second-hop citers.

JSON: {"count": 5}

✅ R10 executed run 2 graded by code

5. Within two hops of W01 are W40 and W41 (citing it), then W50, W51 and W52 (citing those).

JSON: {"count": 5}

✅ R10 executed run 3 graded by code

5. The works are W40 and W41 (one hop), then W50, W51 and W52 (two hops).

JSON: {"count": 5}

✅ R10 executed run 4 graded by code

Five: W40, W41, W50, W51, W52. This excludes W01 itself.

JSON: {"count": 5}

✅ R10 executed run 5 graded by code

5. Hop 1 is W40 and W41, and hop 2 is W50, W51 and W52.

JSON: {"count": 5}