Q31, run 2026-11-06-0519-sonnet-query

Which works cite at least one of the works that cite W01?

Tests: Two hops; W51 cites both first-hop works; W90 is a test record.

Expected: works = ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895']

❌ D1 sql run 1 graded by code · query session

14 works, listed in the JSON.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W844", "W895", "W90", "W922"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W844', 'W895', 'W90', 'W922']

❌ D1 sql run 2 graded by code · query session

The 14 works that cite a work citing W01: W801, W844, W1042, W396, W682, W90, W922, W337, W546, W51, W50, W52, W895, W338.

JSON: {"works": ["W801", "W844", "W1042", "W396", "W682", "W90", "W922", "W337", "W546", "W51", "W50", "W52", "W895", "W338"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W801', 'W844', 'W1042', 'W396', 'W682', 'W90', 'W922', 'W337', 'W546', 'W51', 'W50', 'W52', 'W895', 'W338']

❌ D1 sql run 3 graded by code · query session

14 works: W396, W682, W50, W52, W1042, W90, W922, W51, W895, W801, W844, W337, W546, W338.

JSON: {"works": ["W396", "W682", "W50", "W52", "W1042", "W90", "W922", "W51", "W895", "W801", "W844", "W337", "W546", "W338"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W396', 'W682', 'W50', 'W52', 'W1042', 'W90', 'W922', 'W51', 'W895', 'W801', 'W844', 'W337', 'W546', 'W338']

❌ D1 sql run 4 graded by code · query session

14 works, listed in the JSON. They cite the 8 direct citers of W01.

JSON: {"works": ["W337", "W546", "W51", "W682", "W801", "W844", "W50", "W396", "W1042", "W895", "W338", "W52", "W90", "W922"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W337', 'W546', 'W51', 'W682', 'W801', 'W844', 'W50', 'W396', 'W1042', 'W895', 'W338', 'W52', 'W90', 'W922']

❌ D1 sql run 5 graded by code · query session

W801, W844, W50, W396, W90, W922, W337, W546, W52, W51, W338, W682, W895, W1042.

JSON: {"works": ["W801", "W844", "W50", "W396", "W90", "W922", "W337", "W546", "W52", "W51", "W338", "W682", "W895", "W1042"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W801', 'W844', 'W50', 'W396', 'W90', 'W922', 'W337', 'W546', 'W52', 'W51', 'W338', 'W682', 'W895', 'W1042']

✅ D2 sql+markdown run 1 graded by code · query session

W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801, W895. W01 has 7 direct citers, and these 11 works cite at least one of them.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D2 sql+markdown run 2 graded by code · query session

W50, W51, W52, W337, W338, W396, W546, W682, W801, W895, W1042.

JSON: {"works": ["W50", "W51", "W52", "W337", "W338", "W396", "W546", "W682", "W801", "W895", "W1042"]}

❌ D2 sql+markdown run 3 graded by code · query session

W16, W19, W25.

JSON: {"works": ["W16", "W19", "W25"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W16', 'W19', 'W25']

✅ D2 sql+markdown run 4 graded by code · query session

11 works: W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801 and W895.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D2 sql+markdown run 5 graded by code · query session

11 works, listed in the JSON.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D3 sql+executed run 1 graded by code · query session

W51, W50, W338, W546, W52, W337, W682, W1042, W801, W895, W396 (11 works).

JSON: {"works": ["W51", "W50", "W338", "W546", "W52", "W337", "W682", "W1042", "W801", "W895", "W396"]}

✅ D3 sql+executed run 2 graded by code · query session

W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801 and W895.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D3 sql+executed run 3 graded by code · query session

W682, W1042, W396, W801, W895, W50, W338, W546, W337, W51, W52.

JSON: {"works": ["W682", "W1042", "W396", "W801", "W895", "W50", "W338", "W546", "W337", "W51", "W52"]}

✅ D3 sql+executed run 4 graded by code · query session

W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801, W895.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D3 sql+executed run 5 graded by code · query session

W51, W682, W1042, W50, W338, W546, W895, W801, W396, W52, W337.

JSON: {"works": ["W51", "W682", "W1042", "W50", "W338", "W546", "W895", "W801", "W396", "W52", "W337"]}

❌ D4 sparql run 1 graded by code · query session

14 works: W682, W338, W396, W50, W51, W546, W895, W922, W52, W90, W1042, W337, W801 and W844.

JSON: {"works": ["W682", "W338", "W396", "W50", "W51", "W546", "W895", "W922", "W52", "W90", "W1042", "W337", "W801", "W844"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W682', 'W338', 'W396', 'W50', 'W51', 'W546', 'W895', 'W922', 'W52', 'W90', 'W1042', 'W337', 'W801', 'W844']

❌ D4 sparql run 2 graded by code · query session

The 14 level-2 works listed in the JSON.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W844", "W895", "W90", "W922"]}

❌ D4 sparql run 3 graded by code · query session

The 14 works at hop two: W682, W338, W396, W50, W51, W546, W895, W922, W52, W90, W1042, W337, W801, W844.

JSON: {"works": ["W682", "W338", "W396", "W50", "W51", "W546", "W895", "W922", "W52", "W90", "W1042", "W337", "W801", "W844"]}

❌ D4 sparql run 4 graded by code · query session

The 14 works in the JSON are the second-hop citers, found by following citations two steps from W01.

JSON: {"works": ["W682", "W338", "W396", "W50", "W51", "W546", "W895", "W922", "W52", "W90", "W1042", "W337", "W801", "W844"]}

❌ D4 sparql run 5 graded by code · query session

(no answer found)

JSON: {"works": []}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got []

✅ D5 sparql+ontology run 1 graded by code · query session

W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801 and W895. I excluded the staging records W844 and W90 and the retracted W922.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

❌ D5 sparql+ontology run 2 graded by code · query session

W50, W51, W52, W338, W395-type IDs are not involved; the works are W50, W51, W52, W338, W396, W546, W895 and W922. The STG work W90 is excluded.

JSON: {"works": ["W50", "W51", "W52", "W338", "W396", "W546", "W895", "W922"]}

Why: works: expected ['W1042', 'W337', 'W338', 'W396', 'W50', 'W51', 'W52', 'W546', 'W682', 'W801', 'W895'], got ['W50', 'W51', 'W52', 'W338', 'W396', 'W546', 'W895', 'W922']

✅ D5 sparql+ontology run 3 graded by code · query session

W50, W51, W52, W337, W338, W396, W546, W682, W801, W895, W1042. W01's valid citers are W40, W41, W229, W602, W657, W660 and W895.

JSON: {"works": ["W50", "W51", "W52", "W337", "W338", "W396", "W546", "W682", "W801", "W895", "W1042"]}

✅ D5 sparql+ontology run 4 graded by code · query session

The works that cite a work citing W01 are listed in the JSON, with W895 counted in both hops.

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}

✅ D5 sparql+ontology run 5 graded by code · query session

The 11 works at hop 2 (W1042, W337, W338, W396, W50, W51, W52, W546, W682, W801, W895).

JSON: {"works": ["W1042", "W337", "W338", "W396", "W50", "W51", "W52", "W546", "W682", "W801", "W895"]}