Q31, run 2026-11-04-1752-haiku

← back to the run

Which works cite at least one of the works that cite W01?

Tests: Two hops; W51 cites both first-hop works; W90 is a test record.

Expected: works = ['W50', 'W51', 'W52']

❌ R1 csv run 1 graded by code

W50, W51, W52 and W90. The works citing W01 are W40 and W41, and these four works cite one or both of them.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R1 csv run 2 graded by code

W50, W51, W52 and W90. W40 and W41 are the works citing W01; W50, W51, W52 and W90 cite them.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R1 csv run 3 graded by code

W50, W51, W52 and W90. W40 and W41 are the works that cite W01, and these four cite W40 or W41.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R1 csv run 4 graded by code

W50, W51, W52 and W90. These cite W40 or W41, which cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R1 csv run 5 graded by code

W50, W51, W52 and W90. W40 and W41 are the works citing W01, and these four cite W40 or W41.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R2 rdf run 1 graded by code

W50, W51, W52 and W90. These are the works citing W40 or W41, which are the two works that cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R2 rdf run 2 graded by code

W50, W51, W52, W90. These cite W40 or W41, which are the works citing W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R2 rdf run 3 graded by code

W50, W51, W52 and W90. These cite W40 or W41, which are the two works that cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R2 rdf run 4 graded by code

W50, W51, W52 and W90. These cite W40 or W41, which are the two works that cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R2 rdf run 5 graded by code

W50, W51, W52, W90. These cite W40 or W41, which are the two works that cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

✅ R6 rdf+ontology run 1 graded by code

W50, W51 and W52. W40 and W41 cite W01, and these cite W40 or W41. W90 is an STG test record and is excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R6 rdf+ontology run 2 graded by code

W50, W51 and W52. W50 and W51 cite W40, and W51 and W52 cite W41. W90 cites W41 but is a staging record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R6 rdf+ontology run 3 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01; W90 cites W41 but is a staging record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R6 rdf+ontology run 4 graded by code

W50, W51 and W52. These cite W40 or W41, which are the works citing W01; W90 is excluded as a staging record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R6 rdf+ontology run 5 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01. W90 cites W41 but is a staging record, so it is excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R5 csv+ontology run 1 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01. W90 also cites W41, but it is a staging record and is ignored.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R5 csv+ontology run 2 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01. W90 is an STG test record and is excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R5 csv+ontology run 3 graded by code

W50, W51 and W52. W40 and W41 cite W01; W50 and W51 cite W40, and W51 and W52 cite W41. W90 is excluded as a staging record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R5 csv+ontology run 4 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01. W90 also cites W41, but it is a staging record and is excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R5 csv+ontology run 5 graded by code

W50, W51 and W52. They cite W40 or W41, which are the works citing W01. W90 is a test record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R4 csv+markdown run 1 graded by code

W50, W51, W52. W40 and W41 are the works citing W01; W90 is a staging record and is ignored.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R4 csv+markdown run 2 graded by code

W50, W51 and W52. These cite W40 or W41, which cite W01. W90 is STG and excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R4 csv+markdown run 3 graded by code

W50, W51, W52. W40 and W41 cite W01; W50, W51 and W52 cite them; W90 is excluded as a staging record.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R4 csv+markdown run 4 graded by code

W50, W51, W52. W01 is cited by W40 and W41, and these are cited by W50, W51 and W52. W90 is an STG record and is excluded.

JSON: {"works": ["W50", "W51", "W52"]}

✅ R4 csv+markdown run 5 graded by code

W50, W51 and W52, which cite W40 or W41. Both of those cite W01. W90 is STG and excluded.

JSON: {"works": ["W50", "W51", "W52"]}

❌ R3 csv+padding run 1 graded by code

W50, W51, W52 and W90. These cite W40 or W41, and W40 and W41 are the works citing W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R3 csv+padding run 2 graded by code

W50, W51, W52 and W90. Each cites W40 or W41, which cite W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R3 csv+padding run 3 graded by code

W50, W51, W52 and W90. W40 and W41 cite W01; W50 and W51 cite W40, W51, W52 and W90 cite W41.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R3 csv+padding run 4 graded by code

W50, W51, W52, W90. They cite W40 or W41, which are the two works citing W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']

❌ R3 csv+padding run 5 graded by code

W50, W51, W52 and W90. Those are the works that cite W40 or W41, which are the two works citing W01.

JSON: {"works": ["W50", "W51", "W52", "W90"]}

Why: works: expected ['W50', 'W51', 'W52'], got ['W50', 'W51', 'W52', 'W90']