Q20, run 2026-11-06-0519-sonnet-query

← back to the run

Which works in the data are preprints of another work that is also in the data?

Tests: Versions: a shared title is the clue, version_of the evidence; W18 is a preprint with no published version.

Expected: works = ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877']

✅ D1 sql run 1 graded by code · query session

23 preprints, listed in the JSON, each pointing via `version_of` to a published work that is in the data.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D1 sql run 2 graded by code · query session

The 23 preprints whose original is also in the data: W02, W42, W210, W219, W226, W263, W322, W407, W416, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877, W1049.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D1 sql run 3 graded by code · query session

The 23 preprints whose original is also in the data: W02, W42, W210, W219, W226, W263, W322, W407, W416, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877, W1049.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D1 sql run 4 graded by code · query session

23 preprints point to a work that is also in the data (listed in the JSON).

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D1 sql run 5 graded by code · query session

W02, W42, W210, W219, W226, W263, W322, W407, W416, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877, W1049. Each is a PPR whose `version_of` target is also in the data.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D2 sql+markdown run 1 graded by code · query session

W02, W1049, W210, W219, W226, W263, W322, W407, W416, W42, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877. These all have `version_of` set. I did not separately check that each named published version exists in `works`.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

✅ D2 sql+markdown run 2 graded by code · query session

W02, W42, W210, W219, W226, W263, W322, W407, W416, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877, W1049. Each of these has its published version in the data.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

❌ D2 sql+markdown run 3 graded by code · query session

W02 (of W03) and W42 (of W31). Other preprints name published versions that are not in the data.

JSON: {"works": ["W02", "W42"]}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got ['W02', 'W42']

✅ D2 sql+markdown run 4 graded by code · query session

The 23 preprints listed in the JSON, from W02 to W877. Each names a published version that is also in the data.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

✅ D2 sql+markdown run 5 graded by code · query session

The 23 preprints with version_of set to a work that is also in the data are listed in the JSON.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

❌ D3 sql+executed run 1 graded by code · query session

None. The preprints in the data (PPR) have no matching published-version title, and merged preprints are already folded into their published works.

JSON: {"works": []}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got []

❌ D3 sql+executed run 2 graded by code · query session

None. Preprints are already merged into their published versions (for example W02 into W03). The remaining PPR works have no same-title counterpart in the data.

JSON: {"works": []}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got []

❌ D3 sql+executed run 3 graded by code · query session

None. The PPR works (W1054, W18, W221, W306, W336, W566, W745, W747, W780, W781, W824) each have only their own record ID, so none is merged into or paired with a published version in the data.

JSON: {"works": []}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got []

❌ D3 sql+executed run 4 graded by code · query session

None. Preprints are already merged into their published versions, and no preprint record matches another work's title.

JSON: {"works": []}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got []

❌ D3 sql+executed run 5 graded by code · query session

None. Preprints are merged into their published versions, and the 11 remaining PPR works have no published version in the data.

JSON: {"works": []}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got []

❌ D4 sparql run 1 graded by code · query session

W02, W42, W556, W612 and W663. These are the ones I saw in the data; I did not run a full listing, so the list may be incomplete.

JSON: {"works": ["W02", "W42", "W556", "W612", "W663"]}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got ['W02', 'W42', 'W556', 'W612', 'W663']

✅ D4 sparql run 2 graded by code · query session

23 works are preprints with a `versionOf` link to another work in the data (see the JSON).

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

✅ D4 sparql run 3 graded by code · query session

The 23 preprints that have a `versionOf` link: W02, W1049, W210, W219, W226, W263, W322, W407, W416, W42, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

✅ D4 sparql run 4 graded by code · query session

23 preprints point to a work that is also in the data. They are listed in the JSON, and all their targets are in the data.

JSON: {"works": ["W226", "W1049", "W432", "W210", "W416", "W506", "W611", "W219", "W460", "W663", "W877", "W263", "W407", "W42", "W556", "W612", "W522", "W728", "W524", "W730", "W545", "W322", "W02"]}

✅ D4 sparql run 5 graded by code · query session

The 23 preprints with a `versionOf` link: W02, W1049, W210, W219, W226, W263, W322, W407, W416, W42, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877.
**Q21–Q25.** Unresolved.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

❌ D5 sparql+ontology run 1 graded by code · query session

W02, W42, W556, W612 and W663.

JSON: {"works": ["W02", "W42", "W556", "W612", "W663"]}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got ['W02', 'W42', 'W556', 'W612', 'W663']

❌ D5 sparql+ontology run 2 graded by code · query session

W02 (preprint of W03) and W42 (preprint of W31).

JSON: {"works": ["W02", "W42"]}

Why: works: expected ['W02', 'W1049', 'W210', 'W219', 'W226', 'W263', 'W322', 'W407', 'W416', 'W42', 'W432', 'W460', 'W506', 'W522', 'W524', 'W545', 'W556', 'W611', 'W612', 'W663', 'W728', 'W730', 'W877'], got ['W02', 'W42']

✅ D5 sparql+ontology run 3 graded by code · query session

The 23 preprints with `versionOf` are W02, W42, W210, W219, W226, W263, W322, W407, W416, W432, W460, W506, W522, W524, W545, W556, W611, W612, W663, W728, W730, W877, W1049.

JSON: {"works": ["W02", "W42", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877", "W1049"]}

✅ D5 sparql+ontology run 4 graded by code · query session

The 23 preprints that name a published version are listed in the JSON, taken from the versionOf query.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}

✅ D5 sparql+ontology run 5 graded by code · query session

23 preprints, listed in the JSON below.

JSON: {"works": ["W02", "W1049", "W210", "W219", "W226", "W263", "W322", "W407", "W416", "W42", "W432", "W460", "W506", "W522", "W524", "W545", "W556", "W611", "W612", "W663", "W728", "W730", "W877"]}