Q22, run 2026-11-04-1711-sonnet

← back to the run

Which entities have ever been in default?

Tests: Default semantics: RD is a default; WD is not.

Expected: entities = ['E08']

✅ R1 csv run 1 graded by code

E08, which reached RD (A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 2 graded by code

E08, which was rated RD in A22.

JSON: {"entities": ["E08"]}

✅ R1 csv run 3 graded by code

E08, which reached RD (A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 4 graded by code

E08 (RD, A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 5 graded by code

E08, from the RD rating in A22.

JSON: {"entities": ["E08"]}

✅ R2 rdf run 1 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R2 rdf run 2 graded by code

E08 (RD, A22).

JSON: {"entities": ["E08"]}

✅ R2 rdf run 3 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R2 rdf run 4 graded by code

E08 (RD, A22).

JSON: {"entities": ["E08"]}

✅ R2 rdf run 5 graded by code

E08, which was rated RD in A22.

JSON: {"entities": ["E08"]}

✅ R6 rdf+ontology run 1 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R6 rdf+ontology run 2 graded by code

E08 (RD, A22).

JSON: {"entities": ["E08"]}

✅ R6 rdf+ontology run 3 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R6 rdf+ontology run 4 graded by code

E08. A22 set it to RD.

JSON: {"entities": ["E08"]}

✅ R6 rdf+ontology run 5 graded by code

E08 (RD in A22).

JSON: {"entities": ["E08"]}

✅ R5 csv+ontology run 1 graded by code

E08, which reached RD in A22. E16 is QA and ignored.

JSON: {"entities": ["E08"]}

✅ R5 csv+ontology run 2 graded by code

E08, because RD is a default (A22).

JSON: {"entities": ["E08"]}

✅ R5 csv+ontology run 3 graded by code

E08, through the RD in A22.

JSON: {"entities": ["E08"]}

✅ R5 csv+ontology run 4 graded by code

E08, which reached RD (A22).

JSON: {"entities": ["E08"]}

✅ R5 csv+ontology run 5 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 1 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 2 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 3 graded by code

E08, because of the RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 4 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 5 graded by code

E08. A22 moved it to RD, a default.

JSON: {"entities": ["E08"]}

✅ R3 csv+padding run 1 graded by code

E08 (RD, A22).

JSON: {"entities": ["E08"]}

✅ R3 csv+padding run 2 graded by code

E08, which has RD in A22.

JSON: {"entities": ["E08"]}

✅ R3 csv+padding run 3 graded by code

E08, through the RD in A22.

JSON: {"entities": ["E08"]}

✅ R3 csv+padding run 4 graded by code

E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R3 csv+padding run 5 graded by code

E08, which reached RD (A22).

JSON: {"entities": ["E08"]}