Q22, run 2026-11-04-2022-sonnet

← back to the run

Which entities have ever been in default?

Tests: Default semantics: RD is a default; WD is not.

Expected: entities = ['E08']

✅ R1 csv run 1 graded by code

E08. Its RD (A22) is the only default-grade rating in the data.

JSON: {"entities": ["E08"]}

✅ R1 csv run 2 graded by code

E08 only (RD, A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 3 graded by code

E08, the only entity with a default-grade (RD) rating (A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 4 graded by code

E08 only (RD, A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 5 graded by code

E08 only, via RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 1 graded by code

Only E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 2 graded by code

E08 only, which reached RD via A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 3 graded by code

E08. It is the only entity ever rated RD or D (A22).

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 4 graded by code

E08 only. It is the only entity with an RD or D rating (A22).

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 5 graded by code

E08. It is the only entity ever rated RD or D (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 1 graded by code

Only E08, which reached RD in 2026 (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 2 graded by code

Only E08, which went to RD on 2026-07-08 (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 3 graded by code

E08 only, through RD (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 4 graded by code

E08 only. It has the only RD rating (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 5 graded by code

E08, the only entity ever rated RD or D (A22).

JSON: {"entities": ["E08"]}

✅ R8 csv+axioms run 1 graded by code

E08 only. A22 is the only RD/D rating in the data.

JSON: {"entities": ["E08"]}

✅ R8 csv+axioms run 2 graded by code

E08 only, the only RD or D in the data (A22).

JSON: {"entities": ["E08"]}

✅ R8 csv+axioms run 3 graded by code

E08 only, via A22 (RD).

JSON: {"entities": ["E08"]}

✅ R8 csv+axioms run 4 graded by code

E08, via A22 (RD).

JSON: {"entities": ["E08"]}

✅ R8 csv+axioms run 5 graded by code

E08 only. It is the only entity with an RD or D rating (A22).

JSON: {"entities": ["E08"]}