Q22, run 2026-11-04-1738-sonnet

← back to the run

Which entities have ever been in default?

Tests: Default semantics: RD is a default; WD is not.

Expected: entities = ['E08']

✅ R1 csv run 1 graded by code

Only E08, which reached RD in A22.

JSON: {"entities": ["E08"]}

✅ R1 csv run 2 graded by code

E08 only (RD, A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 3 graded by code

E08, which reached RD on 2026-07-08 (A22).

JSON: {"entities": ["E08"]}

✅ R1 csv run 4 graded by code

Only E08, via A22 (RD).

JSON: {"entities": ["E08"]}

✅ R1 csv run 5 graded by code

E08 only, via RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 1 graded by code

E08 only, rated RD in A22.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 2 graded by code

Only E08. It reached CCC (A21) and then RD (A22).

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 3 graded by code

E08, the only entity ever rated RD or D (A22).

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 4 graded by code

E08 only. A22 is the only RD or D rating in the data.

JSON: {"entities": ["E08"]}

✅ R4 csv+markdown run 5 graded by code

E08 only, through its RD downgrade (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 1 graded by code

E08 only (RD, A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 2 graded by code

E08, the only entity ever rated RD (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 3 graded by code

E08 only (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 4 graded by code

E08 only, rated RD (A22).

JSON: {"entities": ["E08"]}

✅ R10 executed run 5 graded by code

E08 only, through its RD rating (A22).

JSON: {"entities": ["E08"]}