Q44, run 2026-11-06-0206-sonnet

← back to the run

Which institutions are part of the Albury University System, at any level below it?

Tests: Local type: an affiliated institute (AFF) is not a unit of its parent.

Expected: institutions = ['I02', 'I03', 'I04', 'I05', 'I19', 'I20']

❌ R1 csv run 1 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R1 csv run 2 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R1 csv run 3 graded by code

I02, I03, I04, I05, I06, I19, I20, I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R1 csv run 4 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R1 csv run 5 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R3 csv+padding run 1 graded by code

I02, I03, I04, I05, I06, I19, I20, I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R3 csv+padding run 2 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R3 csv+padding run 3 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R3 csv+padding run 4 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

❌ R3 csv+padding run 5 graded by code

I02, I03, I04, I05, I06, I19, I20 and I21.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I06", "I19", "I20", "I21"]}

Why: institutions: expected ['I02', 'I03', 'I04', 'I05', 'I19', 'I20'], got ['I02', 'I03', 'I04', 'I05', 'I06', 'I19', 'I20', 'I21']

✅ R4 csv+markdown run 1 graded by code

I02, I03, I04, I05, I19 and I20. I06 and I21 are affiliated institutes, not units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R4 csv+markdown run 2 graded by code

I02, I03, I04, I05, I19 and I20. The affiliated institutes I06 and I21 are not units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R4 csv+markdown run 3 graded by code

I02, I03, I04, I05, I19 and I20. I06 and I21 are affiliated institutes, not units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R4 csv+markdown run 4 graded by code

I02, I03, I04, I19, I05 and I20. The affiliated institutes I06 and I21 are not units.

JSON: {"institutions": ["I02", "I03", "I04", "I19", "I05", "I20"]}

✅ R4 csv+markdown run 5 graded by code

I02, I03, I04, I05, I19 and I20. The affiliated institutes I06 and I21 are not units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R5 csv+ontology run 1 graded by code

I02, I03, I04, I05, I19 and I20. The affiliated institutes I06 and I21 are not part of the system.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R5 csv+ontology run 2 graded by code

I02, I03, I04, I19, I05, I20. The affiliated institutes I06 and I21 are not units.

JSON: {"institutions": ["I02", "I03", "I04", "I19", "I05", "I20"]}

✅ R5 csv+ontology run 3 graded by code

I02, I03, I04, I19, I05, I20. The affiliated institutes I06 and I21 are not part of the system.

JSON: {"institutions": ["I02", "I03", "I04", "I19", "I05", "I20"]}

✅ R5 csv+ontology run 4 graded by code

I02, I03, I04, I05, I19 and I20. The affiliated institutes I06 and I21 are not units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R5 csv+ontology run 5 graded by code

I02, I03, I04, I19, I05 and I20. I06 and I21 are affiliated institutes, so they are not part of the system.

JSON: {"institutions": ["I02", "I03", "I04", "I19", "I05", "I20"]}

✅ R10 executed run 1 graded by code

I02, I03, I04, I05, I19 and I20. I06 and I21 have a parent_id but are not listed in institution_units.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R10 executed run 2 graded by code

I02, I03, I04, I05, I19 and I20 (from institution_units; I06 and I21 are affiliates and do not roll up).

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R10 executed run 3 graded by code

I02, I03, I04, I05, I19 and I20. I06 and I21 have parents in institutions.csv but are not listed as counting towards the system.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R10 executed run 4 graded by code

I02, I03, I04, I05, I19 and I20, per institution_units. I06 and I21 have parent_ids but are not rolled up.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}

✅ R10 executed run 5 graded by code

I02, I03, I04, I05, I19 and I20. I06 and I21 list parents in institutions.csv, but institution_units does not roll them up.

JSON: {"institutions": ["I02", "I03", "I04", "I05", "I19", "I20"]}