Q48, run 2026-11-04-2010-sonnet

← back to the run

Why is W70 not one of the University of Albury's research works, though its author lists the Tessel Laboratory?

Tests: Local rules: the last-listed affiliation, and affiliated institutes.

Expected: Tomasz Wierzba lists the Tessel Laboratory first and the Halloran Institute second; the house rule credits the last-listed one, Halloran. Halloran is an affiliated institute (AFF): its parent link is an agreement, so its works are not the University of Albury's.

❌ R1 csv run 1 graded by llm

The premise is wrong. I04 sits under I03, which sits under I02, so W70 does count as a University of Albury work, and it is included in Q9.

Why: Rejects the premise and says W70 counts for Albury; the key says only the last-listed affiliation counts, so W70 goes to the Halloran Institute, an affiliated institute that does not roll up to Albury.

❌ R1 csv run 2 graded by llm

The premise is wrong. I04 → I03 → I02, so W70 does count toward the University of Albury (included in Q9).

Why: Claims W70 does count toward Albury; the key says only the last-listed affiliation counts (Halloran Institute), an affiliated institute that doesn't roll up to Albury.

❌ R1 csv run 3 graded by llm

The premise is wrong: W70 is one of the University of Albury's works. I04 rolls up to I03 and then to I02, and I06 is also under I02. W70 counts once for Albury even though it has two affiliations.

Assumptions: research types are ART, REV and PPR, with preprints deduplicated against their published version. Staging (STG) records are excluded.

Why: Rejects the premise and says W70 counts for Albury; the key says only the last-listed affiliation counts, so it goes to Halloran Institute, an affiliated institute that doesn't roll up to Albury

❌ R1 csv run 4 graded by llm

The premise doesn't hold. I04 sits under I03, then I02, so W70 is counted as an Albury work (see Q9).

Why: Rejects the premise and says W70 counts for Albury; the checklist says only the last-listed affiliation counts, crediting the Halloran Institute, an affiliated institute that doesn't roll up to Albury.

❌ R1 csv run 5 graded by llm

The premise is wrong, because W70 is one of the University of Albury's works. I04 sits under I03, which sits under I02, and I06 is also a child of I02. It is also a research ART (2023, S02).

Why: Rejects the premise and claims W70 is a University of Albury work; the key says only the last-listed affiliation counts, so W70 goes to the Halloran Institute, which is an affiliated institute and not a unit, so it doesn't roll up.

❌ R2 rdf run 1 graded by llm

The premise is wrong. W70 is credited to I04 (→ I03 → I02) and I06 (→ I02), so it is one of the University of Albury's research works, counted once (see Q9).

Why: Rejects the premise and says W70 counts for Albury, contradicting the key's points that only the last-listed affiliation counts (Halloran Institute) and that the affiliated institute doesn't roll up to Albury

❌ R2 rdf run 2 graded by llm

It is one of them. I04 sits under I03, which sits under I02, and A08's other affiliation I06 is also under I02. It is counted once in Q9.

Why: Claims W70 is a University of Albury work; contradicts the key, which says only the last-listed affiliation counts (Halloran Institute, an affiliated institute that doesn't roll up) and misses both points.

❌ R2 rdf run 3 graded by llm

The premise is wrong, because W70 is one of the University of Albury's works. W70 is credited to I04 (Tessel Laboratory) and I06 (Halloran Institute), and I04 → I03 → I02 and I06 → I02. It is counted once in Q9's 12.

Assumptions I applied:
- Research works are articles, reviews and preprints, with a preprint and its published version counted once.
- Editorials, errata, front matter and supplementary material are excluded.
- Records from every origin are counted.

Why: Asserts W70 is a University of Albury work, contradicting the key: only the last-listed affiliation (Halloran Institute) counts, and it is an affiliated institute that doesn't roll up

❌ R2 rdf run 4 graded by llm

The premise is false. W70 is credited to I04 and I06, and both roll up to I02 (I04 → I03 → I02; I06 → I02). So W70 is one of the University of Albury's works and is counted in Q9.

Why: Rejects the premise and says W70 counts for Albury, contradicting the key: only the last-listed affiliation counts, so it goes to the Halloran Institute, an affiliated institute that doesn't roll up.

❌ R2 rdf run 5 graded by llm

The premise is wrong. W70 is credited to I04 (→ I03 → I02) and I06 (→ I02), so it is one of the University of Albury's works.

Why: Rejects the premise and says W70 counts for Albury; the key says only the last-listed affiliation counts, so W70 is credited to Halloran Institute, an affiliated institute that doesn't roll up to Albury.

✅ R6 rdf+ontology run 1 graded by llm

A08 listed I04 first and I06 last, and only the last-listed affiliation is credited. I06 is an affiliated institute (AFF), so its link to I02 is not followed.

✅ R6 rdf+ontology run 2 graded by llm

A08 listed I04 (seq 1) and I06 (seq 2), and the house rule credits only the highest sequence, I06. I06 is an affiliated institute, so its parent link to I02 is not membership.

✅ R6 rdf+ontology run 3 graded by llm

A08 listed I04 (seq 1) and I06 (seq 2) on W70, and only the last-listed affiliation is credited, which is I06. I06 is an affiliated institute, so its parent link to I02 is not followed.

✅ R6 rdf+ontology run 4 graded by llm

A08 listed I04 (seq 1) and I06 (seq 2) on W70, and the house rule credits only the last-listed one, I06. I06 is an affiliated institute, so its link to I02 does not make it a unit and nothing is credited upward.

✅ R6 rdf+ontology run 5 graded by llm

A08 gave I04 (Tessel Laboratory) and I06 on W70, and only the last-listed affiliation, I06, is credited. I06 is an affiliated institute (AFF), so its parent link to I02 is not followed.

✅ R5 csv+ontology run 1 graded by llm

A08 listed I04 first and I06 last on W70, so only I06 is credited. I06 is an affiliated institute, and its parent link to I02 is not membership, so the work is never credited to I02.

🟡 R5 csv+ontology run 2 graded by llm

A08 listed I04 first and I06 last on W70. The house rule credits only the last-listed affiliation, which is I06. I06 is an affiliated institute, so its parent link to I02 is not followed.

Why: Gives last-listed-affiliation rule and credits I06, but says only that the parent link isn't followed because it's an affiliated institute; this covers the second point loosely, yet doesn't say it's an affiliated institute rather than a unit explicitly as the reason for no roll-up.

✅ R5 csv+ontology run 3 graded by llm

A08 listed I04 first and I06 last, and only the last-listed affiliation is credited. I06 is an affiliated institute, so its parent link does not make it part of I02 and W70 is not credited upward.

✅ R5 csv+ontology run 4 graded by llm

For W70, A08 listed I04 first and I06 last, and the house rule credits only the last-listed affiliation. I06 is an affiliated institute, not a unit of I02, so W70 is not credited to the University of Albury.

✅ R5 csv+ontology run 5 graded by llm

A08 listed I04 first and I06 second on W70, so under the last-listed rule only I06 is credited. I06 is an affiliated institute, and its parent link to I02 is not followed.

✅ R4 csv+markdown run 1 graded by llm

A08 listed I04 first and I06 last, so W70 is credited only to I06. I06 is an affiliated institute, so its parent link does not make it part of the University of Albury.

✅ R4 csv+markdown run 2 graded by llm

A08 listed I04 (sequence 1) and I06 (sequence 2) on W70. Only the last-listed affiliation counts, which is I06, and I06 is an affiliated institute whose link to I02 does not make it a unit.

✅ R4 csv+markdown run 3 graded by llm

A08 listed I04 first and I06 second on W70. Only the last-listed affiliation is credited, which is I06. I06 is an affiliated institute (AFF), so it is not a unit of I02 and its works are not credited upward.

✅ R4 csv+markdown run 4 graded by llm

A08 listed I04 first and I06 second on W70, and only the last-listed affiliation (highest sequence) is credited. That is I06, the Halloran Institute, which is an affiliated institute. Its parent link to I02 doesn't make it a unit, so the work never reaches the University of Albury.

✅ R4 csv+markdown run 5 graded by llm

A08 listed I04 (sequence 1) and I06 (sequence 2) on W70, and only the last-listed affiliation counts. So the work is credited to I06, an affiliated institute whose parent link does not pass credit up to I02.

❌ R3 csv+padding run 1 graded by llm

The premise doesn't hold. W70 lists I04 (Tessel) first, and I04 rolls up through I03 to I02, so it is a University of Albury work (counted in Q9).

Why: Rejects the premise and says W70 is an Albury work; the checklist says only the last-listed affiliation counts, crediting the Halloran Institute, which doesn't roll up to Albury.

❌ R3 csv+padding run 2 graded by llm

The premise is wrong. W70 does count as a University of Albury work, because I04 → I03 → I02. W70 is excluded only from I05, which sits under I01 but not under I02.

Why: Claims W70 does count for Albury; the key says only the last-listed affiliation counts (Halloran Institute), and as an affiliated institute it doesn't roll up to Albury.

❌ R3 csv+padding run 3 graded by llm

The premise is wrong, because W70 is one of the University of Albury's works. Its Tessel affiliation (I04) rolls up through I03 to I02, and its I06 affiliation also has parent I02.

**Assumptions:**
- "Research" means ART and REV. A preprint is merged into its published version.
- I excluded the staging records W90–W92 (`record_source` STG), which also drops their citations.

Why: Claims W70 does belong to Albury via roll-up, contradicting the key (last-listed affiliation only, Halloran Institute is affiliated, not a unit); meets neither point.

❌ R3 csv+padding run 4 graded by llm

The premise is wrong: W70 does count towards the University of Albury. A08 lists I04 (Tessel), which sits under I03 and then I02, so W70 rolls up to the University of Albury. It is also credited through I06 (Halloran), which has I02 as parent. W70 is included in the 12 for Q9.

Why: Rejects the premise and says W70 counts via Tessel and Halloran; the key says only the last-listed affiliation counts, crediting Halloran, an affiliated institute that doesn't roll up to Albury.

❌ R3 csv+padding run 5 graded by llm

The premise is wrong. W70 is a University of Albury work: I04 → I03 → I02, and its other affiliation, I06, is also under I02. It is counted once, not twice.

Why: Claims W70 is a University of Albury work, contradicting the key: only the last-listed affiliation counts, crediting the Halloran Institute, which is affiliated and not a unit, so it doesn't roll up.