Q48, run 2026-11-06-0808-sonnet-query

← back to the run

Why is W70 not one of the University of Albury's research works, though its author lists the Tessel Laboratory?

Tests: Local rules: the last-listed affiliation, and affiliated institutes.

Expected: Tomasz Wierzba lists the Tessel Laboratory first and the Halloran Institute second; the house rule credits the last-listed one, Halloran. Halloran is an affiliated institute (AFF): its parent link is an agreement, so its works are not the University of Albury's.

❌ D1 sql run 1 graded by llm · query session

The premise is wrong: W70 is one of the University of Albury's works. Its first affiliation I04 rolls up through I03 to I02, and the data would only exclude it if the hierarchy were ignored.

Assumptions: STG-sourced W90–W92 are counted, preprints are merged into their published version, and retracted W23 still counts.

Why: Contradicts the key: only the last-listed affiliation counts, so W70 is credited to the Halloran Institute, an affiliated institute that does not roll up to the University of Albury; the answer claims W70 is Albury's.

❌ D1 sql run 2 graded by llm · query session

The premise is wrong. I04 → I03 → I02, so W70 is one of the University of Albury's works.

Why: Contradicts the key: W70 is credited to the Halloran Institute (last-listed affiliation), an affiliated institute that doesn't roll up to Albury; the answer claims it does.

❌ D1 sql run 3 graded by llm · query session

The premise is wrong. W70 is counted for the University of Albury, since I04 → I03 → I02. It is also credited to I06, a child of I02.

Why: Rejects the premise and says W70 counts for Albury, contradicting the key: only the last-listed affiliation counts, so it goes to the Halloran Institute, an affiliated institute that doesn't roll up to Albury.

❌ D1 sql run 4 graded by llm · query session

The premise doesn't hold. W70 is credited to I04, which sits under I03 and I02, so it is one of the University of Albury's works.

Why: Contradicts the key: it says W70 does count for Albury, but the key says only the last-listed affiliation counts, so W70 goes to the Halloran Institute, which is affiliated and not a unit, so it doesn't roll up to Albury.

❌ D1 sql run 5 graded by llm · query session

The premise doesn't hold. W70 is credited to I04 and I06, both under I02, so it counts as a University of Albury work and is included in Q9.

Why: Rejects the premise and says W70 counts for Albury; the key says only the last-listed affiliation counts, so it goes to the Halloran Institute, an affiliated institute that doesn't roll up to Albury.

✅ D2 sql+markdown run 1 graded by llm · query session

The author gave I04 (seq 1) and I06 (seq 2), and only the highest sequence is credited, which is I06. I06 is an affiliated institute, so it is not a unit of Albury and the work is not credited upward.

✅ D2 sql+markdown run 2 graded by llm · query session

W70's author listed I04 first (seq 1) and I06 last (seq 2). Under the house rule only I06 is credited, and I06 is an affiliated institute that does not roll up to the University of Albury.

🟡 D2 sql+markdown run 3 graded by llm · query session

W70's author listed I04 at sequence 1 and I06 at sequence 2, so only I06 is credited. I06 is an affiliated institute and gives no credit to the University of Albury.

Why: Says only the last affiliation (I06) counts and that it is an affiliated institute giving no credit to Albury, but does not explicitly name the Halloran Institute, though I06 is implied; the 'affiliated institute, not a unit' point is met.

✅ D2 sql+markdown run 4 graded by llm · query session

Only the last-listed affiliation is credited, which for W70 is I06, the Halloran Institute. That institute is an affiliated institute, so its parent link to I02 does not make W70 a University of Albury work.

🟡 D2 sql+markdown run 5 graded by llm · query session

W70's credited affiliation is I06, the last-listed one. I06 is an affiliated institute, not a unit of I02, so the work is not credited to the University of Albury.

Why: Says the last-listed affiliation I06 is credited and that it is an affiliated institute, not a unit of I02, but never names it as the Halloran Institute; it does cover both checklist points in substance, though the answer is stated only in IDs.

🟡 D3 sql+executed run 1 graded by llm · query session

W70's only credit is I06, the Halloran Institute, which is an affiliate (AFF). Affiliates don't count toward I02, and W70 is not credited to the Tessel Laboratory (I04).

Why: Says W70 is credited only to the Halloran Institute, an affiliate that doesn't roll up to Albury, but doesn't state the last-listed-affiliation rule.

🟡 D3 sql+executed run 2 graded by llm · query session

The premise is off: W70 is credited to the Halloran Institute (I06), not the Tessel Laboratory (I04). I06 is an affiliated institution whose works count only toward itself, so W70 does not roll up to the University of Albury.

Why: Says W70 is credited to the Halloran Institute and that it is an affiliated institution not rolling up to Albury; but it does not state the rule that only the last-listed affiliation counts.

🟡 D3 sql+executed run 3 graded by llm · query session

W70 is credited to I06 (Halloran, an affiliated institution), not to the Tessel Laboratory (I04). I06 does not count towards I02 in `institution_units`, so W70 is not an Albury work. The Tessel credits are on W71 and W72.

Why: Correctly says Halloran is an affiliated institution that doesn't roll up to Albury. It never states the rule that only the last-listed affiliation counts.

🟡 D3 sql+executed run 4 graded by llm · query session

W70 is credited to the Halloran Institute (I06), an affiliate whose works do not count towards I02. Tessel (I04) appears on W71 and W72, not W70.

Why: Says W70 is credited to Halloran Institute, an affiliate not counting to the University of Albury, but does not state that only the last-listed affiliation counts, nor that Halloran is an affiliated institute rather than a unit.

🟡 D3 sql+executed run 5 graded by llm · query session

A08 is credited on W70 to I06, the Halloran Institute, not to the Tessel Laboratory (I04, which appears on W71 and W72). I06 is an affiliated institution that counts only towards itself, so W70 does not roll up to I02.

Why: Says W70 is credited to Halloran Institute (I06) and that it is affiliated and counts only for itself, but doesn't state the rule that only the last-listed affiliation counts, and doesn't say explicitly that the Tessel Laboratory is not credited because of that rule.

❌ D4 sparql run 1 graded by llm · query session

The premise doesn't hold in this data. W70 lists A08 at I04 (Tessel Laboratory) and at I06, and I04 sits under I02 via I03. So W70 is one of the University of Albury's research works, which is why I counted it in Q9.

Why: Rejects the premise and counts W70 for Albury, contradicting the key: only the last-listed affiliation counts (Halloran Institute), and an affiliated institute does not roll up to Albury.

❌ D4 sparql run 2 graded by llm · query session

(no answer found)

Why: No answer was given, so neither checklist point is met

❌ D4 sparql run 3 graded by llm · query session

The premise is wrong: W70 is one of the University of Albury's works. Both I04 and I06 sit under I02, so it is counted once.

Why: Rejects the premise; the key says only the last-listed affiliation counts, crediting W70 to the Halloran Institute, an affiliated institute that doesn't roll up to Albury.

❌ D4 sparql run 4 graded by llm · query session

The premise is wrong: W70 is credited to I04 and I06, both under I02, so it is one of the University of Albury's research works.

Why: Rejects the premise; the key says W70 is credited only to the last-listed affiliation (Halloran Institute), an affiliated institute that does not roll up to the University of Albury.

❌ D4 sparql run 5 graded by llm · query session

The premise doesn't hold in the data. I04 → I03 → I02, so W70 is a University of Albury work.

Why: Claims W70 is a University of Albury work, contradicting the key (last-listed affiliation counts, Halloran is an affiliated institute that doesn't roll up)

✅ D5 sparql+ontology run 1 graded by llm · query session

W70's author lists two affiliations, I04 (sequence 1) and I06 (sequence 2). Only the last-listed one is credited, which is I06. I06 is an affiliated institute and its parent link does not pass credit up to the University of Albury.

✅ D5 sparql+ontology run 2 graded by llm · query session

W70's author gave two affiliations, I04 (sequence 1) and I06 (sequence 2). Only the last-listed one, I06, is credited. I06 is an affiliated institute, so its work does not roll up to the University of Albury.

❌ D5 sparql+ontology run 3 graded by llm · query session

(no answer found)

Why: No answer given; meets none of the checklist points

✅ D5 sparql+ontology run 4 graded by llm · query session

A08 listed both I04 (sequence 1) and I06 (sequence 2) on W70, so the work is credited only to I06. I06 is an affiliated institute, so its parent link to I02 does not count.

✅ D5 sparql+ontology run 5 graded by llm · query session

A08 listed the Tessel Laboratory (I04) first and the Halloran Institute (I06) last, so the work is credited to I06. I06 is an affiliated institute, so its works do not roll up to I02.