Run 2026-11-04-1738-sonnet-query

Credit ratings: at 300 issuers claude:sonnet query 48 questions started 2026-11-04 17:38 commit 973d22f done

Accuracy

Condition	Repeats	Accuracy	95% interval
D1 `sql`	5	87%	77–95%
D2 `sql+markdown`	5	98%	96–100%
D4 `sparql`	5	80%	70–89%
D5 `sparql+ontology`	5	97%	94–100%

Queries

Condition	Queries run	Failed	Rounds, on average
D1 `sql`	102	1	5.8
D2 `sql+markdown`	93	2	6.2
D4 `sparql`	124	1	6.8
D5 `sparql+ontology`	94	5 (2 timed out)	6.6

Question by question

One mark per repeat; hover for the grader's reason, click a question for every answer to it.

Question D1 sql D2 sql+markdown D4 sparql D5 sparql+ontology

Q1 What was Kestrel Energy's rating on 1 January 2025? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q2 Has Kestrel Energy been downgraded in 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q3 Is Kestrel Energy's 2031 note investment grade? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q4 What is Northwind Holdings' current outlook? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q5 Whose credit risk does a holder of the Northwind Finance 2030 notes take, and how is it rated? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q6 Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating? 🟡✅✅✅✅ ✅✅✅🟡✅ ✅🟡🟡🟡✅ 🟡❌✅✅✅

Q7 Which issuers were downgraded in 2026? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅✅✅✅

Q8 Which entities were in default on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q9 As of 1 October 2026, how many distinct issuers hold an issuer rating? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅✅✅✅

Q10 Is Valdoria Telecom investment grade? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ❌✅✅✅✅

Q11 What was Marlow Utilities' rating on 1 June 2025? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q12 What was Marlow Utilities' rating on 1 January 2024? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q13 How many times has Marlow Utilities been downgraded? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q14 What was Halden Foods' rating on 1 January 2024? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q15 What was Halden Bank's rating on 1 January 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q16 Has Marlow Utilities' rating changed since 1 January 2025? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q17 Was Orrin Bank downgraded in 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q18 Which issuers were on Rating Watch Negative on 1 October 2026? ✅✅✅❌✅ ✅✅✅✅✅ ✅✅❌❌✅ ✅✅✅✅✅

Q19 Which issuers had a Negative outlook on 1 October 2026? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅❌✅❌

Q20 Is Pellam Retail in default? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q21 Which entities had an issuer rating at some point but no longer had one on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅❌❌❌ ❌❌✅✅✅

Q22 Which entities have ever been in default? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q23 What is Kestrel Energy's short-term rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q24 Is Kestrel Energy's issuer rating investment grade? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q25 How many instruments held an investment-grade rating on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅❌✅❌✅ ✅✅✅✅✅

Q26 What is Corvenia Power's local-currency rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q27 How is Corvenia Power's 2032 note rated? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q28 What is the Republic of Corvenia's foreign-currency issuer rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q29 What is the Republic of Valdoria's issuer rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q30 Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅❌✅✅ ✅✅✅✅✅

Q31 Did any company have a foreign-currency issuer rating above its country's ceiling on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅❌✅✅ ✅✅✅✅✅

Q32 Who is Halden Leasing's ultimate parent? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q33 Whose credit risk does a holder of the Halden Leasing 2028 notes take, and how is it rated? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q34 Is Halden Foods part of the same group as Halden Bank? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q35 How many entities are in the Halden group, the parent included? ✅✅✅✅✅ ✅✅✅✅❌ ✅✅✅✅✅ ✅✅✅✅✅

Q36 How many entities are in the Northwind group, the parent included? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q37 How many distinct legal entities does the data describe? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅✅✅✅

Q38 Are Orrin Bank AG and Orrin Bancorp Inc the same entity? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q39 What is Northwind Holdings' current rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q40 How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅✅✅✅

Q41 What is Brindle Capital's current rating? ❌❌❌❌❌ ✅✅✅✅✅ ❌❌❌❌❌ ✅✅✅✅✅

Q42 In which country is Halden Bank domiciled? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q43 How many distinct entities are domiciled in Luxembourg (LU)? ✅✅✅✅✅ ❌✅❌✅✅ ❌✅✅✅❌ ✅✅✅✅✅

Q44 Is Valdoria Telecom's 2027 note a local-currency obligation? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q45 Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows? ✅✅✅✅✅ ✅✅✅✅❌ ❌✅❌✅✅ ✅✅✅✅✅

Q46 Does Halden Leasing have an issuer rating? ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅ ✅✅✅✅✅

Q47 How is Corvenia Power's 2034 note rated? ✅✅✅✅✅ ✅✅✅✅✅ ✅❌✅❌✅ ✅✅✅✅✅

Q48 How many instruments held a rating on 1 October 2026? ✅✅✅✅✅ ✅✅✅✅✅ ✅❌✅❌✅ ✅✅✅✅✅

Question	D1 `sql`	D2 `sql+markdown`	D4 `sparql`	D5 `sparql+ontology`
Q1 What was Kestrel Energy's rating on 1 January 2025?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q2 Has Kestrel Energy been downgraded in 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q3 Is Kestrel Energy's 2031 note investment grade?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q4 What is Northwind Holdings' current outlook?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q5 Whose credit risk does a holder of the Northwind Finance 2030 notes take, and how is it rated?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q6 Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating?	🟡✅✅✅✅	✅✅✅🟡✅	✅🟡🟡🟡✅	🟡❌✅✅✅
Q7 Which issuers were downgraded in 2026?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅✅✅✅
Q8 Which entities were in default on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q9 As of 1 October 2026, how many distinct issuers hold an issuer rating?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅✅✅✅
Q10 Is Valdoria Telecom investment grade?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	❌✅✅✅✅
Q11 What was Marlow Utilities' rating on 1 June 2025?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q12 What was Marlow Utilities' rating on 1 January 2024?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q13 How many times has Marlow Utilities been downgraded?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q14 What was Halden Foods' rating on 1 January 2024?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q15 What was Halden Bank's rating on 1 January 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q16 Has Marlow Utilities' rating changed since 1 January 2025?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q17 Was Orrin Bank downgraded in 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q18 Which issuers were on Rating Watch Negative on 1 October 2026?	✅✅✅❌✅	✅✅✅✅✅	✅✅❌❌✅	✅✅✅✅✅
Q19 Which issuers had a Negative outlook on 1 October 2026?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅❌✅❌
Q20 Is Pellam Retail in default?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q21 Which entities had an issuer rating at some point but no longer had one on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅❌❌❌	❌❌✅✅✅
Q22 Which entities have ever been in default?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q23 What is Kestrel Energy's short-term rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q24 Is Kestrel Energy's issuer rating investment grade?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q25 How many instruments held an investment-grade rating on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅❌✅❌✅	✅✅✅✅✅
Q26 What is Corvenia Power's local-currency rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q27 How is Corvenia Power's 2032 note rated?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q28 What is the Republic of Corvenia's foreign-currency issuer rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q29 What is the Republic of Valdoria's issuer rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q30 Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅❌✅✅	✅✅✅✅✅
Q31 Did any company have a foreign-currency issuer rating above its country's ceiling on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅✅❌✅✅	✅✅✅✅✅
Q32 Who is Halden Leasing's ultimate parent?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q33 Whose credit risk does a holder of the Halden Leasing 2028 notes take, and how is it rated?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q34 Is Halden Foods part of the same group as Halden Bank?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q35 How many entities are in the Halden group, the parent included?	✅✅✅✅✅	✅✅✅✅❌	✅✅✅✅✅	✅✅✅✅✅
Q36 How many entities are in the Northwind group, the parent included?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q37 How many distinct legal entities does the data describe?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅✅✅✅
Q38 Are Orrin Bank AG and Orrin Bancorp Inc the same entity?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q39 What is Northwind Holdings' current rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q40 How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅✅✅✅
Q41 What is Brindle Capital's current rating?	❌❌❌❌❌	✅✅✅✅✅	❌❌❌❌❌	✅✅✅✅✅
Q42 In which country is Halden Bank domiciled?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q43 How many distinct entities are domiciled in Luxembourg (LU)?	✅✅✅✅✅	❌✅❌✅✅	❌✅✅✅❌	✅✅✅✅✅
Q44 Is Valdoria Telecom's 2027 note a local-currency obligation?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q45 Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows?	✅✅✅✅✅	✅✅✅✅❌	❌✅❌✅✅	✅✅✅✅✅
Q46 Does Halden Leasing have an issuer rating?	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅	✅✅✅✅✅
Q47 How is Corvenia Power's 2034 note rated?	✅✅✅✅✅	✅✅✅✅✅	✅❌✅❌✅	✅✅✅✅✅
Q48 How many instruments held a rating on 1 October 2026?	✅✅✅✅✅	✅✅✅✅✅	✅❌✅❌✅	✅✅✅✅✅

The prompts

The report, as report.md

credit_300: claude:sonnet, 2026-11-04 17:38

48 questions, 5 repeats per condition. Correct = 1, partial = ½. Graded by code where a question has a typed key, by claude:sonnet with a checklist otherwise.

Accuracy

Condition	Accuracy	95% interval	Questions unstable across repeats
D1 `sql`	87%	77% to 95%	2 of 48
D2 `sql+markdown`	98%	96% to 100%	4 of 48
D4 `sparql`	80%	70% to 89%	10 of 48
D5 `sparql+ontology`	97%	94% to 100%	4 of 48

Against D1 `sql`, question by question

Condition	Difference	95% interval
D2 `sql+markdown`	+11 points	+2 to +22
D4 `sparql`	-7 points	-12 to -3
D5 `sparql+ontology`	+10 points	+2 to +20

By question

Question	Graded by	D1 `sql`	D2 `sql+markdown`	D4 `sparql`	D5 `sparql+ontology`
Q1	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q2	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q3	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q4	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q5	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q6	llm	🟡 ✅ ✅ ✅ ✅	✅ ✅ ✅ 🟡 ✅	✅ 🟡 🟡 🟡 ✅	🟡 ❌ ✅ ✅ ✅
Q7	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅
Q8	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q9	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅
Q10	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	❌ ✅ ✅ ✅ ✅
Q11	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q12	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q13	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q14	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q15	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q16	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q17	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q18	code	✅ ✅ ✅ ❌ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ❌ ❌ ✅	✅ ✅ ✅ ✅ ✅
Q19	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ❌ ✅ ❌
Q20	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q21	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ❌ ❌ ❌	❌ ❌ ✅ ✅ ✅
Q22	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q23	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q24	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q25	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ❌ ✅ ❌ ✅	✅ ✅ ✅ ✅ ✅
Q26	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q27	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q28	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q29	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q30	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ❌ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q31	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ❌ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q32	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q33	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q34	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q35	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ❌	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q36	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q37	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅
Q38	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q39	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q40	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅
Q41	code	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅	❌ ❌ ❌ ❌ ❌	✅ ✅ ✅ ✅ ✅
Q42	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q43	code	✅ ✅ ✅ ✅ ✅	❌ ✅ ❌ ✅ ✅	❌ ✅ ✅ ✅ ❌	✅ ✅ ✅ ✅ ✅
Q44	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q45	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ❌	❌ ✅ ❌ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q46	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅
Q47	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ❌ ✅ ❌ ✅	✅ ✅ ✅ ✅ ✅
Q48	code	✅ ✅ ✅ ✅ ✅	✅ ✅ ✅ ✅ ✅	✅ ❌ ✅ ❌ ✅	✅ ✅ ✅ ✅ ✅

Lists, with partial credit

The 7 questions answered with a list of entities: strict accuracy (the whole list right) against the mean F1 of the lists given, which credits a list that is nearly right.

Condition	Strict	Mean F1
D1 `sql`	69%	96%
D2 `sql+markdown`	100%	100%
D4 `sparql`	54%	92%
D5 `sparql+ontology`	89%	100%

The checklist grader agreed with itself on 17 of 20 answers graded twice.

Why each miss was marked

Q6. Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating?

D1 sql run 1: Mentions the BB country ceiling alongside the ratings but explicitly says no reason is stated; never names the ceiling as the cause nor says it caps only foreign-currency ratings.
D2 sql+markdown run 4: Identifies the BB Country Ceiling as consistent with a cap on the FC rating but hedges and states it's not answerable, and doesn't clearly say the ceiling applies to foreign-currency and not local-currency ratings.
D4 sparql run 2: Identifies the BB country ceiling and that it is consistent with capping FC, but hedges and doesn't assert the ceiling as the cause or explicitly state it doesn't cap LC.
D4 sparql run 3: Names the BB Country Ceiling as the cap on the FC rating, but never states that the ceiling applies to foreign-currency and not local-currency ratings, and hedges with 'appears' and 'no explicit reason'.
D4 sparql run 4: Names the BB Country Ceiling as the likely cause, but hedges and never says the ceiling caps foreign-currency ratings and not local-currency ones.
D5 sparql+ontology run 1: Identifies the BB Valdoria ceiling and FC/LC gap as consistent with a cap, but hedges that no record states the cause and doesn't clearly say the ceiling applies to FC and not LC.
D5 sparql+ontology run 2: No answer was given, so neither the Country Ceiling (BB) cause nor the foreign- vs local-currency distinction is met.

Q7. Which issuers were downgraded in 2026?

D1 sql run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1167', 'E1058', 'E1341', 'E1344', 'E1080', 'E1263', 'E1345', 'E1349', 'E1307', 'E1228', 'E1298', 'E1255', 'E1229', 'E1340', 'E1346', 'E16', 'E1034', 'E1342', 'E1160', 'E10', 'E1351', 'E1294', 'E1350', 'E1151', 'E1290', 'E1285', 'E1343', 'E1064', 'E1093', 'E1144', 'E1053', 'E1057', 'E1159', 'E1243', 'E1347', 'E1051', 'E1300', 'E1213', 'E1163', 'E1169', 'E1186', 'E1348', 'E1112', 'E08']
D1 sql run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1151', 'E1350', 'E1294', 'E1341', 'E1167', 'E1058', 'E1285', 'E1290', 'E16', 'E1340', 'E1346', 'E1344', 'E1169', 'E1112', 'E08', 'E1348', 'E1186', 'E1342', 'E10', 'E1351', 'E1160', 'E1144', 'E1053', 'E1057', 'E1243', 'E1159', 'E1080', 'E1034', 'E1347', 'E1051', 'E1093', 'E1064', 'E1343', 'E1263', 'E1345', 'E1349', 'E1307', 'E1229', 'E1228', 'E1298', 'E1255', 'E1213', 'E1163', 'E1300']
D1 sql run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1186', 'E1243', 'E1255', 'E08', 'E1151', 'E1298', 'E1307', 'E1213', 'E1080', 'E1285', 'E1112', 'E1263', 'E1064', 'E1347', 'E1348', 'E1344', 'E1163', 'E1053', 'E1051', 'E1300', 'E10', 'E1034', 'E1229', 'E16', 'E1144', 'E1159', 'E1057', 'E1340', 'E1228', 'E1294', 'E1058', 'E1342', 'E1093', 'E1160', 'E1343', 'E1290', 'E1169', 'E1350', 'E1167', 'E1345', 'E1351', 'E1349', 'E1346']
D1 sql run 4: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1034', 'E1170', 'E1159', 'E1057', 'E1299', 'E1243', 'E1053', 'E1144', 'E1064', 'E1343', 'E1093', 'E1350', 'E1151', 'E1294', 'E1347', 'E1051', 'E1307', 'E1228', 'E1349', 'E1263', 'E1255', 'E1229', 'E1345', 'E1344', 'E1080', 'E08', 'E1112', 'E1186', 'E1348', 'E16', 'E1346', 'E1340', 'E10', 'E1351', 'E1161', 'E1342', 'E1163', 'E1213', 'E1300', 'E1285', 'E1290', 'E1058', 'E1167']
D1 sql run 5: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E16', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351']
D4 sparql run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16']
D4 sparql run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E16']
D4 sparql run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E16']
D4 sparql run 4: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16']
D4 sparql run 5: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16']

Q9. As of 1 October 2026, how many distinct issuers hold an issuer rating?

D1 sql run 1: count: expected 278, got 291
D1 sql run 2: count: expected 278, got 291
D1 sql run 3: count: expected 278, got 291
D1 sql run 4: count: expected 278, got 291
D1 sql run 5: count: expected 278, got 291
D4 sparql run 1: count: expected 278, got 290
D4 sparql run 2: count: expected 278, got 290
D4 sparql run 3: count: expected 278, got 290
D4 sparql run 4: count: expected 278, got 290
D4 sparql run 5: count: expected 278, got 289

Q10. Is Valdoria Telecom investment grade?

D5 sparql+ontology run 1: investment_grade: expected depends, got no

Q18. Which issuers were on Rating Watch Negative on 1 October 2026?

D1 sql run 4: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E1037', 'E1126', 'E1132', 'E1168', 'E1006', 'E1133', 'E1203', 'E1260', 'E1317', 'E1210', 'E1264', 'E1267', 'E1109', 'E1061', 'E1323', 'E1066', 'E1098', 'E1266', 'E1314', 'E06', 'E1297', 'E1013', 'E1146', 'E1181', 'E1238', 'E1099', 'E1088', 'E1194', 'E1039', 'E1242']
D4 sparql run 3: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E06', 'E1006', 'E1013', 'E1037', 'E1039', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146']
D4 sparql run 4: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E1006', 'E1013', 'E1037', 'E1039', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1210', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323', 'E06']

Q19. Which issuers had a Negative outlook on 1 October 2026?

D1 sql run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E1005', 'E1080', 'E1055', 'E1350', 'E1294', 'E1188', 'E1248', 'E1034', 'E1351', 'E1029', 'E1342', 'E1160', 'E1228', 'E1345', 'E1263', 'E1211', 'E09', 'E1046', 'E1348', 'E1158', 'E1344', 'E1105', 'E1059', 'E1282', 'E1056', 'E1340', 'E1300', 'E1347', 'E1271', 'E1261', 'E1343', 'E01', 'E1118', 'E1064', 'E1072', 'E1190', 'E1079']
D1 sql run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E1350', 'E1055', 'E1294', 'E1188', 'E1248', 'E1034', 'E1347', 'E1271', 'E1261', 'E1118', 'E1064', 'E01', 'E1343', 'E1345', 'E1228', 'E1263', 'E1029', 'E1342', 'E1351', 'E1160', 'E09', 'E1211', 'E1080', 'E1005', 'E1340', 'E1056', 'E1059', 'E1282', 'E1105', 'E1344', 'E1158', 'E1046', 'E1348', 'E1072', 'E1190', 'E1079', 'E1300']
D1 sql run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E1211', 'E1340', 'E1350', 'E1271', 'E1263', 'E1248', 'E1064', 'E1105', 'E1345', 'E1294', 'E1300', 'E1079', 'E1059', 'E1190', 'E1262', 'E1046', 'E1342', 'E01', 'E1347', 'E1282', 'E1348', 'E1228', 'E1344', 'E1055', 'E1029', 'E09', 'E1005', 'E1034', 'E1188', 'E1080', 'E1158', 'E1056', 'E1343', 'E1351', 'E1160', 'E1072', 'E1118']
D1 sql run 4: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E1055', 'E1263', 'E1340', 'E09', 'E1079', 'E1105', 'E1161', 'E1228', 'E1262', 'E1005', 'E1300', 'E1072', 'E1211', 'E1282', 'E01', 'E1188', 'E1190', 'E1344', 'E1347', 'E1029', 'E1046', 'E1064', 'E1248', 'E1294', 'E1342', 'E1060', 'E1350', 'E1351', 'E1056', 'E1343', 'E1348', 'E1034', 'E1080', 'E1118', 'E1158', 'E1345', 'E1271']
D1 sql run 5: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E1348', 'E1046', 'E1190', 'E1072', 'E1350', 'E1294', 'E1055', 'E1105', 'E1344', 'E1158', 'E1079', 'E09', 'E1211', 'E1160', 'E1351', 'E1029', 'E1342', 'E1034', 'E1248', 'E1188', 'E1271', 'E1347', 'E1056', 'E1340', 'E1059', 'E1282', 'E1005', 'E1080', 'E1228', 'E1263', 'E1345', 'E1300', 'E1343', 'E1064', 'E01', 'E1261', 'E1118']
D4 sparql run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09']
D4 sparql run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351']
D4 sparql run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1158']
D4 sparql run 4: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09']
D4 sparql run 5: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09']
D5 sparql+ontology run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1132', 'E1146', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300']
D5 sparql+ontology run 5: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300'], got ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1132', 'E1146', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300']

Q21. Which entities had an issuer rating at some point but no longer had one on 1 October 2026?

D4 sparql run 3: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07', 'E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155']
D4 sparql run 4: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D4 sparql run 5: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1106', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D5 sparql+ontology run 1: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D5 sparql+ontology run 2: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1316', 'E1032', 'E1057', 'E1159', 'E1233', 'E1107', 'E1001', 'E1155', 'E1277', 'E1205', 'E1140', 'E1021', 'E1084', 'E1172', 'E1308', 'E1041', 'E1320', 'E1062', 'E1225', 'E1138', 'E1200', 'E1076', 'E1279', 'E1166', 'E1234', 'E1206', 'E1121', 'E1007', 'E1124', 'E1219', 'E1048', 'E1218', 'E1063', 'E07', 'E1254', 'E1244']

Q25. How many instruments held an investment-grade rating on 1 October 2026?

D4 sparql run 2: count: expected 66, got 69
D4 sparql run 4: count: expected 66, got 69

Q30. Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026?

D4 sparql run 3: entities: expected ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15'], got ['E05', 'E1028', 'E1101', 'E1126']

Q31. Did any company have a foreign-currency issuer rating above its country's ceiling on 1 October 2026?

D4 sparql run 3: any: expected no, got yes

Q35. How many entities are in the Halden group, the parent included?

D2 sql+markdown run 5: count: expected 3, got 4

Q37. How many distinct legal entities does the data describe?

D1 sql run 1: count: expected 331, got 344
D1 sql run 2: count: expected 331, got 344
D1 sql run 3: count: expected 331, got 344
D1 sql run 4: count: expected 331, got 344
D1 sql run 5: count: expected 331, got 344
D4 sparql run 1: count: expected 331, got 344
D4 sparql run 2: count: expected 331, got 344
D4 sparql run 3: count: expected 331, got 344
D4 sparql run 4: count: expected 331, got 344
D4 sparql run 5: count: expected 331, got 344

Q40. How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026?

D1 sql run 1: count: expected 66, got 74
D1 sql run 2: count: expected 66, got 74
D1 sql run 3: count: expected 66, got 74
D1 sql run 4: count: expected 66, got 74
D1 sql run 5: count: expected 66, got 74
D4 sparql run 1: count: expected 66, got 74
D4 sparql run 2: count: expected 66, got 74
D4 sparql run 3: count: expected 66, got 74
D4 sparql run 4: count: expected 66, got 74
D4 sparql run 5: count: expected 66, got 74

Q41. What is Brindle Capital's current rating?

D1 sql run 1: rating: expected none, got BB+
D1 sql run 2: rating: expected none, got BB+
D1 sql run 3: rating: expected none, got BB+
D1 sql run 4: rating: expected none, got BB+
D1 sql run 5: rating: expected none, got BB+
D4 sparql run 1: rating: expected none, got BB+
D4 sparql run 2: rating: expected none, got BB+
D4 sparql run 3: rating: expected none, got BB+
D4 sparql run 4: rating: expected none, got BB+
D4 sparql run 5: rating: expected none, got BB+

Q43. How many distinct entities are domiciled in Luxembourg (LU)?

D2 sql+markdown run 1: count: expected 0, got 1
D2 sql+markdown run 3: count: expected 0, got 1
D4 sparql run 1: count: expected 0, got 1
D4 sparql run 5: count: expected 0, got 1

Q45. Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows?

D2 sql+markdown run 5: above_ceiling: expected no, got yes
D4 sparql run 1: above_ceiling: expected no, got yes
D4 sparql run 3: above_ceiling: expected no, got yes

Q47. How is Corvenia Power's 2034 note rated?

D4 sparql run 2: rating: expected none, got A
D4 sparql run 4: rating: expected none, got A

Q48. How many instruments held a rating on 1 October 2026?

D4 sparql run 2: count: expected 106, got 112
D4 sparql run 4: count: expected 106, got 112

Run 2026-11-04-1738-sonnet-query

Accuracy

Queries

Question by question

The prompts

credit_300: claude:sonnet, 2026-11-04 17:38

Accuracy

Against D1 sql, question by question

By question

Lists, with partial credit

Why each miss was marked

Against D1 `sql`, question by question