Run 2026-11-04-2024-sonnet-query

Credit ratings: ownership paths claude:sonnet query 61 questions started 2026-11-04 20:24 commit d26713f done

Accuracy

Condition	Repeats	Accuracy	95% interval
D1 `sql`	3	74%	63–84%
D2 `sql+markdown`	3	86%	82–90%
D3 `sql+executed`	3	95%	91–98%
D4 `sparql`	3	66%	55–76%
D5 `sparql+ontology`	3	96%	92–99%
D6 `sparql+axioms`	3	82%	73–90%

Queries

Condition	Queries run	Failed	Rounds, on average
D1 `sql`	58	0	6.3
D2 `sql+markdown`	42	3	5.0
D3 `sql+executed`	57	1	5.3
D4 `sparql`	62	0	6.7
D5 `sparql+ontology`	94	3 (3 timed out)	5.7
D6 `sparql+axioms`	73	1 (1 timed out)	6.3

Question by question

One mark per repeat; hover for the grader's reason, click a question for every answer to it.

Question D1 sql D2 sql+markdown D3 sql+executed D4 sparql D5 sparql+ontology D6 sparql+axioms

Q1 What was Kestrel Energy's rating on 1 January 2025? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q2 Has Kestrel Energy been downgraded in 2026? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q3 Is Kestrel Energy's 2031 note investment grade? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q4 What is Northwind Holdings' current outlook? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q5 Whose credit risk does a holder of the Northwind Finance 2030 notes take, and how is it rated? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q6 Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating? 🟡🟡✅ ✅✅🟡 ✅🟡🟡 ❌🟡🟡 ✅🟡✅ 🟡🟡🟡

Q7 Which issuers were downgraded in 2026? ❌❌❌ ❌✅✅ ❌✅❌ ❌❌❌ ✅❌✅ ❌❌❌

Q8 Which entities were in default on 1 October 2026? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q9 As of 1 October 2026, how many distinct issuers hold an issuer rating? ❌❌❌ ❌✅✅ ✅❌✅ ❌❌❌ ✅✅✅ ✅✅❌

Q10 Is Valdoria Telecom investment grade? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q11 What was Marlow Utilities' rating on 1 June 2025? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q12 What was Marlow Utilities' rating on 1 January 2024? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q13 How many times has Marlow Utilities been downgraded? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q14 What was Halden Foods' rating on 1 January 2024? ✅✅✅ ✅✅✅ ✅❌✅ ✅✅✅ ✅✅✅ ✅✅✅

Q15 What was Halden Bank's rating on 1 January 2026? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q16 Has Marlow Utilities' rating changed since 1 January 2025? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q17 Was Orrin Bank downgraded in 2026? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q18 Which issuers were on Rating Watch Negative on 1 October 2026? ❌✅✅ ❌✅✅ ✅✅✅ ✅❌✅ ✅✅✅ ✅✅❌

Q19 Which issuers had a Negative outlook on 1 October 2026? ❌❌❌ ❌❌✅ ✅❌✅ ❌❌❌ ✅✅✅ ❌❌❌

Q20 Is Pellam Retail in default? ✅✅✅ ✅✅✅ ❌✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q21 Which entities had an issuer rating at some point but no longer had one on 1 October 2026? ✅✅❌ ❌✅✅ ✅❌✅ ❌❌❌ ❌❌❌ ❌❌❌

Q22 Which entities have ever been in default? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q23 What is Kestrel Energy's short-term rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q24 Is Kestrel Energy's issuer rating investment grade? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q25 How many instruments held an investment-grade rating on 1 October 2026? ✅✅✅ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅✅ ✅✅❌

Q26 What is Corvenia Power's local-currency rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q27 How is Corvenia Power's 2032 note rated? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q28 What is the Republic of Corvenia's foreign-currency issuer rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q29 What is the Republic of Valdoria's issuer rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q30 Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026? ✅✅✅ ❌✅✅ ✅✅❌ ❌✅❌ ✅✅✅ ✅✅✅

Q31 Did any company have a foreign-currency issuer rating above its country's ceiling on 1 October 2026? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q32 Who is Halden Leasing's ultimate parent? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q33 Whose credit risk does a holder of the Halden Leasing 2028 notes take, and how is it rated? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q34 Is Halden Foods part of the same group as Halden Bank? ✅✅✅ ✅✅❌ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q35 How many entities are in the Halden group, the parent included? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q36 How many entities are in the Northwind group, the parent included? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q37 How many distinct legal entities does the data describe? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ❌❌❌

Q38 Are Orrin Bank AG and Orrin Bancorp Inc the same entity? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q39 What is Northwind Holdings' current rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q40 How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ✅❌❌

Q41 What is Brindle Capital's current rating? ❌❌❌ ✅✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ❌❌❌

Q42 In which country is Halden Bank domiciled? ❌❌❌ ✅✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ✅✅✅

Q43 How many distinct entities are domiciled in Luxembourg (LU)? ❌✅❌ ❌✅✅ ✅✅✅ ❌❌✅ ✅✅✅ ✅✅✅

Q44 Is Valdoria Telecom's 2027 note a local-currency obligation? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q45 Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows? ✅✅✅ ✅✅✅ ✅❌✅ ✅✅❌ ✅✅✅ ❌❌❌

Q46 Does Halden Leasing have an issuer rating? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q47 How is Corvenia Power's 2034 note rated? ✅✅✅ ✅✅✅ ✅✅✅ ✅✅❌ ✅✅✅ ❌❌✅

Q48 How many instruments held a rating on 1 October 2026? ✅✅✅ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅✅ ✅✅✅

Q49 Who is Cerid Rosor Holdings SA's ultimate parent? ✅❌❌ ❌✅✅ ✅✅✅ ✅✅❌ ✅✅✅ ✅✅✅

Q50 How many levels of ownership separate Cerid Rosor Holdings SA from its ultimate parent? ✅❌❌ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅❌ ✅❌✅

Q51 How many entities are in the Cerid Group plc group, the parent included? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅❌✅ ✅❌✅

Q52 How many entities are in the Rotam Group Inc group, the parent included? ✅❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ✅❌✅

Q53 Are Belir Mining SA and Rotam Group Inc in the same group? ✅✅✅ ✅✅✅ ✅✅✅ ✅❌❌ ✅✅✅ ✅✅✅

Q54 Which members of the Wonod Group SA group are domiciled in Valdoria (VD)? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ✅❌✅

Q55 If Valdoria (VD) came under stress, how many entities with an issuer rating in force have an entity domiciled in VD somewhere above them in their chain of parents? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅✅✅ ✅❌✅

Q56 What is the lowest current foreign-currency issuer rating held by any member of the Vesol Group BV group? ✅✅✅ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅✅ ✅❌✅

Q57 Which is the nearest entity that Cerid Guven Energy SA and Cerid Telecom SA both have in their chains of parents? ✅❌❌ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅✅ ✅✅✅

Q58 Which entities guarantee a note issued by an entity outside their own group? ✅✅✅ ❌✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q59 How many entities in the Cerid Group plc group sit exactly three levels below the top? ✅❌❌ ❌✅✅ ✅✅✅ ❌✅❌ ✅✅✅ ✅✅✅

Q60 Whose credit risk does a holder of the Cross-group 4.75% notes due 2031 take, and is that entity in the same group as the issuer? ✅✅✅ 🟡✅✅ ✅✅✅ ✅✅✅ ✅✅✅ ✅✅✅

Q61 How many members of the Cerid Group plc group, the top included, hold a foreign-currency issuer rating below investment grade? ❌❌❌ ❌✅✅ ✅✅✅ ❌❌❌ ✅❌✅ ✅❌✅

Question	D1 `sql`	D2 `sql+markdown`	D3 `sql+executed`	D4 `sparql`	D5 `sparql+ontology`	D6 `sparql+axioms`
Q1 What was Kestrel Energy's rating on 1 January 2025?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q2 Has Kestrel Energy been downgraded in 2026?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q3 Is Kestrel Energy's 2031 note investment grade?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q4 What is Northwind Holdings' current outlook?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q5 Whose credit risk does a holder of the Northwind Finance 2030 notes take, and how is it rated?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q6 Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating?	🟡🟡✅	✅✅🟡	✅🟡🟡	❌🟡🟡	✅🟡✅	🟡🟡🟡
Q7 Which issuers were downgraded in 2026?	❌❌❌	❌✅✅	❌✅❌	❌❌❌	✅❌✅	❌❌❌
Q8 Which entities were in default on 1 October 2026?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q9 As of 1 October 2026, how many distinct issuers hold an issuer rating?	❌❌❌	❌✅✅	✅❌✅	❌❌❌	✅✅✅	✅✅❌
Q10 Is Valdoria Telecom investment grade?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q11 What was Marlow Utilities' rating on 1 June 2025?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q12 What was Marlow Utilities' rating on 1 January 2024?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q13 How many times has Marlow Utilities been downgraded?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q14 What was Halden Foods' rating on 1 January 2024?	✅✅✅	✅✅✅	✅❌✅	✅✅✅	✅✅✅	✅✅✅
Q15 What was Halden Bank's rating on 1 January 2026?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q16 Has Marlow Utilities' rating changed since 1 January 2025?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q17 Was Orrin Bank downgraded in 2026?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q18 Which issuers were on Rating Watch Negative on 1 October 2026?	❌✅✅	❌✅✅	✅✅✅	✅❌✅	✅✅✅	✅✅❌
Q19 Which issuers had a Negative outlook on 1 October 2026?	❌❌❌	❌❌✅	✅❌✅	❌❌❌	✅✅✅	❌❌❌
Q20 Is Pellam Retail in default?	✅✅✅	✅✅✅	❌✅✅	✅✅✅	✅✅✅	✅✅✅
Q21 Which entities had an issuer rating at some point but no longer had one on 1 October 2026?	✅✅❌	❌✅✅	✅❌✅	❌❌❌	❌❌❌	❌❌❌
Q22 Which entities have ever been in default?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q23 What is Kestrel Energy's short-term rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q24 Is Kestrel Energy's issuer rating investment grade?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q25 How many instruments held an investment-grade rating on 1 October 2026?	✅✅✅	❌✅✅	✅✅✅	❌✅❌	✅✅✅	✅✅❌
Q26 What is Corvenia Power's local-currency rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q27 How is Corvenia Power's 2032 note rated?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q28 What is the Republic of Corvenia's foreign-currency issuer rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q29 What is the Republic of Valdoria's issuer rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q30 Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026?	✅✅✅	❌✅✅	✅✅❌	❌✅❌	✅✅✅	✅✅✅
Q31 Did any company have a foreign-currency issuer rating above its country's ceiling on 1 October 2026?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q32 Who is Halden Leasing's ultimate parent?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q33 Whose credit risk does a holder of the Halden Leasing 2028 notes take, and how is it rated?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q34 Is Halden Foods part of the same group as Halden Bank?	✅✅✅	✅✅❌	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q35 How many entities are in the Halden group, the parent included?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q36 How many entities are in the Northwind group, the parent included?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q37 How many distinct legal entities does the data describe?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅✅✅	❌❌❌
Q38 Are Orrin Bank AG and Orrin Bancorp Inc the same entity?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q39 What is Northwind Holdings' current rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q40 How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅✅✅	✅❌❌
Q41 What is Brindle Capital's current rating?	❌❌❌	✅✅✅	✅✅✅	❌❌❌	✅✅✅	❌❌❌
Q42 In which country is Halden Bank domiciled?	❌❌❌	✅✅✅	✅✅✅	❌❌❌	✅✅✅	✅✅✅
Q43 How many distinct entities are domiciled in Luxembourg (LU)?	❌✅❌	❌✅✅	✅✅✅	❌❌✅	✅✅✅	✅✅✅
Q44 Is Valdoria Telecom's 2027 note a local-currency obligation?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q45 Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows?	✅✅✅	✅✅✅	✅❌✅	✅✅❌	✅✅✅	❌❌❌
Q46 Does Halden Leasing have an issuer rating?	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q47 How is Corvenia Power's 2034 note rated?	✅✅✅	✅✅✅	✅✅✅	✅✅❌	✅✅✅	❌❌✅
Q48 How many instruments held a rating on 1 October 2026?	✅✅✅	❌✅✅	✅✅✅	❌✅❌	✅✅✅	✅✅✅
Q49 Who is Cerid Rosor Holdings SA's ultimate parent?	✅❌❌	❌✅✅	✅✅✅	✅✅❌	✅✅✅	✅✅✅
Q50 How many levels of ownership separate Cerid Rosor Holdings SA from its ultimate parent?	✅❌❌	❌✅✅	✅✅✅	❌✅❌	✅✅❌	✅❌✅
Q51 How many entities are in the Cerid Group plc group, the parent included?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅❌✅	✅❌✅
Q52 How many entities are in the Rotam Group Inc group, the parent included?	✅❌❌	❌✅✅	✅✅✅	❌❌❌	✅✅✅	✅❌✅
Q53 Are Belir Mining SA and Rotam Group Inc in the same group?	✅✅✅	✅✅✅	✅✅✅	✅❌❌	✅✅✅	✅✅✅
Q54 Which members of the Wonod Group SA group are domiciled in Valdoria (VD)?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅✅✅	✅❌✅
Q55 If Valdoria (VD) came under stress, how many entities with an issuer rating in force have an entity domiciled in VD somewhere above them in their chain of parents?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅✅✅	✅❌✅
Q56 What is the lowest current foreign-currency issuer rating held by any member of the Vesol Group BV group?	✅✅✅	❌✅✅	✅✅✅	❌✅❌	✅✅✅	✅❌✅
Q57 Which is the nearest entity that Cerid Guven Energy SA and Cerid Telecom SA both have in their chains of parents?	✅❌❌	❌✅✅	✅✅✅	❌✅❌	✅✅✅	✅✅✅
Q58 Which entities guarantee a note issued by an entity outside their own group?	✅✅✅	❌✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q59 How many entities in the Cerid Group plc group sit exactly three levels below the top?	✅❌❌	❌✅✅	✅✅✅	❌✅❌	✅✅✅	✅✅✅
Q60 Whose credit risk does a holder of the Cross-group 4.75% notes due 2031 take, and is that entity in the same group as the issuer?	✅✅✅	🟡✅✅	✅✅✅	✅✅✅	✅✅✅	✅✅✅
Q61 How many members of the Cerid Group plc group, the top included, hold a foreign-currency issuer rating below investment grade?	❌❌❌	❌✅✅	✅✅✅	❌❌❌	✅❌✅	✅❌✅

The prompts

The report, as report.md

credit_paths: claude:sonnet, 2026-11-04 20:24

61 questions, 3 repeats per condition. Correct = 1, partial = ½. Graded by code where a question has a typed key, by claude:sonnet with a checklist otherwise.

Accuracy

Condition	Accuracy	95% interval	Questions unstable across repeats
D1 `sql`	74%	63% to 84%	9 of 61
D2 `sql+markdown`	86%	82% to 90%	25 of 61
D4 `sparql`	66%	55% to 76%	14 of 61
D5 `sparql+ontology`	96%	92% to 99%	5 of 61
D3 `sql+executed`	95%	91% to 98%	9 of 61
D6 `sparql+axioms`	82%	73% to 90%	12 of 61

Against D1 `sql`, question by question

Condition	Difference	95% interval
D2 `sql+markdown`	+13 points	+5 to +21
D4 `sparql`	-8 points	-14 to -3
D5 `sparql+ontology`	+22 points	+13 to +32
D3 `sql+executed`	+21 points	+11 to +31
D6 `sparql+axioms`	+8 points	-1 to +17

By question

Question	Graded by	D1 `sql`	D2 `sql+markdown`	D4 `sparql`	D5 `sparql+ontology`	D3 `sql+executed`	D6 `sparql+axioms`
Q1	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q2	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q3	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q4	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q5	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q6	llm	🟡 🟡 ✅	✅ ✅ 🟡	❌ 🟡 🟡	✅ 🟡 ✅	✅ 🟡 🟡	🟡 🟡 🟡
Q7	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ❌ ✅	❌ ✅ ❌	❌ ❌ ❌
Q8	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q9	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ❌ ✅	✅ ✅ ❌
Q10	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q11	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q12	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q13	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q14	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ✅	✅ ✅ ✅
Q15	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q16	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q17	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q18	code	❌ ✅ ✅	❌ ✅ ✅	✅ ❌ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ❌
Q19	code	❌ ❌ ❌	❌ ❌ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ❌ ✅	❌ ❌ ❌
Q20	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	❌ ✅ ✅	✅ ✅ ✅
Q21	code	✅ ✅ ❌	❌ ✅ ✅	❌ ❌ ❌	❌ ❌ ❌	✅ ❌ ✅	❌ ❌ ❌
Q22	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q23	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q24	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q25	code	✅ ✅ ✅	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ❌
Q26	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q27	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q28	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q29	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q30	code	✅ ✅ ✅	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ❌	✅ ✅ ✅
Q31	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q32	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q33	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q34	code	✅ ✅ ✅	✅ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q35	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q36	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q37	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	❌ ❌ ❌
Q38	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q39	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q40	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ❌
Q41	code	❌ ❌ ❌	✅ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	❌ ❌ ❌
Q42	code	❌ ❌ ❌	✅ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q43	code	❌ ✅ ❌	❌ ✅ ✅	❌ ❌ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q44	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q45	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ❌	✅ ✅ ✅	✅ ❌ ✅	❌ ❌ ❌
Q46	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q47	code	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	❌ ❌ ✅
Q48	code	✅ ✅ ✅	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q49	code	✅ ❌ ❌	❌ ✅ ✅	✅ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q50	code	✅ ❌ ❌	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ❌	✅ ✅ ✅	✅ ❌ ✅
Q51	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ❌ ✅	✅ ✅ ✅	✅ ❌ ✅
Q52	code	✅ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ✅
Q53	code	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q54	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ✅
Q55	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ✅
Q56	code	✅ ✅ ✅	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ❌ ✅
Q57	code	✅ ❌ ❌	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q58	code	✅ ✅ ✅	❌ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q59	code	✅ ❌ ❌	❌ ✅ ✅	❌ ✅ ❌	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q60	code	✅ ✅ ✅	🟡 ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅	✅ ✅ ✅
Q61	code	❌ ❌ ❌	❌ ✅ ✅	❌ ❌ ❌	✅ ❌ ✅	✅ ✅ ✅	✅ ❌ ✅

Lists, with partial credit

The 9 questions answered with a list of entities: strict accuracy (the whole list right) against the mean F1 of the lists given, which credits a list that is nearly right.

Condition	Strict	Mean F1
D1 `sql`	59%	95%
D2 `sql+markdown`	70%	76%
D4 `sparql`	44%	79%
D5 `sparql+ontology`	85%	100%
D3 `sql+executed`	81%	100%
D6 `sparql+axioms`	59%	81%

The checklist grader agreed with itself on 18 of 18 answers graded twice.

Why each miss was marked

Q6. Why is Valdoria Telecom's foreign-currency rating lower than its local-currency rating?

D1 sql run 1: Identifies the BB Country Ceiling and says the FC rating is consistent with a ceiling effect, but hedges that no reason is stated and never says the ceiling caps foreign-currency ratings and not local-currency ones.
D1 sql run 2: Names the BB Country Ceiling as consistent with the FC rating, but hedges that no reason is stated and never says the ceiling caps foreign-currency ratings and not local-currency ones.
D2 sql+markdown run 3: Mentions the Country Ceiling at BB alongside the ratings but explicitly declines to name it as the cause and does not say it caps only foreign-currency ratings.
D4 sparql run 1: Does not name the Country Ceiling (BB) as the cause or explain it caps foreign-currency ratings only; claims the question is unanswerable.
D4 sparql run 2: Mentions the BB Country Ceiling and the FC/LC ratings but never states the ceiling caps foreign-currency ratings and not local-currency ones, nor explicitly names it as the cause.
D4 sparql run 3: Cites the BB Country Ceiling alongside the ratings but says the data doesn't explain why, never stating the ceiling is the cause or that it caps only foreign-currency ratings.
D5 sparql+ontology run 2: Identifies the BB Country Ceiling as consistent with the FC rating, but hedges that the data states no reason and never says the ceiling caps FC and not LC ratings.
D3 sql+executed run 2: Names the BB Country Ceiling as matching the FC rating, but never states that the ceiling caps foreign-currency ratings and not local-currency ones, so the causal explanation is missing.
D3 sql+executed run 3: Names the BB Country Ceiling as the likely cause (point 1), but hedges and never states that the ceiling caps foreign-currency ratings and not local-currency ones (point 2).
D6 sparql+axioms run 1: Notes the BB Country Ceiling matches the foreign-currency rating but never names it as the cause and does not say the ceiling caps foreign-currency ratings only, not local-currency ones.
D6 sparql+axioms run 2: Notes the foreign-currency rating equals the VD ceiling (BB) but says the cause isn't answerable and never states the ceiling caps foreign-currency but not local-currency ratings
D6 sparql+axioms run 3: Mentions the BB country ceiling as fitting the foreign-currency rating but declines to state it as the cause and never says it caps only foreign-currency ratings.

Q7. Which issuers were downgraded in 2026?

D1 sql run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E1186', 'E1243', 'E1255', 'E08', 'E1151', 'E1299', 'E1307', 'E1213', 'E1080', 'E5156', 'E1285', 'E1112', 'E1263', 'E1064', 'E1347', 'E1344', 'E1348', 'E5019', 'E1163', 'E1053', 'E1051', 'E1300', 'E10', 'E1034', 'E1229', 'E5116', 'E5059', 'E16', 'E1144', 'E1159', 'E5113', 'E1057', 'E1340', 'E1228', 'E1294', 'E1058', 'E1342', 'E1093', 'E1161', 'E1343', 'E1170', 'E5097', 'E1290', 'E1350', 'E1167', 'E1345', 'E1351']
D1 sql run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10', 'E16', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E5019', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D1 sql run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E1170', 'E1167', 'E5097', 'E1053', 'E5156', 'E1163', 'E1057', 'E1346', 'E1300', 'E1307', 'E1228', 'E1342', 'E1340', 'E1255', 'E1285', 'E1345', 'E1263', 'E1112', 'E1294', 'E1213', 'E1348', 'E1144', 'E1229', 'E1161', 'E1344', 'E1058', 'E1347', 'E5116', 'E1343', 'E16', 'E1051', 'E1080', 'E5059', 'E1351', 'E1034', 'E1243', 'E1186', 'E5113', 'E1350', 'E5019', 'E1093', 'E1151', 'E10', 'E1290', 'E1299', 'E1064', 'E1159', 'E1349']
D2 sql+markdown run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10']
D4 sparql run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D4 sparql run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E1034', 'E1064', 'E1159', 'E1186', 'E1213', 'E1255', 'E1300', 'E1340', 'E1341', 'E1342', 'E1343', 'E1346', 'E10', 'E5019', 'E1051', 'E1294', 'E1053', 'E1057', 'E1167', 'E1229', 'E1243', 'E1350', 'E1058', 'E1263', 'E1347', 'E1348', 'E1080', 'E1344', 'E1349', 'E1351', 'E1093', 'E1161', 'E1290', 'E1112', 'E1151', 'E1299', 'E1144', 'E1163', 'E1228', 'E16', 'E5059', 'E1170', 'E1307', 'E1345', 'E5113', 'E5033', 'E5116', 'E1285', 'E08', 'E5097', 'E5156']
D4 sparql run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D5 sparql+ontology run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E5019', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D3 sql+executed run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E1057', 'E1169', 'E1112', 'E1051', 'E10', 'E5019', 'E1213', 'E1263', 'E1285', 'E1307', 'E1053', 'E1298', 'E5097', 'E1290', 'E1186', 'E1034', 'E1243', 'E1093', 'E1229', 'E1255', 'E5156', 'E1080', 'E1160', 'E1228', 'E1151', 'E1159', 'E1058', 'E5059', 'E1163', 'E1300', 'E1064', 'E1144', 'E1294', 'E5113', 'E1167']
D3 sql+executed run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D6 sparql+axioms run 1: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E16', 'E5019', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D6 sparql+axioms run 2: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1161', 'E1163', 'E1167', 'E1170', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1299', 'E1300', 'E1307', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E08', 'E10', 'E16', 'E5019', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156']
D6 sparql+axioms run 3: issuers: expected ['E08', 'E10', 'E1034', 'E1051', 'E1053', 'E1057', 'E1058', 'E1064', 'E1080', 'E1093', 'E1112', 'E1144', 'E1151', 'E1159', 'E1160', 'E1163', 'E1167', 'E1169', 'E1186', 'E1213', 'E1228', 'E1229', 'E1243', 'E1255', 'E1263', 'E1285', 'E1290', 'E1294', 'E1298', 'E1300', 'E1307', 'E5019', 'E5033', 'E5059', 'E5097', 'E5113', 'E5116', 'E5156'], got ['E08', 'E10', 'E16', 'E5019']

Q9. As of 1 October 2026, how many distinct issuers hold an issuer rating?

D1 sql run 1: count: expected 377, got 390
D1 sql run 2: count: expected 377, got 390
D1 sql run 3: count: expected 377, got 390
D2 sql+markdown run 1: count: expected 377, got 209
D4 sparql run 1: count: expected 377, got 393
D4 sparql run 2: count: expected 377, got 390
D4 sparql run 3: count: expected 377, got 391
D3 sql+executed run 2: count: expected 377, got 376
D6 sparql+axioms run 3: count: expected 377, got 366

Q14. What was Halden Foods' rating on 1 January 2024?

D3 sql+executed run 2: rating: expected none, got BB-

Q18. Which issuers were on Rating Watch Negative on 1 October 2026?

D1 sql run 1: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E1099', 'E1260', 'E1132', 'E1264', 'E1006', 'E1039', 'E1266', 'E1317', 'E1037', 'E1242', 'E1267', 'E1297', 'E1061', 'E1238', 'E1013', 'E1066', 'E1314', 'E1203', 'E1146', 'E1323', 'E1133', 'E06', 'E1088', 'E1194', 'E1126', 'E1098', 'E1209', 'E1181', 'E1109', 'E1168']
D2 sql+markdown run 1: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E06']
D4 sparql run 2: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E1006', 'E1013', 'E1037', 'E1039', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1210', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323', 'E06']
D6 sparql+axioms run 3: issuers: expected ['E06', 'E1006', 'E1013', 'E1019', 'E1037', 'E1039', 'E1059', 'E1061', 'E1066', 'E1088', 'E1098', 'E1099', 'E1109', 'E1126', 'E1132', 'E1133', 'E1146', 'E1168', 'E1181', 'E1194', 'E1203', 'E1209', 'E1238', 'E1242', 'E1260', 'E1264', 'E1266', 'E1267', 'E1297', 'E1314', 'E1317', 'E1323'], got ['E06']

Q19. Which issuers had a Negative outlook on 1 October 2026?

D1 sql run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E5141', 'E5119', 'E1294', 'E1055', 'E1350', 'E1344', 'E1105', 'E1158', 'E1190', 'E5039', 'E1072', 'E5156', 'E1347', 'E1271', 'E1079', 'E5116', 'E1080', 'E1005', 'E1211', 'E1261', 'E5019', 'E5113', 'E5131', 'E1059', 'E09', 'E1348', 'E1046', 'E5059', 'E1160', 'E1351', 'E5020', 'E1029', 'E1342', 'E5170', 'E1248', 'E5057', 'E1034', 'E1188', 'E5102', 'E5097', 'E1300', 'E1263', 'E5073', 'E5050', 'E1228', 'E1345', 'E5099', 'E5023', 'E1056', 'E5062', 'E1340', 'E5013', 'E1282', 'E1064', 'E1118', 'E1343', 'E01']
D1 sql run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E1211', 'E1262', 'E5019', 'E09', 'E1060', 'E5131', 'E5113', 'E1064', 'E01', 'E1118', 'E1343', 'E1079', 'E1347', 'E1271', 'E1263', 'E5073', 'E5050', 'E1228', 'E1345', 'E5099', 'E1029', 'E5059', 'E1342', 'E1351', 'E5020', 'E1161', 'E5170', 'E5023', 'E5062', 'E1056', 'E1340', 'E5013', 'E1282', 'E1348', 'E1046', 'E1294', 'E5141', 'E1055', 'E5119', 'E1350', 'E5057', 'E1188', 'E1248', 'E1034', 'E5116', 'E1080', 'E1005', 'E1344', 'E1105', 'E1158', 'E1072', 'E5156', 'E1190', 'E5039', 'E5102', 'E5097', 'E1300']
D1 sql run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E1105', 'E1344', 'E1158', 'E1064', 'E1118', 'E01', 'E1343', 'E1046', 'E1348', 'E5099', 'E1345', 'E1228', 'E5050', 'E1263', 'E5073', 'E5039', 'E5156', 'E1072', 'E1190', 'E1079', 'E1161', 'E1351', 'E1029', 'E5020', 'E1342', 'E5059', 'E5170', 'E5097', 'E1300', 'E5102', 'E1294', 'E1350', 'E1055', 'E5141', 'E5119', 'E09', 'E1211', 'E5019', 'E1060', 'E1262', 'E5113', 'E5131', 'E1080', 'E5116', 'E1005', 'E5057', 'E1248', 'E1034', 'E1188', 'E1340', 'E5013', 'E1282', 'E5023', 'E5062', 'E1056', 'E1271', 'E1347']
D2 sql+markdown run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E09']
D2 sql+markdown run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E1211', 'E5023', 'E5102', 'E1005', 'E1271', 'E5097', 'E1055', 'E1079', 'E1158', 'E1261', 'E5013', 'E5156', 'E1029', 'E1188', 'E1294', 'E5062', 'E1228', 'E1282', 'E1300', 'E5099', 'E1064', 'E5057', 'E5073', 'E09', 'E1046', 'E5020', 'E5050', 'E5131', 'E01', 'E1132', 'E1059', 'E5019', 'E5059', 'E5141', 'E1248', 'E1263', 'E1034', 'E1118', 'E1190', 'E5039', 'E5113', 'E5119', 'E1056', 'E1072', 'E1080', 'E1146', 'E1105', 'E1160', 'E5116']
D4 sparql run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156', 'E5170']
D4 sparql run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156', 'E5170']
D4 sparql run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E1340', 'E1342', 'E1343', 'E1344', 'E1345', 'E1347', 'E1348', 'E1350', 'E1351', 'E09', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156', 'E5170']
D3 sql+executed run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E1005', 'E1080', 'E5116', 'E1105', 'E1158', 'E1046', 'E1055', 'E1294', 'E5119', 'E5141', 'E1034', 'E1188', 'E1248', 'E5057', 'E1079', 'E1056', 'E1059', 'E1282', 'E5013', 'E5023', 'E5062', 'E1300', 'E5097', 'E5102', 'E1072', 'E1190', 'E5039', 'E5156', 'E01', 'E1064', 'E1118', 'E1261', 'E09', 'E1211', 'E5019', 'E5113', 'E5131', 'E1029', 'E1160', 'E5020', 'E5059', 'E1271', 'E1228', 'E1263', 'E5033', 'E5050', 'E5073', 'E5099']
D6 sparql+axioms run 1: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E09', 'E5013', 'E5019', 'E5020', 'E5023', 'E5033', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156']
D6 sparql+axioms run 2: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1060', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1161', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1262', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E09']
D6 sparql+axioms run 3: issuers: expected ['E01', 'E09', 'E1005', 'E1029', 'E1034', 'E1046', 'E1055', 'E1056', 'E1059', 'E1064', 'E1072', 'E1079', 'E1080', 'E1105', 'E1118', 'E1158', 'E1160', 'E1188', 'E1190', 'E1211', 'E1228', 'E1248', 'E1261', 'E1263', 'E1271', 'E1282', 'E1294', 'E1300', 'E5013', 'E5019', 'E5020', 'E5023', 'E5039', 'E5050', 'E5057', 'E5059', 'E5062', 'E5073', 'E5097', 'E5099', 'E5102', 'E5113', 'E5116', 'E5119', 'E5131', 'E5141', 'E5156'], got ['E01', 'E09', 'E5013', 'E5019', 'E5020', 'E5023']

Q20. Is Pellam Retail in default?

D3 sql+executed run 1: in_default: expected no, got depends

Q21. Which entities had an issuer rating at some point but no longer had one on 1 October 2026?

D1 sql run 3: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1316', 'E1244', 'E1057', 'E1308', 'E1007', 'E1159', 'E1032', 'E1155', 'E1206', 'E1320', 'E1219', 'E1218', 'E1233', 'E1200', 'E1225', 'E1234', 'E1021', 'E1279', 'E07', 'E1166', 'E1084', 'E1048', 'E1062', 'E1121', 'E1205', 'E1107', 'E1041', 'E1140', 'E1138', 'E1063', 'E1002', 'E1076', 'E1277', 'E1254', 'E1172', 'E1124']
D2 sql+markdown run 1: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07']
D4 sparql run 1: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07', 'E1007', 'E1032', 'E1057', 'E1155', 'E1159', 'E1172', 'E1218', 'E1219', 'E1234']
D4 sparql run 2: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D4 sparql run 3: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07', 'E1007', 'E1032', 'E1057', 'E1155', 'E1159', 'E1172']
D5 sparql+ontology run 1: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D5 sparql+ontology run 2: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07', 'E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320']
D5 sparql+ontology run 3: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1279', 'E1308', 'E1316', 'E1320', 'E07']
D3 sql+executed run 2: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1007', 'E1032', 'E1057', 'E1155', 'E1159', 'E1253', 'E1308', 'E1121', 'E1205', 'E1206', 'E1219', 'E1320', 'E1244', 'E1316', 'E1062', 'E1277', 'E1218', 'E07', 'E1021', 'E1166', 'E1279', 'E1001', 'E1124', 'E1172', 'E1048', 'E1084', 'E1041', 'E1063', 'E1107', 'E1138', 'E1140', 'E1200', 'E1225', 'E1233', 'E1234', 'E1076']
D6 sparql+axioms run 1: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1308', 'E1316', 'E1320', 'E07', 'E5170']
D6 sparql+axioms run 2: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E1002', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1254', 'E1277', 'E1308', 'E1316', 'E1320', 'E1340', 'E1341', 'E1342', 'E1343', 'E1344', 'E1345', 'E1346', 'E1347', 'E1348', 'E1349', 'E1350', 'E1351', 'E07', 'E16', 'E5170']
D6 sparql+axioms run 3: entities: expected ['E07', 'E1001', 'E1007', 'E1021', 'E1032', 'E1041', 'E1048', 'E1057', 'E1062', 'E1063', 'E1076', 'E1084', 'E1107', 'E1121', 'E1124', 'E1138', 'E1140', 'E1155', 'E1159', 'E1166', 'E1172', 'E1200', 'E1205', 'E1206', 'E1218', 'E1219', 'E1225', 'E1233', 'E1234', 'E1244', 'E1253', 'E1277', 'E1308', 'E1316', 'E1320'], got ['E07']

Q25. How many instruments held an investment-grade rating on 1 October 2026?

D2 sql+markdown run 1: count: expected 72, got 52
D4 sparql run 1: count: expected 72, got 75
D4 sparql run 3: count: expected 72, got 75
D6 sparql+axioms run 3: count: expected 72, got 5

Q30. Which entities had a foreign-currency issuer rating exactly at their country's ceiling on 1 October 2026?

D2 sql+markdown run 1: entities: expected ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15', 'E5012', 'E5047', 'E5091', 'E5116', 'E5124'], got ['E05', 'E15']
D4 sparql run 1: entities: expected ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15', 'E5012', 'E5047', 'E5091', 'E5116', 'E5124'], got ['E15']
D4 sparql run 3: entities: expected ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15', 'E5012', 'E5047', 'E5091', 'E5116', 'E5124'], got ['E05', 'E15']
D3 sql+executed run 3: entities: expected ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15', 'E5012', 'E5047', 'E5091', 'E5116', 'E5124'], got ['E05', 'E1028', 'E1039', 'E1101', 'E1126', 'E1194', 'E1236', 'E15', 'E5012', 'E5047', 'E5091', 'E5116', 'E5124', 'E1019x']

Q34. Is Halden Foods part of the same group as Halden Bank?

D2 sql+markdown run 3: same_group: expected no, got yes

Q37. How many distinct legal entities does the data describe?

D1 sql run 1: count: expected 497, got 511
D1 sql run 2: count: expected 497, got 509
D1 sql run 3: count: expected 497, got 511
D2 sql+markdown run 1: count: expected 497, got 523
D4 sparql run 1: count: expected 497, got 511
D4 sparql run 2: count: expected 497, got 511
D4 sparql run 3: count: expected 497, got 509
D6 sparql+axioms run 1: count: expected 497, got 511
D6 sparql+axioms run 2: count: expected 497, got 511
D6 sparql+axioms run 3: count: expected 497, got 511

Q40. How many distinct issuers domiciled in GB held an issuer rating on 1 October 2026?

D1 sql run 1: count: expected 79, got 87
D1 sql run 2: count: expected 79, got 87
D1 sql run 3: count: expected 79, got 87
D2 sql+markdown run 1: count: expected 79, got 61
D4 sparql run 1: count: expected 79, got 88
D4 sparql run 2: count: expected 79, got 87
D4 sparql run 3: count: expected 79, got 88
D6 sparql+axioms run 2: count: expected 79, got 74
D6 sparql+axioms run 3: count: expected 79, got 74

Q41. What is Brindle Capital's current rating?

D1 sql run 1: rating: expected none, got BB+
D1 sql run 2: rating: expected none, got BB+
D1 sql run 3: rating: expected none, got BB+
D4 sparql run 1: rating: expected none, got BB+
D4 sparql run 2: rating: expected none, got BB+
D4 sparql run 3: rating: expected none, got BB+
D6 sparql+axioms run 1: rating: expected none, got BB+
D6 sparql+axioms run 2: rating: expected none, got BB+
D6 sparql+axioms run 3: rating: expected none, got BB+

Q42. In which country is Halden Bank domiciled?

D1 sql run 1: country: expected LU, got DE
D1 sql run 2: country: expected LU, got DE
D1 sql run 3: country: expected LU, got DE
D4 sparql run 1: country: expected LU, got DE
D4 sparql run 2: country: expected LU, got DE
D4 sparql run 3: country: expected LU, got DE

Q43. How many distinct entities are domiciled in Luxembourg (LU)?

D1 sql run 1: count: expected 1, got 0
D1 sql run 3: count: expected 1, got 0
D2 sql+markdown run 1: count: expected 1, got 3
D4 sparql run 1: count: expected 1, got 0
D4 sparql run 2: count: expected 1, got 0

Q45. Is Valdoria Telecom's 2027 note rated above what Valdoria's Country Ceiling allows?

D4 sparql run 3: above_ceiling: expected no, got yes
D3 sql+executed run 2: above_ceiling: expected no, got yes
D6 sparql+axioms run 1: above_ceiling: expected no, got yes
D6 sparql+axioms run 2: above_ceiling: expected no, got yes
D6 sparql+axioms run 3: above_ceiling: expected no, got yes

Q47. How is Corvenia Power's 2034 note rated?

D4 sparql run 3: rating: expected none, got A
D6 sparql+axioms run 1: rating: expected none, got A
D6 sparql+axioms run 2: rating: expected none, got A

Q48. How many instruments held a rating on 1 October 2026?

D2 sql+markdown run 1: count: expected 113, got 98
D4 sparql run 1: count: expected 113, got 119
D4 sparql run 3: count: expected 113, got 119

Q49. Who is Cerid Rosor Holdings SA's ultimate parent?

D1 sql run 2: parent: expected E5001, got E5167
D1 sql run 3: parent: expected E5001, got E5167
D2 sql+markdown run 1: parent: expected E5001, got E5002
D4 sparql run 3: parent: expected E5001, got E5167

Q50. How many levels of ownership separate Cerid Rosor Holdings SA from its ultimate parent?

D1 sql run 2: count: expected 6, got 4
D1 sql run 3: count: expected 6, got 4
D2 sql+markdown run 1: count: expected 6, got 1
D4 sparql run 1: count: expected 6, got 0
D4 sparql run 3: count: expected 6, got 0
D5 sparql+ontology run 3: count: expected 6, got 5
D6 sparql+axioms run 2: count: expected 6, got 3

Q51. How many entities are in the Cerid Group plc group, the parent included?

D1 sql run 1: count: expected 58, got 59
D1 sql run 2: count: expected 58, got 55
D1 sql run 3: count: expected 58, got 55
D2 sql+markdown run 1: count: expected 58, got 29
D4 sparql run 1: count: expected 58, got 0
D4 sparql run 2: count: expected 58, got 59
D4 sparql run 3: count: expected 58, got 0
D5 sparql+ontology run 2: count: expected 58, got 59
D6 sparql+axioms run 2: count: expected 58, got 50

Q52. How many entities are in the Rotam Group Inc group, the parent included?

D1 sql run 2: count: expected 19, got 20
D1 sql run 3: count: expected 19, got 20
D2 sql+markdown run 1: count: expected 19, got 3
D4 sparql run 1: count: expected 19, got 0
D4 sparql run 2: count: expected 19, got 20
D4 sparql run 3: count: expected 19, got 0
D6 sparql+axioms run 2: count: expected 19, got 0

Q53. Are Belir Mining SA and Rotam Group Inc in the same group?

D4 sparql run 2: same_group: expected no, got yes
D4 sparql run 3: same_group: expected no, got depends

Q54. Which members of the Wonod Group SA group are domiciled in Valdoria (VD)?

D1 sql run 1: entities: expected ['E5106', 'E5124', 'E5130'], got ['E5124', 'E5130']
D1 sql run 2: entities: expected ['E5106', 'E5124', 'E5130'], got ['E5130', 'E5124']
D1 sql run 3: entities: expected ['E5106', 'E5124', 'E5130'], got ['E5124', 'E5130']
D2 sql+markdown run 1: entities: expected ['E5106', 'E5124', 'E5130'], got ['E5093', 'E5094']
D4 sparql run 1: entities: expected ['E5106', 'E5124', 'E5130'], got []
D4 sparql run 2: entities: expected ['E5106', 'E5124', 'E5130'], got ['E5124', 'E5130']
D4 sparql run 3: entities: expected ['E5106', 'E5124', 'E5130'], got []
D6 sparql+axioms run 2: entities: expected ['E5106', 'E5124', 'E5130'], got []

Q55. If Valdoria (VD) came under stress, how many entities with an issuer rating in force have an entity domiciled in VD somewhere above them in their chain of parents?

D1 sql run 1: count: expected 31, got 23
D1 sql run 2: count: expected 31, got 23
D1 sql run 3: count: expected 31, got 23
D2 sql+markdown run 1: count: expected 31, got 4
D4 sparql run 1: count: expected 31, got 0
D4 sparql run 2: count: expected 31, got 23
D4 sparql run 3: count: expected 31, got 0
D6 sparql+axioms run 2: count: expected 31, got 0

Q56. What is the lowest current foreign-currency issuer rating held by any member of the Vesol Group BV group?

D2 sql+markdown run 1: rating: expected BB-, got B+
D4 sparql run 1: rating: expected BB-, got none
D4 sparql run 3: rating: expected BB-, got none
D6 sparql+axioms run 2: rating: expected BB-, got none

Q57. Which is the nearest entity that Cerid Guven Energy SA and Cerid Telecom SA both have in their chains of parents?

D1 sql run 2: entity: expected E5002, got none
D1 sql run 3: entity: expected E5002, got none
D2 sql+markdown run 1: entity: expected E5002, got E5010
D4 sparql run 1: entity: expected E5002, got E5001
D4 sparql run 3: entity: expected E5002, got E5167

Q58. Which entities guarantee a note issued by an entity outside their own group?

D2 sql+markdown run 1: entities: expected ['E5145'], got ['E5037']

Q59. How many entities in the Cerid Group plc group sit exactly three levels below the top?

D1 sql run 2: count: expected 12, got 11
D1 sql run 3: count: expected 12, got 11
D2 sql+markdown run 1: count: expected 12, got 8
D4 sparql run 1: count: expected 12, got 0
D4 sparql run 3: count: expected 12, got 0

Q60. Whose credit risk does a holder of the Cross-group 4.75% notes due 2031 take, and is that entity in the same group as the issuer?

D2 sql+markdown run 1: risk_of: expected E5145, got E5037

Q61. How many members of the Cerid Group plc group, the top included, hold a foreign-currency issuer rating below investment grade?

D1 sql run 1: count: expected 19, got 20
D1 sql run 2: count: expected 19, got 18
D1 sql run 3: count: expected 19, got 18
D2 sql+markdown run 1: count: expected 19, got 2
D4 sparql run 1: count: expected 19, got 0
D4 sparql run 2: count: expected 19, got 20
D4 sparql run 3: count: expected 19, got 0
D5 sparql+ontology run 2: count: expected 19, got 20
D6 sparql+axioms run 2: count: expected 19, got 3

Run 2026-11-04-2024-sonnet-query

Accuracy

Queries

Question by question

The prompts

credit_paths: claude:sonnet, 2026-11-04 20:24

Accuracy

Against D1 sql, question by question

By question

Lists, with partial credit

Why each miss was marked

Against D1 `sql`, question by question