Skip to content
← All cases

clean

clean-2026000000

No perturbation: this case checks that the agent does not invent problems.

No flag expected

Statement files

These files are the untouched baseline for seed 2026000000.

bnp_camt053.xmlUntouched by this perturbation
<?xml version='1.0' encoding='utf-8'?>
<Document xmlns="urn:iso:std:iso:20022:tech:xsd:camt.053.001.02">
<BkToCstmrStmt>
<GrpHdr>
<MsgId>LB-acct-2026000000-2-2025-07-31</MsgId>
<CreDtTm>2025-07-31T23:59:00+00:00</CreDtTm>
</GrpHdr>
<Stmt>
<Id>acct-2026000000-2</Id>
<ElctrncSeqNb>1</ElctrncSeqNb>
<CreDtTm>2025-07-31T23:59:00+00:00</CreDtTm>
<FrToDt>
<FrDtTm>2025-07-01T00:00:00+00:00</FrDtTm>
<ToDtTm>2025-07-31T23:59:59+00:00</ToDtTm>
</FrToDt>
<Acct>
<Id>
<IBAN>GB20LBEN85566217604296</IBAN>
</Id>
<Ccy>GBP</Ccy>
</Acct>
<Bal>
<Tp>
<CdOrPrtry>
<Cd>OPBD</Cd>
</CdOrPrtry>
</Tp>
<Amt Ccy="GBP">103625.69</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Dt>
<Dt>2025-07-01</Dt>
</Dt>
</Bal>
<Ntry>
<Amt Ccy="GBP">8507.17</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-01</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-01</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t004</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>DD MOORLAND TELECOM REF105912</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">418.28</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-02</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-02</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t002</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPO OSPREY LEASING REF370445</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">6164.94</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-06</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-06</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t010</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>BP JUNIPER PAYROLL REF835586</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">6649.95</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-07</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-07</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t019</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPO MOORLAND TELECOM REF507317</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">11671.85</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-07</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-07</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t022</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>SO OSPREY LEASING REF447576</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">7599.35</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-09</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-09</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t014</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPO AURORA CONSULTING LTD REF977375</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">5114.25</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-11</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-11</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t020</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>CR GREENHOLM FOODS REF385992</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">14245.19</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-13</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-13</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t016</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPO NORTHGATE CLEANING REF104248</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">14641.19</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-13</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-13</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t026</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>DD BRAMBLE LOGISTICS REF545149</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">10725.56</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-14</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-14</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t005</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPI GREENHOLM FOODS REF633452</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">12690.92</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-14</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-14</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t006</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>CR JUNIPER PAYROLL REF487519</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">335.00</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-14</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-14</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t017</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>CR DELPHINIUM MEDIA REF905625</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">7623.67</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-15</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-15</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t012</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPO GREENHOLM FOODS REF733952</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">9848.23</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-16</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-16</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t015</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>DD EASTFIELD ENERGY REF910811</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">4373.90</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-18</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-18</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t023</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>TFR AURORA CONSULTING LTD REF539369</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">5290.58</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-19</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-19</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t003</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>BP EASTFIELD ENERGY REF723455</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">6139.61</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-19</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-19</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t009</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>DD EASTFIELD ENERGY REF991063</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">5672.76</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-19</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-19</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t025</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>TFR KESTREL INSURANCE REF708329</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">13872.73</Amt>
<CdtDbtInd>CRDT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-20</Dt>
</BookgDt>
<ValDt>
<Dt>2025-07-20</Dt>
</ValDt>
<AcctSvcrRef>acct-2026000000-2-t018</AcctSvcrRef>
<NtryDtls>
<TxDtls>
<RmtInf>
<Ustrd>FPI HARBOURLIGHT IT REF457384</Ustrd>
</RmtInf>
</TxDtls>
</NtryDtls>
</Ntry>
<Ntry>
<Amt Ccy="GBP">1540.47</Amt>
<CdtDbtInd>DBIT</CdtDbtInd>
<Sts>BOOK</Sts>
<BookgDt>
<Dt>2025-07-21</Dt>
hsbc_statement.xlsxUntouched by this perturbation
[sheet: Statement]
HSBC Bank plc
Business Current Account Statement
Account name: LEDGERBENCH DEMO LTD
Sort code / Account number: 31-56-49 41906046
Account reference: acct-2026000000-1
Statement period: 01 Jul 2025 to 31 Jul 2025
Currency: GBP
Opening balance: 47806.41
Date Payment type Details Paid out Paid in
01 Jul 2025 FPI AURORA CONSULTING LTD REF108040 3895.69
03 Jul 2025 FPO DELPHINIUM MEDIA REF946630 2859.47
03 Jul 2025 FPI MOORLAND TELECOM REF282783 14223.14
06 Jul 2025 CR BRAMBLE LOGISTICS REF566763 13951.99
06 Jul 2025 FPO LARKSPUR TRAVEL REF614162 6317.65
07 Jul 2025 FPO LARKSPUR TRAVEL REF892989 6613.67
08 Jul 2025 BP AURORA CONSULTING LTD REF360250 12380.52
09 Jul 2025 FPI NORTHGATE CLEANING REF379932 12643.67
09 Jul 2025 SO AURORA CONSULTING LTD REF234118 702.21
12 Jul 2025 BP FENWICK & PARTNERS REF466831 11825.62
13 Jul 2025 TFR NORTHGATE CLEANING REF572120 5518.76
14 Jul 2025 FPO AURORA CONSULTING LTD REF894533 11658.73
17 Jul 2025 CR FENWICK & PARTNERS REF260802 12451.45
17 Jul 2025 FPO MOORLAND TELECOM REF464815 10792.25
17 Jul 2025 SO CASTLEGATE PROPERTY REF696167 6935.90
17 Jul 2025 DD HARBOURLIGHT IT REF876640 3312.99
18 Jul 2025 BP EASTFIELD ENERGY REF574687 7218.18
20 Jul 2025 FPO CASTLEGATE PROPERTY REF232899 7417.03
21 Jul 2025 DD DELPHINIUM MEDIA REF244239 6197.28
21 Jul 2025 DD CASTLEGATE PROPERTY REF776976 10529.51
24 Jul 2025 CR FENWICK & PARTNERS REF785781 3769.01
24 Jul 2025 FPO BRAMBLE LOGISTICS REF143686 5818.37
26 Jul 2025 CR DELPHINIUM MEDIA REF296239 12330.81
29 Jul 2025 DD OSPREY LEASING REF530071 14778.04
30 Jul 2025 FPO CASTLEGATE PROPERTY REF297532 9511.37
30 Jul 2025 TFR NORTHGATE CLEANING REF415404 14267.00
rbs_transactions.csvUntouched by this perturbation
"Date","Type","Description","Value","Account Name","Account Number","Ledger Ref"
"01/07/2025","BAL","OPENING BALANCE","41491.92","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"01/07/2025","TFR","TFR NORTHGATE CLEANING REF104691","2333.15","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"01/07/2025","FPI","FPI OSPREY LEASING REF349193","1668.64","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"01/07/2025","DD","DD DELPHINIUM MEDIA REF449067","-8716.39","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"02/07/2025","TFR","TFR FENWICK & PARTNERS REF869702","14104.88","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"02/07/2025","TFR","TFR IRONBRIDGE TOOLING REF682507","7409.22","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"03/07/2025","FPO","FPO HARBOURLIGHT IT REF581564","-4513.83","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"03/07/2025","CR","CR JUNIPER PAYROLL REF556350","7111.78","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"05/07/2025","TFR","TFR AURORA CONSULTING LTD REF127424","6149.18","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"05/07/2025","BP","BP GREENHOLM FOODS REF904826","-9402.49","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"05/07/2025","FPI","FPI EASTFIELD ENERGY REF766590","4241.89","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"09/07/2025","FPO","FPO MOORLAND TELECOM REF776107","-6893.52","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"09/07/2025","DD","DD EASTFIELD ENERGY REF405197","-5437.81","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"10/07/2025","FPI","FPI KESTREL INSURANCE REF786219","2071.07","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"12/07/2025","TFR","TFR OSPREY LEASING REF648772","9144.36","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"13/07/2025","CR","CR MOORLAND TELECOM REF491567","3748.30","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"13/07/2025","DD","DD OSPREY LEASING REF131853","-8816.77","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"13/07/2025","DD","DD LARKSPUR TRAVEL REF646609","-5887.11","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"13/07/2025","SO","SO HARBOURLIGHT IT REF210871","-12588.57","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"15/07/2025","FPO","FPO BRAMBLE LOGISTICS REF452924","-11685.00","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"20/07/2025","DD","DD BRAMBLE LOGISTICS REF360600","-13067.90","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"21/07/2025","CR","CR JUNIPER PAYROLL REF736202","7891.86","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"22/07/2025","DD","DD KESTREL INSURANCE REF120680","-403.80","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"22/07/2025","SO","SO OSPREY LEASING REF703000","-13121.32","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"26/07/2025","SO","SO LARKSPUR TRAVEL REF575741","-9946.78","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"26/07/2025","FPO","FPO BRAMBLE LOGISTICS REF181623","-8470.39","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"29/07/2025","TFR","TFR MOORLAND TELECOM REF264685","3687.83","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"29/07/2025","BP","BP CASTLEGATE PROPERTY REF511205","-2318.00","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
"30/07/2025","SO","SO BRAMBLE LOGISTICS REF111032","-9204.96","LEDGERBENCH DEMO LTD","70-23-34 31266508","acct-2026000000-3"
 

Ground truth

Public here because the benchmark is open; it is the model's prompt path that can never reach these values, not human readers.

AccountClosing balance
acct-2026000000-1£5,989.14
acct-2026000000-2£81,971.48
acct-2026000000-3−£19,420.56

Recorded runs on this case

  • exactSingle prompt2 steps · 12,596 tokens · Confidence high

    Model claude-sonnet-4-6Measured 2026-08-20Bench v1.0Run 11eaa71b2d02Commit 3d38c30

  • exactAgent with tools20 steps · 46,757 tokens · Confidence high

    Model claude-sonnet-4-6Measured 2026-08-20Bench v1.0Run f140aa1e57f4Commit 384d72d

Step through any of these on the demo page.