What financial institutions need to test before relying on AI agents
Practical AI validation testing for compliance and reporting agents in financial services.
By: Dwayne Price, Kevin Coleman, AnneMarie Curtin, Anne Marie Flynn, Ray Byrne
06 Mar 2024 6 min read

The RSO sets out the key trends and risks facing the financial sector, along with their regulatory and supervisory priorities.
CBI defines the industry-wide supervisory priorities and outcomes across six themes, which are aligned with the corresponding priorities of the European System of Financial Supervision and ECB Banking Supervision.
Both retail and wholesale banks face the challenge of maintaining financial resilience to bolster the economy amidst shifting macroeconomic landscapes and fluctuating interest rates.
The focus lies on managing inherent risks, particularly credit and interest rate risks, necessitating vigilant credit risk management and customer engagement strategies.
Implementation of the Individual Accountability Framework (IAF) aims to mitigate undue risk-taking. Additionally, banks must navigate the digital revolution by offering robust digital support while catering to less digitally inclined customers.
CBI continues to focus on understanding Banks' operational resilience and IT infrastructure amid this digital transformation. Furthermore, CBI continues to assess firms’ implementation of environmental, social and governance (ESG) supervisory expectations and their progress towards enhancing ESG disclosures.
Key supervisory activities include;
Ongoing risk-based supervision will concentrate on inadequate risk control measures and concerns regarding the competence of appointed PCF role holders. Conflict of interest issues stemming from certain firms' incentivised remuneration models is a focus area, particularly among senior staff. MiFID firms need to ensure they meet both short- and long-term client needs while being cautious of the gamification of financial markets.
CBI has observed an overreliance on external and intra-group outsourcing among certain firms, and deficient IT and operational risk management practices. These areas will be focal points for the CBI's supervisory engagements to mitigate potential harm to investors and the wider markets.
Key supervisory activities for 2024/25 include;
CBI reaffirmed its views on control environment deficiencies, which were previously called out in its 2023 Dear CEO letter to Payment and E-money firms. CBI's key focus areas include safeguarding client assets, governance, operational resilience, and financial crime.
Given the evolving product offerings of these firms, due to the opportunities offered by cryptocurrencies, a specific callout is the impact MiCAR will have on these firms’ business models.
Firms need to have heightened awareness around Operational Resilience and Financial Crime by ensuring they have sufficiently robust Anti-Money Laundering (AML) and Countering the Financing of Terrorism (CFT) controls as the financial system evolves and risk levels rise. A key focus for 2024 will be for firms to be operationally ready for DORA and PSD III.
Key supervisory activities will revolve around;
CBI has highlighted its focus on consumer protection with the release of the Consumer Protection Outlook Report, outlining five critical drivers of consumer risk. Their assessment underscores the necessity for heightened measures to safeguard consumers and preserve financial system integrity. This includes urging firms to prioritise adequate resourcing and foster consumer-focused cultures for swift complaint resolution and equitable treatment.
Moreover, CBI has found that firms provide incomplete or unclear information throughout the customer journey, necessitating transparent disclosures, particularly concerning product benefits, costs, and grievance resolution processes.
CBI calls on firms to support consumers by offering tailored products and services, including responsible lending practices, to mitigate risks associated with higher inflation and interest rates.
Furthermore, the higher reliance on technology introduces cybersecurity and fraud risks, prompting a focus on cyber resilience and fraud prevention measures to uphold consumer trust and protect sensitive data.
Regulated entities should ensure their priorities are reviewed in light of this report, which includes a heightened awareness of the risks from Artificial Intelligence and an expanded scope in tackling Financial Crime. Key regulatory initiatives stated in the Dear CEO letter alongside the RSO include:
Grant Thornton’s Risk Advisory service is prepared to advise our clients on all matters highlighted in this RSO. Navigating the wide scope of supervisory priorities outlined by CBI requires a nuanced understanding of the ever-changing legal framework, staying on top of regulatory updates, fostering collaboration with regulatory bodies, and leveraging technological advancements. Our best in class advisory and assurance services can support you across the following areas:
Our team know the regulatory expectations and know how to implement your regulatory strategy and agenda in this increasingly rigorous regulatory environment.
Talk to our multi-disciplinary conduct Risk and Culture team today for comprehensive advice and support in navigating the risks and challenges facing this sector.
Practical AI validation testing for compliance and reporting agents in financial services.
PPWR obligations, timelines and compliance considerations for businesses across the EU.
How Rinn can convert research investment into innovation and economic impact.
Sign up for expert insights, industry trends, and key updates—delivered straight to you.