We want to be clear about how we measure our progress. Here we set out what outcomes matter to us and the metrics we use to measure them.
Our outcomes
Our 3-year Strategy and annual Business Plan makes us more accountable by creating a clear path from the outcomes we want to achieve for consumers and market participants, to the tools and interventions we use.
We distinguish between 2 levels of outcomes - consistent topline outcomes and commitment outcomes:
Consistent topline outcomes
These are the outcomes we expect financial services markets to deliver - they stay the same from year to year and enable us to measure how we deliver our statutory objectives over time. For consumers and wholesale markets these outcomes are:
Our commitment outcomes
Our 3- year Strategy sets out our 13 commitments for 2022/23 to 2024/25. For each commitment we identify the outcomes we want to achieve for consumers and wholesale markets.
The graphic below shows our commitments and how they support the delivery of our topline outcomes:
The metrics we use to measure our outcomes
We use 3 types of metrics that:
- are based on research data that record the attitudes, perceptions or behaviours of consumers or firms (in particular, our Financial Lives survey (FLS) and the FCA and Practitioner Panel survey)
- provide market data that measure or are indicative of the outcome
- are based on our data that records our activities to achieve the outcome
We use 4 key data sources to inform multiple metrics across our outcomes. These are:
All metrics have limitations, especially when dealing with complex and inter-related outcomes.
Progress will not be immediate and will not be steady from year to year. A metric’s movement is often affected by what other related metrics, and other parties, are doing. We also need to consider the effect of economic uncertainty or other factors beyond our control. For example, there are many drivers of financial crime and several parties who can affect its prevalence and impact on victims. Many factors also contribute to operational disruptions, the ongoing conflict in Ukraine, along with other geopolitical issues, has resulted in a sustained heightened threat level of cyber-attacks affecting UK firms.
Unless specified otherwise, we include whether we want the metric to increase or decrease over the long-term.
For each metric we compare the current value with the baseline value and apply the following rules to determine progress:
Improved |
Indicates positive movement from the baseline value to the latest value of 5% or more |
---|---|
Declined |
Indicates negative movement from the baseline value to the latest value of 5% or more |
Little or no change |
Indicates movement from the baseline value to the latest value of less than 5% |
Not assessed |
This includes where latest values are not available, or data sources have changed |
For survey data (Financial Lives survey and FCA and Practitioner Panel survey) we use results of statistical significance testing to determine change.
It is important to note that these rules do not consider long term trends, so whilst the latest value compared to the baseline may show improvement or decline, this could be a result of additional factors, namely seasonality or natural variation in the data.
A proper assessment of the reasons behind any changes is key to understanding whether an increase or decrease should be seen as consistent with our stated outcomes. For example, a short-term jump in complaints or compensation claims may be driven by better consumer awareness of their rights or new approaches we use to identify harm faster. It can take time for effects or actions to materialise because the data can lag behind actions taken. But over time we might expect the numbers to fall as firm conduct improves and there is less cause for complaint or a claim.
We will keep all metrics under review and consider whether they remain appropriate for the outcomes we want to achieve, whether they should evolve or be replaced. We welcome your views on the metrics and data we set out on these pages at [email protected].
Summary of progress against our metrics so far
We have committed to report annually on our outcome metrics and these pages include our progress against each metric during the second year of our 3-year Strategy.
Our metrics show that we’ve made progress in 2023/24 against our outcomes for reducing and preventing financial crime, dealing with problem firms, enabling consumers to help themselves and improving the oversight of Appointed Representatives commitments.
Despite the challenging economic environment, we have generally not seen a meaningful worsening in some of the metrics where we might have expected to see a decline. For example, in relation to preventing harm from firm failure, we saw a slight decline in the proportion of firms failing to meet financial resource requirements for the year up to December 2023. This trend continues to reflect a low and stable proportion of firms who are not meeting financial resources requirements.
In relation to minimising the impact of operational disruptions, the cyber threat and operational resilience risks facing firms have continued to remain heightened, and we have seen several groups target financial services and their supply chain. As a result we are seeing an increase in operational disruptions reported to us. Despite the increase in incidents, we are pleased to see the impacts on important business services to be low.
The links below give further detail on our outcomes and metrics, including progress.
Topline outcomes and metrics
Outcomes and metrics for each of our commitments
- 1. Dealing with problem firms
- 2. Improving the redress framework
- 3. Reducing harm from firm failure
- 4. Improving oversight of Appointed Representatives
- 5. Reducing and preventing financial crime
- 6. Delivering assertive action on market abuse
- 7. Putting consumers’ needs first
- 8. Enabling consumers to help themselves
- 9. Our environmental, social and governance (ESG) priorities
- 10. Minimising the impact of operational disruptions
- 11. Preparing financial services for the future
- 12. Strengthening the UK’s position in global wholesale markets
- 13. Shaping digital markets to achieve good outcomes