Turning Big Data into Smart Data

Turning big data into smart data – the need to survive

To say data is critical to success in financial markets is a vast understatement, but for many banks, the ability to extract the true value of their data is still beyond their grasp. Matthew Hodgson, CEO and Founder of Mosaic Smart Data, looks at what’s holding these institutions back and why in a post-2020 world, failure to ignore could prove costly. 

The value of market and transactional data is nothing new. It is the lifeblood of financial markets and an integral component in every market participant’s toolkit. Every institution uses its data differently – but what unites many of them is that they are not fully maximising its value. 

Matthew Hodgson, Mosaic Smart Data

In the FICC markets, this is particularly apparent. All FICC businesses are under unparalleled pressure due to the changing risk conditions and scrutiny that has increased largely as a result of the constraints of regulatory initiatives such as MiFID II and tumultuous market conditions caused by the pandemic. 

Firms across the sell-side, buy-side as well as exchanges and CCPs, are all struggling to unlock the value in their data to help them to tackle these critical challenges. Thankfully, there is a solution: advanced analytics of their business. 

However, it’s not quite as simple as flicking a switch and suddenly extracting actionable insight from your data. All analytics programmes must begin with putting fundamental data foundations in place. Without the right preparatory work and coherent data sets, valuable insights will continue to remain inaccessible to those institutions that do not address their overall data strategy. 

In today’s markets, for banks to act seamlessly and efficiently they have to be able, at the drop of a hat, to answer questions like, who are their best clients? Which asset class is seeing the most business? and many more. The answers to these questions lie in transaction data, real-time analytics and AI, however the vast majority of banks do not have their data in a place where this is even possible. 

Prior to embarking on an analytics journey banks must address the fundamentals of their data business before expanding onwards into further technological development. The pandemic has created an uncertain and challenging operating environment, but a carefully planned programme that combines cutting-edge data analytics and AI technology holds the key to driving growth and turning the tide of decline. 

Quality over quantity is also key. Consuming vast swathes of market data is no longer the be-all and end-all of data usage. Instead, intelligent data analytics is based around the premise that less data that is more comprehensive is better than vast quantities that lack value. 

Despite this, some market data vendors are still trying to sell unyielding swollen data sets that are incoherent, unwieldy and require huge amounts of time to extract anything of any value. 

For a bank to truly transform its FICC business, it must turn big data into smart data. But how can this be achieved?

One step at a time: the journey to successful analytics 

Like all FICC market participants, banks sit on a vast untapped bedrock of market and transactional data. This data is a precious commodity, but the majority of these institutions are unable to harness it in a way that allows them to provide added value services direct to customers and generate more income for themselves. 

In the era of COVID-19 and the subsequent shift to a digital working environment, banks have to be smarter than ever when it comes to gaining a comprehensive view of their data and extracting value from it. While people are speculating that the end of the ‘new normal’ might be on the horizon, the impact it has on the way we work and where we work is undoubtedly set to remain, with efficiency being the key. 

The journey to a successful data analysis programme begins with the normalisation of transaction and market data. Aggregating, standardising and enriching data sets are the foundation of any successful analytics programme. 

From this solid foundation, advanced analytics tools can then begin to deliver value, providing insights across the organisation. The critical gain firms will experience on this journey is analysis and reporting of their clients’ activity becoming more dynamic, actionable and profitable. 

Overcoming complexity

When you consider how many clients that banks cover, all with different needs, demands, areas of expertise and areas of focus, this journey can be daunting and complex. But as the financial services industry has transitioned towards a remote working future for the time being, effectively monitoring internal teams as well as client activity is more essential than ever before. 

This challenge can be overcome most effectively by engaging a specialist analytics firm to cleanse, normalise and enrich raw transaction data. This provides a consolidated real-time view and analysis of the transactions flowing through the organisation, delivered in a language that financial market professionals can understand. 

One area that has garnered much attention of the financial markets over the recent years is the utilisation of Artificial Intelligence (AI). Institutions utilising AI have been reported to have a 58% chance of improving profitability.[1] However, the ability to use AI techniques effectively depends on having access to complete and high-quality data – a challenge that financial institutions rank as in the top three key hurdles to AI implementation.[2]

With regulations and risk conditions looking set to increase over the near future, competent data sets will not only allow institutions to manoeuvre the new regulatory landscape but also have a significant impact on profitability from the insights that can be delivered as a result of this. 

The next six months will be a critical period for all sell-side businesses and partnering with a specialist analytics firm to effectively harness the value locked within data can help ensure an efficient and profitable transition to a post-COVID world. 


[1] Global survey of 151 financial services firms by World Economic Forum (WEF) and University of Cambridge Judge Business School, January 2020

[2] Global survey of 151 financial services firms by World Economic Forum (WEF) and University of Cambridge Judge Business School, January 2020