By Nicola Askham
28th January 2013

We often read insightful articles written by journalists who have based their article on data provided by a particular respected industry association. A lot of people make decisions based on such articles, but have you ever thought about how reliable that data might be? Just because the data comes from say the British Bankers Association, the British Retail Consortium etc. should we necessarily believe it?

By definition any report issued by a trade association must be based on the combined data of their members, but do you know how good all or some of that data is?  Does it contain data from all their members or just a sample?

Data Management as a discipline is still relatively immature so how do you know that the data the report is based on is any good, or that it has combined the same things or compared like with like, to come up with an aggregated view?

So what’s the solution to this predicament?

In Insurance Regulation the Solvency II Directive recognises this issue and makes the requirement that external data must be treated as though you had created that data yourself.  This requires knowing how good that data is and how it has been controlled before you received it.  On a company basis you can look at including contract terms regarding the quality of data which you purchase and maybe even include a right to audit that data periodically.  But that doesn’t help us when we are reading our daily newspapers.

I think that we are a long way from such reports coming with some kind of assurance of quality of the data both contained within the report and the sources of that data. I’m not sure that it will ever happen, so can you do anything to increase your confidence in the data?  Well to be honest, I think you are limited in your options, but if you want to make an important decision based on such reports my advice would be as follows:

  • Check for other sources of the same or similar data to compare.
  • Look at previous years reports and see if they have changed as you would have expected.
  • Look for changes in trends and look for independent explanations of those changes.  For example if say growth in a certain sector has been 5% year on year and then suddenly is 12% this year, are there reported reasons for such an increase?

So while I’m not saying that you should distrust every report, a healthy dose of cynicism would not go amiss.  Remember what Harold McMillan is reported as saying: “ I read a great number of press reports and find comfort in the fact that they are nearly always conflicting”.


Nicola is an independent data management consultant, whose primary area of expertise is data governance.  Nicola has experience in designing and implementing full data governance organisations in both regulatory and non-regulatory environments. She has worked in Data Management for ten years, initially for a leading UK Bank, before becoming a consultant at the beginning of 2009.  Most recently Nicola has spent most of her time delivering data governance for Solvency II and also offers data governance coaching.

Nicola presents at Data Management Conferences, is a Director and Committee Member of DAMA UK and is on the Expert Panel of

If you would like to be our next guest blogger, please get in touch with Gemma Morris


Currently there are no comments. Be the first to post one!

Post Comment


Have an opinion on Citizen Data Scientists? We want to hear from you!

Each quarter we produce an e-magazine on issues the information management and data analytics industry might be facing. In previous issues we have looked at: GDPR , Self-Service BI and Data Warehousing . We are constantly looking for guests to write articles... Read More

The importance of keeping your data safe in a data driven world

The security of our personal data is becoming more important in this data driven world. It’s not unheard of for major security and cyber hacks where people’s personal data is stolen, or just simply their technology is ‘taken over’. The... Read More

4 reasons a coding bootcamp could be for you

The popularity of coding and data science bootcamps across America is rapidly growing with it becoming an alternative route into the working world, rather than attending university. I recently wrote about why a company should hire a coding and data... Read More

Will Virtual Reality change the way we live?

Virtual Reality (VR) is taking many industries by storm. From gaming companies to film makers, VR is revolutionising the way we view the world. While Virtual Reality is being incorporated into the way companies are working and creating new products,... Read More

Where should we send our newsletter?