Big data
By Gemma Morris
18th September 2014

“Humans don’t make very good decisions about people” – Tom Davenport

That was the attention-grabbing headline to an interview in the HR industry publication, People Management, in its July 2014 issue. Given that Tom Davenport is one of the most respected authorities on how businesses use Big Data, we were curious, to say the least, on what his thoughts were on the role of data in the hiring process.

The author of Keeping Up With the Quants and Big Data@Work, Davenport is well respected for his level-headed analysis of the use of metrics in the work place. In the interview, Davenport notes that despite the availability of useful data, HR departments tend not to use that information to derive conclusions and make forward-looking decisions. Instead, data is used merely for reporting, which Davenport terms ‘backward-looking.’

Davenport argues that data should be leveraged to assign values and inform business objectives. For example, he says, if your company has an attrition problem, you can mine data to make connections, identifying the issues linking departing employees, and thus perhaps right the ship going forward. This line of thinking makes perfect sense; it’s not a far cry from what ERP systems have been offering HR departments for years – a set of transactional data to capture employee data.

These metrics can be enormously useful, of course – but they’re less effective at getting at the underlying reasons why you might have an attrition problem. Operational issues are just as likely to stem from dynamics, personalities and emotions as anything that could be captured in an ERP system. And we can’t see how the role of HR could ever be replaced there. It’s about building trust with people to get them to talk openly, actually looking at people and their environment to spot problems and working out the right time and channel to communicate.

So the claim that humans don’t make good judgements about other people surprised us. To clarify, Davenport says in the interview that humans “tend to seek out and hire those who are much like themselves” and can be “unfair in evaluation processes.” Certainly there’s a grain of truth here. Human judgement is fallible and there are times when our own biases or agendas can cloud the hiring process in a negative way.

But on an enterprise level, we believe the human element is invaluable, crucial, irreplaceable. Leveraging Big Data to find specific skills sets or qualifications overlooks the critical element of ‘fit’ – is this employee right for your organisation? By trusting an algorithm to predict the best hires for your company, you miss out on the intangible values that the human element adds – the ability to assess future potential versus current qualifications and technical skills, for example, or the perception to decide whether a candidate really matches your corporate values.

It all comes down to the age-old question of whether it’s better to hire for specific skills to meet a short-term operational need, or to find someone who has the potential to be a true asset to the enterprise in future. We've seen many examples of someone being hired because they have expert knowledge of a particular software, only to find they’re simply not a good fit for the organisation. We believe in sticking with the old adage ‘Hire the attitude, not the skills’ – and humans are simply better at assessing that.

Which is not to say that humans don’t make mistakes in the recruitment, retention and engagement processes, of course. But they’re not problems necessarily resolved by the use of Big Data. Indeed, by the end of the interview, Davenport concedes that data “will never replace the need for some level of interaction before you hire someone.” We couldn't agree more. 

We’re curious to hear your thoughts on the topic. To what extent do you use metrics in the HR function? Would you ever hire someone identified by an algorithm without meeting them first? Please share your comments below.


"HR desperately needs some sort of help, if we humans are ever to get past this unemployment problem we’re having.

Hiring Principals can’t generalize because HR drones can’t be expected to interpret and analyze.

HR drones can’t evaluate, because the scope and substance of the jobs are light-years beyond their ken.

We potential employees get left in the dust, and those miserable few who do get past the Round File are judged more for our ability to craft a pretty resume than for our actual on-the-job skills.

No one in HR cares about our skills or our experience or our ability to adapt and learn your one-off kludgy software while providing the Customer Service your CUSTOMERS demand, so you continue your race to the bottom and beg for more immigrant workers to “fill the need” at slave wages.


Speaking of PAY… We happen to be good enough at our jobs to know what our contributions are worth, so that lowball salary might be accepted for starters, but we expect to be rewarded in proportion (not in excess!!!) to our contribution. Just so you’ll know.

Thanks for reading.

Jim" - Jim Long

"i agree that the human element is paramount; but many HR professionals may not be truly connected (and this applies to many managers throughout the organisation �� )" - Bruce Pentreath 


Currently there are no comments. Be the first to post one!

Post Comment


Is Artificial Intelligence wasting our money?

If you are anything like me, you will have become addicted to online shopping. And like me your addiction might have led you to questioning if you are buying things unnecessarily. Asking yourself: Am I wasting my money? So, as... Read More

15 years on: How times have changed…

When I incorporated KDR 15 years ago this month I had a simple mission. I wanted to run the market leading agency in its field placing contract staff with experience of working with the emerging data warehouse tool Kalido. I... Read More

The life of a Business Administration apprentice!

I started my apprenticeship with KDR in the September of 2018, when I was searching for a job I never imagined that I would find a company quite like KDR, from the moment I first stepped through the door everyone... Read More

How can data analytics impact climate change?

Every quarter we produce an e-magazine on issues and topics within the data and analytics world. In our previous issues we have looked at the impact of blockchain , the future of the data warehouse and GDPR . In our next issue... Read More

Where should we send our newsletter?