Big data
By Gemma Morris
18th September 2014

“Humans don’t make very good decisions about people” – Tom Davenport

That was the attention-grabbing headline to an interview in the HR industry publication, People Management, in its July 2014 issue. Given that Tom Davenport is one of the most respected authorities on how businesses use Big Data, we were curious, to say the least, on what his thoughts were on the role of data in the hiring process.

The author of Keeping Up With the Quants and Big Data@Work, Davenport is well respected for his level-headed analysis of the use of metrics in the work place. In the interview, Davenport notes that despite the availability of useful data, HR departments tend not to use that information to derive conclusions and make forward-looking decisions. Instead, data is used merely for reporting, which Davenport terms ‘backward-looking.’

Davenport argues that data should be leveraged to assign values and inform business objectives. For example, he says, if your company has an attrition problem, you can mine data to make connections, identifying the issues linking departing employees, and thus perhaps right the ship going forward. This line of thinking makes perfect sense; it’s not a far cry from what ERP systems have been offering HR departments for years – a set of transactional data to capture employee data.

These metrics can be enormously useful, of course – but they’re less effective at getting at the underlying reasons why you might have an attrition problem. Operational issues are just as likely to stem from dynamics, personalities and emotions as anything that could be captured in an ERP system. And we can’t see how the role of HR could ever be replaced there. It’s about building trust with people to get them to talk openly, actually looking at people and their environment to spot problems and working out the right time and channel to communicate.

So the claim that humans don’t make good judgements about other people surprised us. To clarify, Davenport says in the interview that humans “tend to seek out and hire those who are much like themselves” and can be “unfair in evaluation processes.” Certainly there’s a grain of truth here. Human judgement is fallible and there are times when our own biases or agendas can cloud the hiring process in a negative way.

But on an enterprise level, we believe the human element is invaluable, crucial, irreplaceable. Leveraging Big Data to find specific skills sets or qualifications overlooks the critical element of ‘fit’ – is this employee right for your organisation? By trusting an algorithm to predict the best hires for your company, you miss out on the intangible values that the human element adds – the ability to assess future potential versus current qualifications and technical skills, for example, or the perception to decide whether a candidate really matches your corporate values.

It all comes down to the age-old question of whether it’s better to hire for specific skills to meet a short-term operational need, or to find someone who has the potential to be a true asset to the enterprise in future. We've seen many examples of someone being hired because they have expert knowledge of a particular software, only to find they’re simply not a good fit for the organisation. We believe in sticking with the old adage ‘Hire the attitude, not the skills’ – and humans are simply better at assessing that.

Which is not to say that humans don’t make mistakes in the recruitment, retention and engagement processes, of course. But they’re not problems necessarily resolved by the use of Big Data. Indeed, by the end of the interview, Davenport concedes that data “will never replace the need for some level of interaction before you hire someone.” We couldn't agree more. 

We’re curious to hear your thoughts on the topic. To what extent do you use metrics in the HR function? Would you ever hire someone identified by an algorithm without meeting them first? Please share your comments below.


"HR desperately needs some sort of help, if we humans are ever to get past this unemployment problem we’re having.

Hiring Principals can’t generalize because HR drones can’t be expected to interpret and analyze.

HR drones can’t evaluate, because the scope and substance of the jobs are light-years beyond their ken.

We potential employees get left in the dust, and those miserable few who do get past the Round File are judged more for our ability to craft a pretty resume than for our actual on-the-job skills.

No one in HR cares about our skills or our experience or our ability to adapt and learn your one-off kludgy software while providing the Customer Service your CUSTOMERS demand, so you continue your race to the bottom and beg for more immigrant workers to “fill the need” at slave wages.


Speaking of PAY… We happen to be good enough at our jobs to know what our contributions are worth, so that lowball salary might be accepted for starters, but we expect to be rewarded in proportion (not in excess!!!) to our contribution. Just so you’ll know.

Thanks for reading.

Jim" - Jim Long

"i agree that the human element is paramount; but many HR professionals may not be truly connected (and this applies to many managers throughout the organisation �� )" - Bruce Pentreath 


Currently there are no comments. Be the first to post one!

Post Comment


Data Visualisation vs Traditional Reporting

Every quarter we produce an e-magazine focussing on issues and topics within the data and analytics world. In our previous editions we have looked at; data analytics and climate change , the impact of blockchain and the death of the data... Read More

The best data conferences in 2019

2019 is set to be another big year in data, technology and analytics. As more ‘smart’ technology is being released the amount of data being collected is only going to rise. At KDR we find one of the best ways... Read More

Top blogs of 2018

Every year we take a look back at which blogs of ours you read the most, and this year is no different. While we write around a mix of topics including: data analytics , AI , IoT and more , it seems our... Read More

Information Matters – Data Analytics and Climate Change

We are proud to announce the sixth edition of Information Matters ! As recruiters in the Information Management and Data Analytics industry we consider it vital to in the know about issues and events facing our industry and your business. Our... Read More

Where should we send our newsletter?