HBR Articles About Big Data
HBR Articles About Big Data
Function?
by
Thomas H. Davenport
Loading...
HBR Staff/PeopleImages/Getty Images
I have argued over the past decade that the Human Resources (HR) function
has the potential to become one of the leaders in analytics. The key word, I
thought, was potential. Not anymore. A recent global survey on which I
collaborated with Oracle suggests that HR is right up there with the most
analytical functions in business — and even a bit ahead of a quantitatively-
oriented function like Finance. Many HR departments are making use of
advanced analytical methods like predictive and prescriptive models, and
even artificial intelligence.
This is a big change from a decade ago, when I began to study the use of
talent analytics. (Jeanne Harris, Jeremy Shapiro, and I published an article in
HBR on the subject in 2010). At that time, the only really sophisticated HR
analytics capability we uncovered was at Google and perhaps Harrah’s (now
Caesars). There was a fair amount of reporting going on, but not much
prediction. Few HR organizations even had a dedicated analytics person.
“HR analytics” typically meant a debate about how many employees the
organization had, or the best way to measure employee engagement.
Even before the new survey results came out, I suspected that things were
very different today. Most large companies have at least a small people,
talent, workforce, or HR analytics group. There are many conferences
devoted to the topic. It’s very common for organizations today to model
workforce growth, attrition, engagement, and other key variables.
But no function in a business stands alone with regard to data and analytics.
One reason that Oracle surveyed both HR and Finance executives is that
those two functions have an increasing need to collaborate. Workforce
expenditures are often among an organization’s highest costs, and a
company’s financial situation will dictate fluctuations in the size and makeup
of the workforce. The survey found high levels of collaboration and mutual
respect between HR and Finance, and a growing need for collaboration. For
example, 82% of respondents agreed or strongly agreed, and only 5%
disagreed, that “Integrating HR and Finance data is a top priority for us this
year.” However, several interviews conducted after the survey revealed that
there is still much opportunity for greater sharing of data and collaboration
on analytics.
“Big data” has become such a universal phrase that every function of
business now feels compelled to outline how they are going to use it to
improve their operations. That’s also true for Human Resources (HR)
departments, which is where most of a company’s money is spent, and where
— we’d like to believe — the real value lies.
One of the reasons for the special attention being given to big data in HR is
that the department is always under pressure to be more analytic — which is
justified to some extent. Some wishful thinkers believe that the application of
big data techniques will somehow rid HR of the some of the attributes they
don’t like about it, such as the perception that they’re focusing on “soft”
issues and not detailing the return on HR-related investments.
As with most of “the next big thing” stories in business, big data is really
important in some areas, and not so important in others. As a literal
definition, HR does not actually have big data, or more precisely, almost
never does. Most companies have thousands of employees, not millions, and
the observations on those employees are still for the most part annual. In a
company of this size, there is almost no reason for HR to use the special
software and tools associated with big data.
RELATED VIDEO
The Explainer: Big Data and Analytics
<span>What the two terms really mean -- and how to effectively use each.</span>
Save
Share
SEE MORE VIDEOS >
For most companies, the challenge in HR is simply to use data at all — the
reason being that the data associated with different tasks such as hiring and
performance management, often reside in different databases. Unless we can
get the data in those two databases to be compatible, there is no way to ask
even the most basic questions, such as which applicant attributes predict
who will be a good performer. In short, most companies — and that includes
a lot of big ones — don’t need fancy data scientists. They need database
managers to clean up the data. And they need simple software — sometimes
even Excel spreadsheets can do the analyses that most HR departments
need.
Consider Google’s very prominent efforts over the years to analyze their
people data with initiatives such as Project Oxygen, a multi-year research
project that was designed to try to figure out what makes a good manager —
a much more substantial effort than most any other company could pull off.
Most of the conclusions from that very intensive exercise were ones that
research discovered decades ago and which could have been found in
textbooks. That doesn’t mean it’s not a worthwhile exercise to test how those
standard assumptions of management play out in our own organizations, but
expecting to find big and new insights is simply a bad bet.
INSIGHT CENTER
Putting Data to Work
So, what should HR be doing with data, after we clean up our datasets?
Anytime we analyze data, it helps to start with the basics. First, just look at
the big picture — graphs plotting outcomes across the organization and then
over time: Where has turnover spiked, and when did it happen? Are there
places where there are consistent employee complaints? Second, look at
more of this data, more often. For example, the move to pulse surveys (short,
very quick, sometimes daily surveys) of employees that replace the annual
and ponderous morale surveys are a good idea. Smart companies like IBM
compile data that the employees themselves generate on company-sponsored
social media, for example, to monitor morale and identify workplace
concerns.
At the end of the day, everything starts with the quality of the data: If we
don’t think our performance appraisal scores are good measures of actual
performance, for example, then no analyses that try to predict who will be a
good employee will be worth doing.
“We have charts and graphs to back us up. So f*** off.” New hires in Google’s
people analytics department began receiving a laptop sticker with that
slogan a few years ago, when the group probably felt it needed to defend its
work. Back then people analytics—using statistical insights from employee
data to make talent management decisions—was still a provocative idea with
plenty of skeptics who feared it might lead companies to reduce individuals
to numbers. HR collected data on workers, but the notion that it could be
actively mined to understand and manage them was novel—and suspect.
Today, for the first time in the fifteen years I've been an analyst,
human resources departments are getting serious about analytics.
And I mean serious.
This last week I had another similar meeting and we had three of
the world's leading insurance companies, two large retailers, three
health care companies, and two manufacturing companies with
serious mathematicians and scientists assigned to HR.
If you look back in time, ten years ago companies tried to build "HR
Analytics" systems (typicall called HR data warehouses) to help
companies look at simple metrics like "total headcount," "time to
hire" and "retention rate" and clean up their messy, often
inaccurate people data. Quite a few companies built these
databases, but they were primarily used to be a single system of
record across the many HR platforms in place.
In the 1990s vendors like PeopleSoft, Oracle, and NCR/Teradata
built analytics products to support this market. They didn't sell
very well, primarily because companies had such complex HR
systems they didn't have the budget or IT support to build the HR
data warehouse. (Some companies did do this, and they have been
benefiting from this for many years.)
About five years ago the book Moneyball came out, and we started
a global marketplace called "Big Data." Tools like Hadoop, R, and
other parallel data management tools became productized and
industries like marketing, advertising, and finance started to
analyze massive amounts of data. Much of this started at Facebook,
Google, LinkedIn and other internet companies who simply had to
analyze enormous amounts of data to run their businesses.
Along the way the term "Data Science" was invented, and today
there are hundreds of jobs for "Data Scientists." (Typically defines
as people who understand information management, Big Data tools,
statistics, and modeling - a rare breed.)
During the last ten years we watched the discussion with HR stay
very tactical, focused on operational reporting and simply fixing the
mess of incompatible HR systems we have. There were many HR
and learning analytics presentations and a few conferences, but
most of the focus was helping technical practitioners improve their
reporting systems. The idea of predictive analytics was little more
than ROI studies to look at whether a training program worked.
(Full disclosure, I was the head of product management for two
companies that built advanced learning analytics solutions in the
early 2000s.)
The whole idea of our focus on "Big Data in HR" was to help HR
organizations realize that they, too, could enjoy the wave of interest
in Moneyball and BigData. HR is not as interesting a topic as
homeland security or cyberwarfare, but it's a big area of spending
(more than $4 trillion is spent on payroll around the world) so
there's a lot of opportunity in this huge data set. And the world of
"People Analytics" was born.
Today, while the topic is hot, HR teams are just starting to get good
at analytics. The problem has not been the concept, but rather
the focus. We spent far too much time trying to measure HR and
L&D spending, and figure out which HR programs were adding
value. While that seems interesting HR managers, typically
business people just don't care. What they want is information that
helps them run the company better: "Get me the right people into
the job, make them productive and happy, and get them to help us
attract more customers and drive more revenue. I don't care if your
L&D program has a 200% ROI or not."
Since then, interest in this market has exploded. And I mean like an
atomic bomb. Everyone is now talking about it, and the whole
concept has changed.
A few weeks ago I had a meeting with five major Silicon Valley and
New York companies who are focused in this area, and the room
was filled with statistics PhDs, engineers (like me), and I/O
psychologist PhDs. Thus the title of this article:
The geeks have arrived, and we're all happier for it.
We'll be doing a lot more research on this topic over the coming
years, but let me simply state clearly "The Geeks have Arrived:
People Analytics is Here."
How do you keep up? In this article I highlight ten of the biggest
disruptions happening in the space, and give you guidance for your
technology roadmap or investments over the next year. (Click
here for the detailed report. (Click here to view the Slideshare
view of this article.)
Think about goal management. Do you want your teams to build goals once per year
and not even look at them until performance appraisal time comes (the HR approach)?
Or do you want the goal management system to be “agile” and “always in use,” helping
people manage their weekly, monthly, and quarterly objectives? Our research shows
that companies who manage goals quarterly generate 30% higher returns from that
process than companies who manage them annually. Why wouldn’t the HR system
facilitate this agile, continuous goal management process?
Think about learning. Do you want your employees to “log into the LMS” only when they
think about it to find a course? Or would you rather them always viewing new videos,
new instructional modules, and new learning opportunities every day or right in the
context of their work? Today we want employees learning to be “fully integrated with
work” – not someplace they “go when they have time.”
This is not to say that web applications are going away – but rather
that the focus of new applications should now be “mobile first.”
Vendors have to look at usage mechanics, user interface, and
design of mobile apps. In a mobile device we “tap and swipe”
rather than “click and type” – so if your HR system is not designed
well for mobile, look carefully for a vendor that has made that
investment.
And mobile apps are just that: apps. They are small, interactive,
easy to use, single function systems. They look more like Snap Chat
and less like Outlook. They have red dots, simple swiping
mechanisms, lots of feedback, and are fast and efficient. A mobile
app should be usable within one or two clicks: many HR
applications take dozens of clicks just to get started.
[/entity]
A new solution from Deloitte, for example, looks at real time labor
activity and uses analytics techniques to show companies how to
save what could amount to millions of dollars in payroll expense
without reducing any worker flexibility or productivity. Similar
solutions now let companies scientifically understand who their
leading recruiters are and how to source far better candidates
based on the success profile of existing employees. One vendor has
a “virtual educator” who looks at an employees’ online activities
and actually recommends training and learning based on their
patterns of activity.
While most companies still have annual reviews, more than 80%
(Deloitte Human Capital Trends 2014) tell us they are not worth the
time people spend on them. Today companies want programs that
focus on real-time feedback, coaching, development, and agile
approaches to goal management. This means redesigning
performance management to be more agile, developmental, and
transparent.
Today the LMS market is over $2.5 billion in size and grew by over
21% this year, so it is the fastest growing major segment in HR
software. Why the growth? Corporate learning, content, and
collaboration have become fundamentally strategic to nearly every
company. Today every company needs to reskill technical staff,
onboard and train new employees, build deeper leadership
pipelines, and help people learn how to do their job better.
What about the big issue of buying all your HR applications from a
single ERP vendor? With Oracle, SAP, Workday, SumTotal, Infor,
ADP, Ultimate, and other HRMS providers offering a range of talent
management applications, is it time to consolidate to a single
vendor solution?
Are all the ERP vendors the same? Not at all. Each vendor has its
own core strengths and a variety of new vendors now focus on the
mid-market. If you are a global company you must evaluate payroll
solutions as well as country-specific solutions and support. If you
are a mid-market company you should make sure the system is both
affordable and very easy to use.
Despite the consolidation, you will still end up with multiple vendor
solutions. Innovation in the areas of networked recruiting,
analytics, crowdsourcing, real time engagement management,
social recognition, and collaborative learning still continues. The
ERP vendors now offer credible, trusted solutions for most core
applications of HR and talent, but most of the innovation continues
to come from small providers.
Look, for example, how fast companies like Snapchat and Whatsapp
became billion dollar valuation companies. It wasn’t because these
companies had thousands of advanced features – in fact it was quite
the opposite. These development teams were able to harness new
mobile and cloud technology to create a highly engaging user
experience that makes communications or photo sharing easy. This
is not as simple as it sounds. They invested many hours of trial and
error to learn how to build highly engaging mobile applications,
eventually creating something transformational in our lives. HR
vendors have to do the same.
Winning vendors will build agile, highly expert teams. They will
likely release new features and interfaces every few months and
they will be able to rapidly adapt their products as technology, user
experience, and client demands change.
(The war for technical talent is raging: Vendors like Hiqlabs, which
just released an innovative new analytics solution for retention,
have attracted some of the top data scientists in Silicon Valley.
Workday "acqui-hired" their team from Identified, and Cornerstone
just "acqui-hired" theirs from Evolv.)
The incumbent, larger vendors will likely remain, and the winners
will continue to acquire smaller companies. Vendor sales forces will
probably compete as vigorously as ever, but buyers will start
looking at HR technology as a total “employee experience."
Vendors have many challenges to deal with over the next few years,
but the marketplace is filled with highly trained, motivated, smart
people and we believe HR technology can add ever more value each
day. This is a dynamic market filled with talented and committed
vendors, and we see the value of HR technology going up rapidly.
Perhaps for the first time since the original personnel database was
developed on a mainframe, we believe HR technology can become
one of a company’s most important tools for talent management,
strategic decision-making, and overall company success.
Quality of data. Talent analytics relies on techniques that are borrowed from domains or business
functions (such as marketing and finance) that tend to produce very large volumes of data.
However, small organizations may not have high-quality HR data and may lack the analytical
capabilities to adapt techniques designed for big data to areas where the volume of data is quite small
(Cappelli 2017). The result is that translating the findings into business outcomes can
be problematic.