CHAPTER 3: Research Methodology: 3.3.1 Population
CHAPTER 3: Research Methodology: 3.3.1 Population
3.1 Introduction
This chapter provides a justification for the methodology and methods chosen for the
study. It provides an explanation of the choices made for testing the relationships in the
conceptual model, including the sampling, procedure, measures, and the analytical
approach.
3.3 Participants
3.3.1 Population
The investigation took place in a multinational automotive supply company that
produces safety parts for the big five automobile manufactures and supplies products to
other well-known international automobile producers. The company employs 60,000
employees located in 26 different countries. The company has been a global leader in
the automotive supply industry for several years. It is organized according to different
independent global business units that report to centralized, functional Executive Vice
Presidents, or to the CEO, COO, or CFO. The company was highly suitable for this
study as it is a technically orientated organization that depends heavily on the
performance, skills, knowledge, and abilities of engineers or technicians. The study was
conducted in one of the globally organized autonomous business units with locations in
UK, China, Malaysia, Poland, The Czech Republic, Germany, Italy, Spain, South-
56
America (Brazil), North America (Winona, Livonia) and Mexico (Reynosa), and has
5000 employees. At the time when the study was conducted, the facilities in North
America and Mexico were not part of the newly structured organization; thus, they not
included in the investigation.
From Table 2, it can be seen that the response rate for each country differed. In
some locations, employees did not like to complete surveys. For instance, the lowest
response rate was obtained from the participants located in Germany where the
headquarters of the business was based. Participants expressed their concern about the
confidentiality of the survey. The Chinese employees chose to complete the surveys.
Local HR managers played an important role in increasing the response rate by
communicating with the participants.
Location
Percent
Germany China Brazil Poland Czech Italy UK Total
total sample
Participants age group
20-30 1 37 4 1 11 1 0 55 18%
30-40 11 60 11 6 22 12 5 130 43%
40-50 21 4 11 0 4 13 8 65 21%
50-60 10 0 4 4 4 22 11 55 18%
Total 44 103 30 11 41 52 24 305
Percent 14% 34% 10% 4% 13% 17% 8%
be concluded that the business is dominated by males at 75% (n = 219) and has 25% (n
= 72) females, which is not surprising since the business operates in a technically
orientated industry and the participants were predominately chosen from non-
administrative departments. It is important to note that China reported the highest
female rate of 40% (n = 40) compared to the other countries. On the other hand, Brazil
reported the highest male rate of 93% (n = 30), whereas China showed the highest male
rate as a percentage of the total population with 21% (n = 60). It can be seen that the age
group 30-40 had the largest representation at 43 % (n = 125), of which 10% were
female and 33% male.
Poland, and Germany. In these countries, the translation from English into the local
language was performed by internal employees with a professional level of English
skills and then back translated from English into the local language by an external
institution. Copies of the translated questionnaires were shipped via DHL to the
locations in which the participants were based. The local Human Resource Manager
informed the selected participants about the purpose of the survey, either individually or
during a group meeting, and distributed the printed pen-and-paper self-administered
questionnaires.
All the participants received the questionnaire in a similar order to ensure
consistency when analyzing the responses to draw conclusions from the research
results. The questionnaire was structured in such a way that similar questions were
posed to all participants in a similar order. The group of local Human Resource
Managers received a detailed briefing via telephone and by sharing documents online
prior to the distribution of the survey. In these briefings, the researcher shared the
purpose of the study, the process of data collection and the covering letters that were
attached to each questionnaire. A few participants complained about completing the
survey during their normal working hours at the expense of some business tasks they
needed to accomplish. Some refused to participate because they did not wish to support
any survey conducted in the company. The participants were asked to complete the
survey within a period of two weeks. Some people asked for the deadline to be extended
by another week, which was accepted. The surveys were shipped to the researcher’s
home address once the participants had completed the questionnaires. The return rate
was 67%.
“The biggest problem in conducting a science of human behavior is not selecting
the right sample size or making the right measurement. It’s doing those things
ethically…” (Bernard, 2000, p. 21). For this reason, the questionnaire and data
collection approach was reviewed and approved in line with the standards set for
doctoral work at the Leiden University's Campus, The Hague. All participants were
informed about the ethical principles of this study in advance via the covering letters
attached to each questionnaire. The covering letters explained the purpose of the study
and informed the participants that the survey was authorized by the Vice President of
the Business Unit and by the Vice President of Human Resources in the company.
Participation in this survey was purely voluntary and at the participants’ discretion. It
was also stated in the covering letters that there would be no negative implications if
60
someone decided not to participate. The participants were then asked to return the
questionnaires anonymously to the local Human Resources Department. The
questionnaires were shipped to the researcher’s private address. The data were entered
onto a software program installed on the researcher’s private computer by a student who
was sitting alone in a private room.
Part I requested some demographic data and was designed to analyze data that
impacted on national cultural differences.
aspects of work (Jing & Rounds, 2012), a positive association with the dependent
variables was expected. Furthermore, this instrument was used previously in many
studies and has received widespread acceptance (Maslach & Jackson, 1981; Meglino,
Ravlin, & Adkins, 1989).
Part III of the questionnaire contained three individual outcomes as the dependent
variables, namely Work Engagement, Emotional Exhaustion, Affective Commitment,
and one organizational outcome, Productivity.
Work Engagement: To test the hypothesis about the predictor of work engagement, the
17-item Work Engagement Scale developed by Schaufeli, Salanova, Roma, and Bakker
(2006) was chosen. The instrument is one of the most widely used and been applied in
various studies; therefore, it was considered appropriate for this investigation. The 17-
item Utrecht Work Engagement Scale (UWES) consists of a three-factor model such as
vigor, dedication, and absorption. The items describe a feeling at work as well as a
passion for work leading to a positive association with performance. The participants
used the five-point scale to measure emotional exhaustion and assessed each item.
Therefore, the items were scored according to two dimensions: frequency (how often)
and intensity (how strongly). Frequency was measured using a five-point scale ranging
from 0 (never), 1 (a few times a year), 2 (a few times a month), 3 (a few times a week),
to 4 (every day). Intensity was measured using a five-point scale ranging from 0
(never), 1 (very mild), 2 (noticeable), 3 (major), to 4 (very strong). This two
dimensional measure showed how often participants invested energy in their work roles
and how strongly they felt they were engaged. The reason for using the five-point scale
in this study was to be consistent with the scale for measuring emotional exhaustion in
order to have a better comparison between the two constructs.
Emotional Exhaustion was measured using nine items taken from the Maslach Burnout
Inventory developed by Maslach and Jackson (1981). The entire Burnout Inventory
consists of 25 items divided into four subscales: emotional exhaustion, personal
accomplishment, depersonalization, and an optional scale, involvement. The
questionnaire was designed to assess the consequences of burnout syndrome on the
quality of service of staff in human service institutions (Maslach & Jackson, 1981).
However, since burnout has become a global epidemic that has affected employees in
63
different professions, the questionnaire has been used for research in different industries
and countries (Maslach, Schaufeli & Leiter, 2001). At present the questionnaire is still
widely accepted and has been applied in numerous recent studies (Haines & Saba 2012;
Rubino, Volpone, & Avery, 2013; Thanacoody, Newman, & Fuchs, 2013; Tourigny,
Baba, Han, & Wang, 2013). For this study, the subscale “emotional exhaustion” was
deemed appropriate as the participants were in a similar situation to people working in
human service institutions or health care. The nine items from the subscale “emotional
exhaustion” were rated following the scale used by Maslach and Jackson (1981). The
items were used to measure two specific dimensions as proposed by Maslach and
Jackson: frequency (how often) and intensity (how strongly). Frequency was measured
using a five-point scale ranging from 0 (never) ,1 (a few times a year), 2 (a few times a
month), 3 (a few times a week), to 4 (every day). Intensity was measured using a five-
point scale ranging from 0 (never), 1 (very mild), 2 (noticeable), 3 (major), to 4 (very
strong).
Commitment was assessed using the subscale ‘affective commitment’ from the
questionnaire developed by Meyer and Allen (1997). According to Meyer and Allen
(1997), affective commitment refers to the desire of an employee to remain at the
company and to be aligned with the goals and strategy of the company. As the research
aimed to determine the impact of value congruence, it was necessary to determine why
employees had chosen to remain at a company. For to this reason, only affective
commitment was examined in the study and other forms of commitment were ignored.
The items were rated on a five-point Likert scale, from 1 (strongly disagree), 2
(disagree), 3 (neutral), 4 (agree), to 5 (strongly agree).
order to achieve organizational and personal goals by reinforcing effective behavior and
actions (Walumbwa et al., 2011). For this study, productivity was measured individually
by using a self-constructed scale, as there no validated scale that assessed white-collar
productivity directly was available. The internal consistency of this scale was six, which
was quite satisfactory after the deletion of one item (see Appendix F). In total, four
items were added and were used to measure productivity on a five-point Likert Scale,
from 1 (strongly disagree), 2 (disagree), 3 (neutral), 4 (agree), to 5 (strongly agree). The
full questionnaire can be found in Appendix B.
a common and recommended method for statistical analysis in the social sciences
(Bernard, 2000; Raab-Steiner & Benesch, 2008; Williams, Sweeney, & Anderson,
2009). Using “profile analysis” (Bernard, 2000, p. 422), the data were also explored per
national culture. Furthermore, a reliability analysis was employed to test the consistency
of the scales of the independent and dependent variables (constructs). In addition,
correlation analysis was used to explore (the strength of) the association among
variables, and to investigate whether these associations were significant.
To determine value congruence, the average of the absolute difference between
two entities of all 31 value items were taken. To be more precise, the participants were
asked to rate how important each statement was to themselves and secondly how
important that same statement was as perceived in the organization. The absolute
difference between the two scores reflects the amount of discrepancy. Thus, a low score
indicated a higher degree of value congruence, whereas a high score implied less
congruence. The respondents assessed the two entities using a five-point Likert scale
ranging from 1 (highly unimportant) to 5 (highly important). One entity reflected the
level of importance of a particular value statement for the individual, while the other
entity reflected the level of importance as perceived by the organization. Despite
criticisms of Cronbach (1953), Edwards (1993, 1994) and Finegan (2000), this method
was favored as it enabled a more detailed understanding of the discrepancies in more
detail. Second, a reliability test for the value instrument displayed a Cronbach’s α of
.94, which reduced the potential weakness. Moreover, despite earlier criticisms e.g.
Cronbach (1953), Edwards (1993, 1994), and Finegan (2000) recent research has
favored this approach. For example, Nwadei (2003) used the normative approach (e.g.,
difference scores) arguing that the ipsative technique (e.g., ranking) forces respondent
to rank values at the expense of another. In addition, he criticized approaches where
people been asked to assess directly the perceived congruence as respondents may not
know their own values, not to mention the values of an organization. In support of this,
Meglino and Ravlin (1998) assessed the application of difference scores in the
measurement of value congruence as essential.
Individual values were calculated by averaging the ratings of the items as
important for themselves. The same method was applied for the constructs of the
dependent variables, work engagement, emotional exhaustion (on two dimensions,
“frequency” and “intensity”), affective commitment, and productivity.
67
Figure 3: Research Model 1 - value congruence, individual values predict outcome variables, moderated
by individual values
In addition, the chapter includes an analysis of the combined effect of value congruence
and individual values and the interaction effect (moderation) of individual values on the
relationship between value congruence and the six outcome variables mentioned above.
Figure 3 illustrates stage 1.
To support the aim of stage 1, correlation analysis was first used to investigate
whether there was a relationship among the variables and to investigate whether the
relationship was significant. In addition, linear multiple hierarchical regression analysis
was performed in three steps to measure the direction and strength of the relationship
between the outcome variables and to explore whether value congruence accounts for
variation in work engagement, emotional exhaustion, affective commitment, or
productivity. In the second step of the linear multiple hierarchical regression analysis
individual values were added to test whether value congruence is still related to the
68
outcome variables. 1 In the third and final step of the linear multiple regression analysis,
the interaction term between value congruence and individual values were added to
determine whether, and to what extent, the effect of value congruence on the outcome
variables was moderated by individual values. In support of this, the central idea of the
thesis is to cast more light on the nature of the moderation (Field, 2014), because there
might be cases in which the moderator would increase the effect of the predictor on the
outcome, in which the moderator would decrease the effect, or in which the moderator
would reverse the relationship between the predictor and the outcome. Moreover, the
influence of the moderator on the relationship might or might be not be significant.
Therefore, a deeper investigation is suggested, which involves conducting a simple
slope analysis that examines the relationship between predictor variables and outcome
variables at low, mean and high values for the third (moderating) variable (Field, 2014).
To achieve this the tool PROCESS (Hayes, 2012) was used to detect a possible
moderation effect by providing estimated data for three different levels of values for the
moderator.
Stage 2, Chapter 5 is dedicated to testing Hypothesis 5-7 in order to investigate
value congruence and individual values multidimensionally. In other words, it explores
the strength of the different value dimensions related to the individual or organizational
outcomes. Furthermore, it discusses whether the effect of the value dimensions’
congruence on the outcome variables is moderated by or depends on the level of the
individual value dimensions.
1
As individual values are an integral part of value congruence, absence of collinearity was verified.
69
Figure 4: Research Model 2 - value congruence, individual value dimensions predict outcome variables,
moderated by the individual value dimension
was used to investigate in which nation the relationship between value congruence and
outcome variables changed by taking individual values into account, reflecting
Hypothesis 6. In stage 2, similar statistical methods were used to explore the cultural
effects for testing Hypothesis 10. In other words, descriptive data for value congruence
dimensions and individual value dimensions were computed to show the mean value of
the various countries. Correlation analysis was performed to analyze whether the
association of value congruence dimensions or individual value dimensions with work
engagement, emotional exhaustion, affective commitment, or productivity varies among
national cultures.
3.8 Summary
The findings in the existing literature suggested the adoption of a deductive approach
for the study. A survey strategy was selected in which a questionnaire was employed to
gather data from a multinational company. The company was considered suitable for
this study due to its inclusion of employees from different nations and across different
locations. Moreover, accessibility for the researcher also made the selection of this
company suitable to this study. The final number of respondents who participated in this
study was 305. For the analysis of data, various quantitative methods were used, such as
descriptive data analysis, correlation analysis, regression analysis with interaction
effects, and multiple regression analysis. To meet the research objectives, the analytical
process was conducted in two steps:
(a) To test the effects of different value concepts, such value congruence and individual
values, on emotional exhaustion, work engagement, affective commitment and
productivity, and to investigate the moderating role of individual values on these
relationships, and
(b) To explore the strength of different value dimensions on the outcome variables and
the moderating role of particular individual value dimensions on the relationship of
different value congruence dimensions and emotional exhaustion, work
engagement, affective commitment, or productivity.