Module 5

Mixed methods involves the collection and “mixing” or integration of both

quantitative and qualitative data in a study. It is not enough to only analyze
your qualitative and quantitative data. Further analysis consists of integrating
the two databases for additional insight into research problems and questions.
Mixed methods research has increased in popularity in recent years, and this
chapter highlights important developments and provides an introduction to
the use of this design. This chapter begins by defining mixed methods research
and the core characteristics that describe it. Then the three core designs in
mixed methods research—(a) convergent, (b) explanatory sequential, and (c)
exploratory sequential—are detailed in terms of their characteristics, data
collection and analysis features, and approaches for interpreting and validating
the research. Further, these core designs are employed within other designs
(e.g., experiments), within theories (e.g., feminist research), and within
methodologies (e.g., evaluation procedures). Finally, we discuss the decisions
needed to determine which one of the designs would be best for your mixed
methods project. We provide examples of the core designs and include a
checklist to review to determine whether you incorporated all of the essential
steps in your proposal or project.
Designing a study is a difficult and time-consuming process. This book will not
necessarily make the process easier or faster, but it can provide specific skills
useful in research, knowledge about the steps involved in the process, and a
practical guide to composing and writing scholarly research. Before the steps
of the process unfold, we recommend that proposal developers think through
their approaches to research, conduct literature reviews on their topics,
develop an outline of topics to include in a proposal design, and begin
anticipating potential ethical issues that may arise in the research. Part I begins
with these topics.

Sequential Mixed Methods Design

Description of the design. The explanatory sequential mixed methods approach

is a design in mixed methods that appeals to individuals with a strong
quantitative background or from fields relatively new to qualitative
approaches. It involves a two-phase data collection project in which the
researcher collects quantitative data in the first phase, analyzes the results,
and then uses the results to plan (or build on to) the second, qualitative phase.
The quantitative results typically inform the types of participants to be
purposefully selected for the qualitative phase and the types of questions that
will be asked of the participants. The overall intent of this design is to have the
qualitative data help explain in more detail the initial quantitative results, thus
it is important to tie together or to connect the quantitative results to the
qualitative data collection. A typical procedure might involve collecting survey
data in the first phase, analyzing the data, and then following up with
qualitative interviews to help explain confusing, contradictory, or unusual
survey responses.

Data collection. The data collection proceeds in two distinct phases with
rigorous quantitative sampling in the first phase and with purposeful sampling
in the second, qualitative phase. One challenge in this strategy is to plan
adequately what quantitative results to follow up on and what participants to
gather qualitative data from in the second phase. The key idea is that the
qualitative data collection builds directly on the quantitative results. The
quantitative results that then are built on may be extreme or outlier cases,
significant predictors, significant results relating variables, insignificant results,
or even demographics. For example, when using demographics, the researcher
could find in the initial quantitative phase that individuals in different
socioeconomic levels respond differently to the dependent variables. Thus, the
follow-up qualitatively may group respondents to the quantitative phase into
different categories and conduct qualitative data collection with individuals
representing each of the categories. Another challenge is whether the
qualitative sample should be individuals that are in the initial quantitative
sample. The answer to this question should be that they are the same
individuals, because the intent of the design is to follow up the quantitative
results and explore the results in more depth. The idea of explaining the
mechanism—how the variables interact—in more depth through the
qualitative follow-up is a key strength of this design. Data analysis and
integration. The quantitative and the qualitative databases are analyzed
separately in this approach. Then the researcher combines the two databases
by the form of integration called connecting the quantitative results to the
qualitative data collection. This is the point of integration in an explanatory
sequential design. Thus, the quantitative results are then used to plan the
qualitative follow-up. One important area is that the quantitative results
cannot only inform the sampling procedure but it can also point toward the
types of qualitative questions to ask participants in the second phase. These
questions, like all good qualitative research questions, are general and open-
ended. Because analysis proceeds independently for each phase, this design is
useful for student research and perhaps easier to accomplish (than the
convergent design) because one database explains the other and the data
collection can be spaced out over time.

Interpretation. The mixed methods researcher interprets the follow up results

in a discussion section of the study. This interpretation follows the form of first
reporting the quantitative, first-phase results and then the qualitative, second
phase results. However, this design then employs a third form of
interpretation: how the qualitative findings help to explain the quantitative
results. A common misstep at this point by beginning researchers is to merge
the two databases. While this approach may be helpful, the intent of the
design is to have the qualitative data help to provide more depth, more insight
into the quantitative results. Accordingly, in the interpretation section, after
the

researcher presents the general quantitative and then qualitative results, a

discussion should follow that specifies how the qualitative results help to
expand or explain the quantitative results. Because the qualitative database
questions narrows the scope of the quantitative questions, a direct comparison
of the overall results of the two databases is not recommended.

Validity. As with all mixed methods studies, the researcher needs to establish
the validity of the scores from the quantitative measures and to discuss the
validity of the qualitative findings. In the explanatory sequential mixed
methods approach, additional validity concerns arise. The accuracy of the
overall findings may be compromised because the researcher does not
consider and weigh all of the options for following up on the quantitative
results. We recommend that researchers consider all options for identifying
results to follow up on before settling on one approach. Attention may focus
only on personal demographics and overlook important explanations that need
further understanding. The researcher may also contribute to invalidated
results by drawing on different samples for each phase of the study. If
explaining the quantitative results in more depth, then it makes sense to select
the qualitative sample from individuals who participated in the quantitative
sample. This maximizes the importance of one phase explaining the other.
These are a few of the challenges that need to be built into the planning
process for a good explanatory sequential mixed methods study.

DATA COLLECTION IN MIXED METHODS DESIGNS

It is essential to know the general procedures of collecting data in qualitative
and quantitative research because mixed methods research involves collecting
both forms of data. Before we turn to specific designs, here are several general
guidelines for collecting both forms of data in mixed methods research:
• The data collection procedures will vary depending on the type of
mixed methods design. A helpful way to conceptualize data collection
among the designs is to consider data collection as occurring concurrently or
sequentially. In concurrent data collection, the quantitative
and qualitative data are collected at roughly the same time (as in the
Triangulation and Embedded Designs). In the sequential approach,
the quantitative (or qualitative) data is collected first, and the results
inform the second (quantitative or qualitative) form of data collection
(as in the Explanatory, Exploratory, and Embedded Designs).
• When data are collected concurrently, the two forms (quantitative and
qualitative) of data are independent of each other; when collected
sequentially, the two forms of data are related or connected
Regardless of the concurrent or sequential or independent or
connected forms of data collection, use rigorous quantitative and
qualitative procedures, as discussed earlier in this chapter.
• IRB permissions are required for all research data collection. In the
concurrent approaches, both forms of data collection can be
described at the outset; in the sequential forms, only the initial phase
of data collection can be identified with any certainty. Because IRB
review boards require as full a disclosure of data collection procedures as
possible, in the sequential forms of data collection, state the
follow-up phase as tentative, recognizing that an addendum may need
to be filed with the IRB when the follow-up data collection procedures
are firmly established.

Data transformation in the mixed methods context refers to transforming the

qualitative data into numeric counts and variables using content analysis so
that the data can be integrated with a quantitative database.