Mixed Methods

BPSY 75 - Field Methods

in Psychology
Ms. Shaine C. Hayag
AGENDA

01 02 03 04

FORMULATION
DATA DATA
AND
COLLECTION ANALYSIS
TYPES
STATEMENT
OF
HYPOTHESIS
 QUALITATIVE QUANTITATIVE
TEXT DATA NUMERIC DATA
This is a sample of a text 2342523112342
file of words that might 33211153421421
be collected on
54222311324511
interview transcripts,
observation fieldnotes,
5532422145152
or optically-scanned
documents
FRAMEWORK
Quantitative Data Qualitative Data

Mixed Methods

Method Methodology

Paradigm
Perspective Use of mixed methods
in other designs
A MIXED METHODS RESEARCHER

● Collects both quantitative and qualitative

data
● “mixes” them at the same time
(concurrently) or one after the other
(sequentially)
● Emphasizes both equally or unequally
 Mixed Methods
Mixed methods research is both a method and methodology for
conducting research that involves collecting, analyzing, and integrating
quantitative and qualitative research in a single study or a longitudinal
program of inquiry.
 Mixed Methods
The purpose of this form of research is that both qualitative and
quantitative research, in combination, provide a better understanding of
a research problem or issue than either research approach alone.
 WHY MIXED METHODS?

ž Quantitative data can reveal generalizable information for a large group

of people
○ These data often fail to provide specific answers, reasons, explanations
or examples
ž Qualitative research provides data about meaning and context regarding
the people and environments of study
○ Findings are often not generalizable because of the small numbers &
narrow range of participants
ž Both methods have strengths and weaknesses
○ When used together, these methods can be complimentary
TYPES OF RESEARCH DESIGN

Quantitative Qualitative Mixed Methods

research Methods research Methods Research Methods

• Experimental • Narratives • Sequential

designs •Phenomenology •Concurrent
•Non- Experimental •Ethnographies •Transformative
designs, such as •Grounded theory
survey •Case Studies
CRITERIA FOR CHOOSING A STRATEGY

Theoretical
Implementation Priority Integration
Perspective

No Sequence
Equal At data
Concurrent
collection
Explicit
At data
Sequential- analysis
Qualitative At data
Qualitative first
interpretation

Sequential- Implicit
Quantitative With some
Qualitative first combination
CRITERIA FOR CHOOSING A STRATEGY

ž What is implementation sequence of the quantitative and

qualitative data collection in the proposed study?
ž What priority will be given to the quantitative and qualitative data
collection and analysis?
ž At what stage in the research project will the quantitative and
qualitative data and finding be integrated?
ž Will an overall theoretical perspective (e.g., gender, race/ ethnicity,
lifestyle, class) be used in the study?
MIXING OR LINKING THE DATA
MIXED METHODS IS USED…

● To compare results from quantitative and qualitative

research
● To use qualitative research to help explain quantitative
findings
● To explore using qualitative research and then to
generalize findings to a large population using
quantitative research
● To develop an instrument because none are available
or useful
● To augment an experiment with qualitative data
REASONS TO USE MIXED METHODS

● The insufficient argument – either quantitative or

qualitative may be insufficient by itself

● Multiple angles argument – quantitative and

qualitative approaches provide different “pictures”

● The more-evidence-the-better argument – combined

quantitative and qualitative provides more evidence
REASONS TO USE MIXED METHODS

● Community of practice argument – mixed methods

may be the preferred approach within a scholarly
community

● Eager-to-learn argument – it is the latest methodology

● “Its intuitive” argument – it mirrors “real life”

DESIGNING A MIXED METHODS

● Preliminary considerations
● Creating a title
● Posing a general question
● Listing the types of data collection and analysis
● Making explicit your worldview
● Identifying your research design
● Drawing a figure of your design
● Writing a purpose statement
● Writing research questions
● Completing a research plan
PRELIMINARY CONSIDERATIONS

• Research problem
• Content – any topics
• Fit the problem to mixed methods (arguments)

• Access to both qualitative and quantitative data

• Background and resources

• Receptive audience
CREATE A WORKING TITLE

● Writing the title

○ Short
○ Topic
○ Participants
○ Include the words “Mixed methods”
○ Neutral –neither quan or qual
POSE THE GENERAL QUESTION TO BE
ANSWERED

● Write it as a question
● Look to see how it is phrased
● Make sure that it is specific enough and
focused (an answerable question)
● Ask yourself, “when I end the study, what
question would like to have answered?”
DETERMINE YOUR OVERVIEW
Postpositivism Constructivism
•Determination •Understanding
•Reductionism •Multiple participant
•Empirical observation meanings
and measurement •Social and historical
•Theory verification construction
•Theory generation
Advocacy/Participatory Pragmatism
•Political •Consequences of
•Empowerment issue- actions
oriented •Problem-centered
•Collaborative •Pluralistic
•Change-oriented •Real-world practice
oriented
STATE YOUR PROCEDURES (METHODS)

● Procedures for handling your qualitative and

quantitative data
● Sequence – concurrent or sequential or both
● Emphasis – emphasis on qualitative or quantitative
● Sometimes both concurrent and sequential phases are
used
● Designs may include more than two phases
● Think about using a simple, elegant design
 DESIGN OPTIONS

Design Name Equal priority QUAN emphasis QUAL emphasis

Concurrent, triangulation QUAL+QUAN QUAN+qual QUAL+quan

Concurrent, embedded n/a QUAN(qual) QUAL(quan)

Explanatory, sequential, QUANàQUAL QUANàqual quanàQUAL

quan first

Exploratory sequential, QUALàQUAN qualàQUAN QUALàquan

qual first

Sequential, embedded n/a (qual) QUAN (quan) QUAL

QUAN (qual) QUAL (quan)

MIXING THE QUAN AND QUAL DATA

Type of Mixing Type of Design Why Mixing Occurs Where Mixing

Occurs in Research
Process

Connecting Sequential One phase builds on Between data analysis

the other (Phase 1) and data
collection (Phase 2)

Merging Concurrent Bring results together After analysis of both

quan and qual –
typically in discussion

Embedding Sequential or Either building or Either between phases

Concurrent bringing results or in discussion after
together analysis
METHODOLOGICAL ISSUES

CONCURRENT DESIGNS SEQUENTIAL DESIGNS

— Use strategies to — In Explanatory Design,
explore contradictory select qual sub-sample
findings from quan sample
— Use parallel questions — In Explanatory Design,
— Select sub-sample of consider alternatives for
quantitative for follow-up qual sampling
qualitative — In Exploratory Design,
— Be sensitive to bias samples can differ
from one data — In Exploratory Instrument
collection to the other Design, consider qual data
analysis approaches for
developing instrument
QUALITATIVE RESEARCH QUESTIONS

● Qualitative central question

○ Begin with “what” or “how”
○ Focus on single phenomenon
○ Use exploratory verbs (discover, understand,
explore)
○ Non-directional language
○ A general question (allowing participants’
perspectives to emerge)
QUANTITATIVE RESEARCH QUESTIONS

● Can be hypotheses or questions

● State variables – independent, dependent, mediating,
covariates
● Develop from theory
● Use distinct measures for independent and dependent
variables
● Order variables from independent to dependent
WRITING RESEARCH QUESTIONS/HYPOTHESIS

● Write qualitative research questions and write

quantitative research questions/hypotheses

● Also write a mixed methods research question

● Write these questions separately

WRITING RESEARCH QUESTIONS/HYPOTHESIS

Three ways to write this question:

Methodologically-focused:
○ To what extent do the qualitative results confirm the quantitative
results?
Content-focused:
○ How do the interviews with adolescent boys support the
quantitative results that their self-esteem changes during the
middle school years?
Hybrid of quantitative and qualitative elements:
○ What results emerge from comparing the exploratory qualitative
data about boy’s self-esteem with outcome quantitative
instrument data measured on a self-esteem instrument?
ORDER THE TOPICS FOR YOUR PLAN

— Title
— Introduction
— (Problem)
— Worldview/theoretical lens
— Audience
— Purpose Statement
— Research Questions
— (Literature Review)
— Methods
— Type of Mixed Methods Design (also add definition of mixed methods)
— Types of Data Collection
— Types of Data Analysis
— Sequence/Emphasis/ Mixing Procedures
— Figure of procedures
— Anticipated methodological issues
— Ethical issues anticipated
— Validity issues
— Researcher resources and skills
— References, Appendices
DATA COLLECTION

QUANTITATIVE DATA QUALITATIVE DATA

Instruments Interviews
Checklists Observations
Records Documents
Audio-visual materials
DATA COLLECTION PROCEDURES

ž Identify and be specific about the type of data. Some forms of data
such as interviews and observations can be either quantitative or
qualitative. Although reduction information to numbers is the
approach used in quantitative research, it is also used in qual.
Research.
ž Recognize that quantitative data often involve random sampling, so
that everyone has no equal probability of being selected and the
sample can be generalized to the larger population. In qualitative
data collection, purposeful sampling is used to that individuals are
selected because they have experienced the central phenomenon.
DATA COLLECTION PROCEDURES

ž Relate the procedures specifically to the visual model. For e.g,

in a sequential explanatory model, the general procedures can
be detailed even further. A discussion of this approach might
include describing the use of survey data collection followed by
both descriptive and inferential data analysis in the first phase.
Then qualitative observations and coding and thematic analysis
within an ethnographic design might be mentioned for the
second phase.
DATA ANALYSIS

QUANTITATIVE ANALYSIS QUALITATIVE ANALYSIS

Use statistical analysis for Use text and images for
description, comparing coding, theme
groups and relating development and
variables relating themes
DATA ANALYSIS & VALIDATION PROCEDURES

It’s related to the type of research strategy chosen for the procedures.
Some of the more popular approaches:

ž Data transformation: In the concurrent strategies involve creating

codes and themes qualitatively, then counting the number of times
they occur in the text data. This quantification of qualitative data
enables a researcher to compare quantitative results with the
qualitative data. For instance, in a factor analysis of data from a scale
on an instrument, the researcher may create factors or themes that
then can be compared with themes from the qualitative database.
DATA ANALYSIS & VALIDATION PROCEDURES

ž Explore outliers: In a sequential model, an analysis of

quantitative data in the first phase can yield extreme or
outlier cases. Follow-up qualitative interviews with these
outlier cases can provide insight about why they diverged
from the quantitative sample.
DATA ANALYSIS & VALIDATION PROCEDURES

ž Instrument development: In a sequential approach,

obtain themes and specific statements from participants
in an initial qualitative data collection. In the next phase,
use these statements as specific items and the themes
for scales to create a survey instrument that is grounded
in the views of the participants. A third, final phase might
be to validate the instrument with large sample
representative of a population.
DATA ANALYSIS & VALIDATION PROCEDURES

ž Examine multiple levels: in a concurrent nested model,

conduct a survey at one level (e.g. with families) to gather
quantitative results about a sample. At the same time,
collect qualitative interviews (e.g., with individuals) to
explore the phenomenon with specific individuals in
families.
DATA ANALYSIS & VALIDATION PROCEDURES

ž It is necessary the validation of both qualitative and

quantitative phases of study. Each of methods has the
specific ways, for the qualitative data, the strategies that
will be used to check the accuracy of the findings need to
be mentioned.
REPORT PRESENTATION STRUCTURE

ž For a sequential study, mixed method researcher typically organize

the report of procedures into quantitative data collection and
qualitative data analysis followed by qualitative data and collection
and analysis. Then, in the conclusions or interpretation phase of the
study, the researcher comments on how the qualitative findings
helped to elaborate on or extend the quantitative results.
Alternatively, the qualitative data collection and analysis could come
first followed by the quantitative data collection and analysis. In either
structure, the writer typically will present the project as two distinct
phases, with separate headings of each.
REPORT PRESENTATION STRUCTURE

ž In concurrent study. The quantitative and qualitative

data collection may be presented in separate section, but
the analysis and interpretation combines the two forms
of data to seek convergence among the results. The
structure of this type of mixed methods study does not as
clearly make a distinction between the quantitative and
qualitative phases.
REPORT PRESENTATION STRUCTURE

ž In a transformative study, the structure typically involves

advancing the advocacy issue in the beginning of the
study and then using either the sequential or concurrent
structure as a means of organizing the content of the
study. In the end of the study, a separate section may
advance an agenda for change or reform that has
developed as a result of the research.
 COMMUNICATION PLATFORMS

Shaine C. Hayag

Instructor I, Department of Psychology

Hangouts E-mail Google Classroom

Shaine Hayag shainechayag@cvsu.edu.ph shainechayag@cvsu.edu.ph