Lesson 3 Choosing Data Collection Techniques
Lesson 3 Choosing Data Collection Techniques
Lesson Objectives:
At the end of the lesson, students should:
1. Discuss the important features of a data collection plan;
2. Explain the importance of every data collection method or technique for gathering data; and
3. Differentiate the survey, experiment, and observational study.
Introduction
Data can be collected in a variety of ways. One of the most common methods is through the use
of surveys. We have briefly discussed three common techniques for gathering data: observational studies,
experiments, and surveys. Which techniques is best? The answer depends on the number of variables of
interest and level of confidence needed regarding statements of relationships among the variables.
Lesson Proper
✓ Survey may be the best choice for gathering information across a wide range of many variables. Many
questions can be included in a survey. However, great care must be taken in the construction of the
survey instrument and in the administration of the survey. Nonresponse and other issues discussed
earlier can be introduce bias.
✓ Observational studies are the next most convenient technique for gathering information on many
variables. Protocols for taking measurements or recording observations need to be specified carefully.
✓ Experiments are the most stringent and restrictive data gathering technique. They can be time-
consuming, expensive, and difficult to administer. In experiments, the goal is often to study the effects
of changing only one variable at a time. Because of the requirements, the number of the variables
may be more limited. Experiments must be designed carefully to ensure that the resulting data are
relevant to the research questions.
Comment
An experiment is the best technique for reaching valid conclusions. By carefully controlling for other
variables, the effect of changing one variable in a treatment group and comparing it to a control group
yields results carrying high confidence.
The next most effective technique for obtaining results that have high confidence is the use of
observational studies. Care must be taken that the act of observation does not change the behavior being
measured or observed.
The least effective technique for drawing conclusions is the survey. Surveys have many pitfalls and by
their nature cannot give exceedingly precise results. A medical study utilizing a survey asking patients if
they feel better after taking a specific drug gives some information, but not precise information about
the drug’s effects. However, surveys are widely used to gauge attitudes, gather demographic information,
study social and political trends, and so on.