Test Development
Test Development
Test Tryout
Item Analysis Revision
Test Conceptualization
An emerging social phenomenon or pattern of behavior might serve as the stimulus for the development of a new test The development of a new test maybe in response to a need to assess mastery in an emerging occupation or profession
Pilot Work
Preliminary research surrounding the creation of a prototype of the test Test developer attempts to determine how best to measure a targeted construct The process may entail the creation, revision and deletion of many test items, experimentations and related activities
Test Construction
Scaling : It may be defined as the process of setting rules for assigning numbers to measurement Test taker is presumed to have more or less of the characteristic measured by a test as a function of the test score
Summative Scale: Final test score obtained by summing the ratings across all the items Likert scale: Used to scale attitudes
Each item has five alternative responses Usually on an agree/disagree or approve/disapprove type of continuum
Method of Paired Comparisons: Test takers presented with pairs of stimuli which they are asked to compare Comparative Scaling: Entails judgments of a stimulus in comparison with every other stimulus on the scale Categorical Scaling: Stimuli are placed into one of two or more alternative categories that differ quantitatively with respect to some continuum
Writing Items
What range of contents should the items cover? Which of the many different types of item formats should be employed? How many items should be written?
Item pool: It is the reservoir or well from which items will be drawn or discarded for the final version of the test Item Format: Variables such as the form, plan, structure, arrangement and layout of individual test items are collectively referred to as item format. There are two types of item format:
Selected - response format Constructed - response format
Matching : Two options are provided; premises on the left and responses on the right
Binary choice item : true-false, yes-no, agree-disagree, rightwrong, fact-opinion
Essay
Item Analysis
Tools used by test developers to analyze and select items are:
An index of items difficulty An index of items reliability An index of items validity An index of item discrimination
Sensitivity Review
Study of test items typically conducted during the test development process in which items are examined for fairness to all prospective test takers and for the presence of offensive language, stereotypes, or situations.
Test Revision
Test Revision as a stage in New Test Development Test Revision in the Life Cycle of an Existing Test