Foundation Concepts

Testing and Assessment

1
How often did you feel that examinations
were unfair during your time at school and
institution/university?

2
 Why did you consider a particular
examination as unfair?

• May be you studied the subject well, but the examination

focused on few topics only.
• May be you had the impression that another teacher would
have scored your essay differently.
• May be you had the feeling that the other group got an
easier examination.
• May be you saw the teacher helping some learners.
• May be you could not finish the examination in the given
time although you knew all answers.

3
 ITA Relationship

Industry

OP

VTIs DIT
Assessment
Training based on Test Items
ATP Bank

4
 What is Test?
• A test is a tool used for measuring training/educational
outcomes.
• A test is an event during which someone is asked to
demonstrate some aspect of his or her knowledge or skill.
• Test can consist of a single test item, but generally it
consists of several items.
• Tests are training/educational measuring instruments.

5
 What is test item?

• The basic unit of a test which calls a single response

or a set of responses to a single stimulus or stimulus
pattern.
• Test Item Types used by DIT:
―Multiple Choice Test Items (MCTI),
―Matching Test Items(MTI),
―Short Answer Test Items (SATI),
―Performance Test Items (PTI), etc.

6
7
 What is an assessment?

Assessment is a means by which evidence is gathered and

judged to decide if the individual has met the stipulated
standards or not.

8
 OCCUPATIONAL COMPETENCE BASED
ASSESSMENT(OCBA)

What is Occupational Competence Based

Assessment?

9
 OCCUPATIONAL COMPETENCE BASED
ASSESSMENT(OCBA)

 The process of collecting evidence and making

judgments by the assessor on whether the
desired competence has been achieved or not.
 This confirms that an individual can perform to
the standards and quality criteria expected in the
workplace.
 The judgment in OCBA is made in terms of
“Successful” or “Unsuccessful”/Competent or
Not Competent.
 The assessment is criterion based.
10
 Basic Principles
 The assessment is flexible,
 Individual assessment,
 Trainees are required to perform a task to a set standard,
 Standards used in assessment are based on industry standard,
 Trainees know in advance the assessment criteria,
 Recognizes skills formally, informally and non-formally acquired
 Assessment must be valid and reliable,
 Assessment is all inclusive (gender, age, SNEs),
 Feedback on assessment reported on spot,
 A trainee is fully involved right from the start to end of assessment
process and
 There is evidence of work performance.

11
 Why to Assess?

The main purpose of assessment is to discriminate who

can perform and who cannot or who knows and who does
not.

12
 Purpose of Occupational competence
based assessment
 Measure occupational competence of
individuals.
 Support occupational learning/training.

13
Framework relationship between CBET
and OCBA

14
Classification of Test

Norm Referenced Test(NRT)

Criterion Referenced Test(CRT)

15
 Norm Referenced Test (NRT)?

• Performance of each test taker compared with

performance of another.
• Judgment is made based on the comparison.
• NRT ranks the candidates, but does not really tell
how well somebody performs.

16
 Example of NRT

When we say person X is above average and that person Y

is below average, we are rank – ordering on the basis of
their performance in reference to each other, and therefore
we are making a norm-referenced evaluation.

17
 Example of NRT

“Within three minutes, be able to solve fifty addition

problems without the use of a calculator”
Suppose one (best) participant solves only 35 problems
within the time allowed.
NRT

This performance is the best among the other

participants. Give him/her grade “A”.

18
 Criterion Referenced Test (CRT)

• Performance measured against the pre-defined

criteria.
• CRT determines the test taker is able to do or not.
• Criterion being the work standards that is derived
from business and industry.

19
Uses of Criterion Reference Test (CRT)

• Compare performance of each individual with preset

criteria for acceptable achievement. This probably is
important for an employer.
• Most of the skills included in vocational training
requires mastery on the job which can be tested by
CRT not by NRT.

20
 Example of CRT

•“Within three minutes, be able to solve fifty addition

problems without the use of a calculator”
•Suppose one (best) participant solves only 35 problems
within the time allowed.
•CRT

This performance did not meet the criterion. S/he has

FAIL.

21
 CRT vs NRT?
Skill: Make a pot of coffee
SN Checklist NRT CRT
1. Disconnect coffee pot 10 √
2. Disassembles coffee pot 10 √
3. Clean components and pot 10 √
4. Inspects components 10 √
5. Fill pot with water 10 √
6. Reassemble components 10 √
7. Fills baskets with coffee 0 X
8. Reconnects coffee pot 10 √
9. Sets dial on coffee pot 10 √
10. Turns coffee pot on 10 √
RESULT 90% Not yet
Competent 22
 CRT or NRT?

• Olympic finals
• Driving tests
• Miss world competition
• Chess competition
• Test for recruitment
• Entrance test for education/training
• Instructor licensing

23
Key Features of a Test

24
 FEATURES OF A TEST

 Validity
 Reliability
 Objectivity
 Efficiency
 Transparency
 Differentiation
 Comprehensiveness

25
 Validity

Validity is the ability of a test item or a test to

measure accurately what it was designed to measure.

Learning Objective Tests

26
 Reliability

Reliability reflects the consistency of assessment

results. If we get similar results when the same
assessment procedure is used with the same test
taker on at least two different occasions, we can say
that it is reliable.

27
 OBJECTIVITY
 Be fair to the assessees/examinees.
 Avoid subjective judgements.
 Agreement on the right / best answer.

28
 EFFICIENCY
 Achieve desired results easily and in the
most efficient manner.
 Achieve desired results without wasting;
 resources
 effort
 time and
 money

29
 TRANSPARENCY
 Information, rules and practices
accessible and understandable by all
interested people
 Clear procedures for decision-making

30
 COMPREHENSIVENESS

 Cover all objectives and criteria

 Completeness over a broad scope

31
 DIFFERENTIATION

 Differentiate between successful and

unsuccessful candidates

32
Thank You

33