Module in Ed 107-Assessment in Learning Ii (Chapter 3)
Module in Ed 107-Assessment in Learning Ii (Chapter 3)
ED 107
ASSESSMENT IN LEARNING II
WITH FOCUS ON
TRAINERS METHODOLOGY I & II
CHAPTER 3
Competency Assessment Instruments
LESSON Institutional Competency Evaluation
1
Learning Outcomes:
Introduction
Evaluation is a very significant element of the teaching learning process. This is done
to verify the acquisition of knowledge, skills and attitude needed acquired from the
training.
As a trainer, it is a must that you know how to test or verify that assessment criteria
addressed during the training.
For the purpose of CBT, assessments are usually given for the following purpose:
1. To validate the current competencies of trainees
2. To measure how much trainees have learned in the training sessions given
3. To help diagnose trainee’s problems and guide future instruction
4. To decide whether trainees are competent or not
The competency evaluation tool should be carefully developed so that it will be able
to assess the four dimensions of competency such as:
1. Tasks skills
2. Task Management Skills
3. Job Role and Environment Management Skill
4. Contingency Management Skills
1. Reliability
This refers to consistency of scores by the same person when re-examined
with the same test on different occasion. Your test is reliable if your test is
consistent in testing what is trying to test.
2. Validity
This is the degree to which the test actually measures what it purports to
measure. It provides a direct check on how well the test fulfils its functions.
To ensure the validity of the evaluation tool, prepare an Evidence Plan based on CS
(Competency Standard). To increase the validity of the written test, you should
prepare a table of specification.
3. Objectivity
The test must be fair to all the examinee
4. Discrimination
It must pick up the good examinees from the poor
5. Ease of Administration and Scoring
The test must have the right length and level of sophistication to do the job.
References:
ACTIVITY SHEET
Lesson 1 (Chapter 3)
Institutional Competency Evaluation
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________
Learning Outcomes:
Introduction
One essential part of the Competency-Based Training Delivery is the institutional
assessment. Assessment is the process of collecting evidence and making judgments
on whether competency has been achieved. The purpose of assessment is to confirm
that an individual can perform to the standards expected in the workplace as
expressed in the relevant competency standards.
Questioning
be assessed
Portfolio
Ortfolio
Written
Report
Critical aspects of competency are the performance criteria that are listed in
the evidence guide of the Competency Standard (CS) as critical. These criteria
are required to be demonstrated by the trainee for him to evaluated as
competent. You should prepare an institutional competency assessment tool
that will show these evidences.
4.3 Inte rvie w/questioning- this is to verify evidences which are not clearly
demonstrated during performance test. This is also the part of the
competency evaluation where you can ask questions to verify Job Role and
Environment Management Skills and Contingency Management Skills.
Activity: L2 (Chapter 3)
1. Task: Make an Evidence Plan: Given the sample guide, make an evidence plan
of your chosen Qualification Title (Dressmaking NC II, Cookery NC II, etc.).
Search for the Training Regulation (TR) of the Qualification you choose.
This will serve as your guide in the formulation of your Evidence Plan.
Given the sample template make an Evidence Plan, see sample for your
guidance.
Competency Standard
Unit of Competency
Demonstration &
(tick the column)
Observation &
Third Party
Questioning
Questioning
Portfolio
Written
Report
Evidence must show that the trainee.....
*
*
*
*
References:
ACTIVITY SHEET
Lesson 2 (Chapter 3)
Evidence Pan
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________
LESSON
Table of Specification
3
Learning Outcomes:
Introduction
The evidence plan is a plan for the institutional evaluation tool. After preparing the
evidence plan, we are now ready to prepare for the development of the other parts of
the evaluation tool such as written test.
To ensure the validity of your test, you should prepare a table of specification so that
all contents to be tested have a representative question.
Table of Specification
A table that shows what will be tested (taught) is the table of specifications. For our
purpose of institutional evaluation, we shall be preparing a table of specifications for
our written test. This will help us plan how many items we need to cover all the
contents or objectives that we need to assess based on the evidence plan you
previously prepared.
A table of specifications is a two-way table that matches the objectives or content you
have taught with the level at which yo u expect students to perform. It contains an
estimate of the percentage of the test to be allocated to each level at which it is to be
measured. In effect we have established hoe much emphasis to give each objective or
topic.
3. Percentage/number of items
We also have to take into account the type of thinking skills we wish o assess.
Whether you use Blooms Taxonomy or another structure, the levels of learning can
help you identify the types of questions (or other type of assessment) that are
appropriate. For ease of use we have used only three levels: knowledge,
comprehension and application, and labeled the column accordingly. The important to
use levels of thinking that are relevant for your students and have been incorporated in
your instruction. At this stage it can be helpful to mark an “x” or make a check mark
in the cells to show the levels at which each objective will be measured, as shown in
the example below.
It may be that at this point you want to compare the test(s) provided by the textbook
publisher with your completed table of specifications. If they match and you think the
questions are well written, you may decide to use the test (or parts of the test)
provided with the text. On the other hand, you may find that it will be necessary for
you to create a test to provide an accurate assessment of what the students in your
class have learned.
One questions frequently asked is how many questions are needed to adequately
sample the content representing an objective or topic. Increasing the number of
questions increases the probability that we will have a good estimate of what the
learner knows and can do.
When translated the number of items per topic, the Table of Specification for 40-item
test may look like this:
For purposes of validating the current competencies of the trainees or for identifying
mastered contents, items placement maybe identified in the Table of Specification for
easier analysis. At this point you also have to decide how many questions needed to
measure learning, what type of questions will be asked and whether a written
assessment is sufficient to measure the competency. In most cases, for skills training,
performance evaluation with interview maybe more appropriate as an assessment
instrument but the effectiveness of written assessment maybe harnessed through the
ingenuity and skills of the trainer. If however, the trainer decides for a performance
evaluation, it should be reflected in the evidence plan.
Activity: L3 (Chapter 3)
References:
ACTIVITY SHEET
Lesson 3 (Chapter 3)
Table of Specification
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________
LESSON
Written Test
4
Learning Outcomes:
Introduction
Evaluation of competency should be assessing the knowledge, skills and attitude.
Written test is a method of assessment which can measure knowledge, skills and
attitude learned in training program but sometimes trainers fail to develop questions to
test the level of skills and attitude.
This lesson discusses some tips and guidelines in preparing the written test. The
written test that you will write after this lesson should follow the guidelines in
preparing a test item.
In developing test items always consider the five (5) characteristics of good-test-
validity, reliability, objectivity, discrimination and ease of administration and
scoring.
responses. They should also contain an example taken form the subject matter
being tested.
6. Study every aspect of the assembled test. After the test is assembled and
directions are written, it is a good policy to lay it aside for several days then
pick up again and review each part critically. Consider each item from the
point of view of the workers who will take the competency assessment. Try to
determine those items that are ambiguous. Check the grammar and be sure that
the words used will be understood by the workers who will take the
competency assessment.
The written test that we shall prepare as a part of the institutional assessment will
largely measure the acquisition of knowledge. Skills and attitude shall be measured
using performance test with questioning.
1. Keep in mind that it I not possible to measure all outcomes of instruction with
one type of test.
2. Devise your items so that they require the trainee to actually apply things
learned rather than merely recalling or recognizing facts.
3. Make certain that the type of test items used for measuring each objective is
the one that will measure the objective.
4. Avoid “tricky” or catchy questions. Do not construct puzzling items in which
hidden meaning or subtle clues provides the correct answer.
5. Do not lift statements directly from the books and use them as test items.
6. Check to make sure that no item can be answered simply by referring to the
other items. Make an item independent upon the answer of another.
7. Do not include the item for which the answer is obvious to a person who does
not know the subject matter.
8. Word the item in the simplest manner possible. Confine the items used to the
vocabulary level of the examinee. States questions clearly and eliminate
ambiguous items.
9. Arrange the items so that responses will not form a particular pattern.
Activity: L4 (Chapter 3)
References:
ACTIVITY SHEET
Lesson 4 (Chapter 3)
Written Test
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________
LESSON
Performance Test
5
Learning Outcomes:
Introduction
Evaluation of competency covers knowledge, skills and attitudes. To assess
knowledge, we can use written test as a method of assessment but to effectively assess
the skills and attitudes acquired by the trainee in CBT, we should use performance
evaluation which will include demonstration of the skills and an interview to follow-
up demonstration.
In this lesson, the format and structure of the prescribed per formance test shall be
discussed to help you develop your own instructions for demonstration.
Performance Evaluation
This is the practical portion of the competency assessment instrument. This part
measures the skills possessed by the examinee in relation to the occupation. It consists
of General and Specific Instruction, and the List of Materials, Equipment/Tools and
the Marking Sheets.
A. GENERAL INSTRUCTIONS
This refers to the overall conduct of the test (before, during and after) which
concerns both the testing officer and the examinee. This part of the competency
assessment specifies the does and don’ts inside the testing area.
B. SPECIFIC INSTRUCTIONS
This provides the instruction which the examinee must follow in the performance
of the test.
1. The test coverage must be consistent with the job description and skills
requirements.
2. The test must not take more than 8 hours to complete.
3. The test statement must specify the exact time within which the expected
examinee is expected to finish the task and the tools/equipment that will be
issued to the examinee.
4. The work performance/specimen or whatever is being tested must be
observable and measurable.
5. The test should be feasible. Do not design tests which makes use of rare or too
expensive equipment.
6. Where applicable there must be a working drawing which is clear and
accurate.
7. The standard performance outcome if possible, should be stated such as
surface finish, clearance or tolerance and number of allowable errors.
8. Directions must be clear, simple, concise and accurate.
Tools
Activity: L5 (Chapter 3)
References:
ACTIVITY SHEET
Lesson 5 (Chapter 3)
Performance Test
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________
LESSON
Questioning Tool
6
Learning Outcomes:
Introduction
Corroboration of evidences should be achieved when gathering evidences of
competency. In case evidences from the written test and the performance test results
are not enough to decide for the contemporary of a trainee, the questioning tool
should be used.
This lesson discusses the structure of the questioning tool so that it will help the
trainer gather evidences of knowledge, skills attitude and the four dimensions of
competency needed for the competency being assessed.
Questioning Tool
All possible questions should be written here. Although the trainer is not
required to ask questions that are already observed in the demonstration of
skills, you should write all possible questions so that these questions are ready
for use.
Questions that will verify the responsibility of the worker towards his
customers, co-employee, employer and the environment are very important
Infrequent events may arise from the job that would need the worker to adjust.
These are the contingency management skills questions that you need to
construct to very this dimensions of the competency.
Knowledge of laws, rules and regulations critical to the job should also be
verified. Prepare questions to gather evidences for the specific competency.
Safety Questions
Feedback to Candidate
General comments (Strengths/Improvements needed):
Activity: L6 (Chapter 3)
References:
ACTIVITY SHEET
Lesson 6 (Chapter 3)
Questioning Tool
Name: ___________________________________________ Date: _____________
Year & Section: ____________________________________