Psyc Assessment Notes
Psyc Assessment Notes
Tests – may refer to the material itself, the administration process or the interpretation of test-scores.
Psychological Testing – refers to measuring psychology related variables by means or procedures designed to obtain a
sample of behavior.
Psychological Assessment – Gathering and integration of psychology – related data for the purpose of making a
psychological evaluation using different tools.
Process of Assessment
TESTING vs ASSESSMENT
To gauge an ability or attribute (usually To answer a referral question, solve a problem or
numerical in nature) arrive at a decision through evaluation.
May be individual or group. Usually just adding Typically individualized since it focuses more on
up responses with little regard of the mechanics how an individual processes rather than simply
of such content the result of the process.
Tester is not the key to the process Assessor is the key to the process
Requires technician-like skills in terms of Requires educated selection of tools of
administering, scoring and interpreting test evaluation, skills in evaluating and organization
results. and integration of data.
Yields a test score or series of test scores Entails a logical problem-solving approach that
requires many sources of data to shed light on a
referral question.
The Role of a Psychometrician According to the Law (RA10029 or the Psychology Act of 2009)
- A natural person who has been registered and issued a valid certificate of registration and a valid professional
identification card as psychometrician by the board and commission in accordance with Sec.3 (d), Article III of R.A.
No.10029 and is authorized to do the ff:
*Administer and score objective personality tests excluding projective tests and higher level forms of psych tests
*Interpreting the results of these tests and prepare a written report on these results
*Conducting preparatory intake interviews of clients for psychological intervention
- All activities shall be supervised by the psychologist who shall take full responsibility for the integrity of the report.
LEVELS OF TESTS
WORLD WAR I
-This historic event spurred the development of the first group test on intelligence
-Led by the president of the American Psychological Association of that time, Robert Yerkes, they developed two
structured group tests of human abilities: the Army Alpha and the Army Beta (1917-1918)
-These were recognized as prototypes for subsequent group-administered cognitive ability tests
-Army Alpha- were taken by literate recruits. It measured verbal ability, numerical ability, ability to follow directions.
Syntonym-antonym tests, analogies and knowledge of information.
-Army Beta- is the non-verbal counterpart of Army Alpha and was taken by illiterate, unschooled, or non-English
speaking draftees and volunteers. It consisted of picture completion tasks, running a maze, number work, etc.
Test on adjustment
-A concern with the general adjustment of the recruits arose as well during the period of World War I.
-Robert S. Woodworth, the chair on the Gov’t Committer on Emotional Fitness, developed a measure on adjustment
and emotional stability
-This was known as the first developed structured personality: the Personal Data Sheet. Recruits were asked to answer
“yes” or “no” to a series of stimuli
-However, the PDS never went beyond the experimental stages of testing and thus, was never commercially used.
-Based on the PDS, a personality test for civilian use called the Woodworth Psychoneurotic Inventory was created. This
was considered as the first self-report test for personality that was widely used.
*Interviews (can either be structured or unstructured)- gathering of information through direct communication
involving reciprocal exchange.
*Portfolio- a collection of work products made by the individual
*Case history data- records, transcripts, or other accounts in written or pictorial form that preserve archival information
about the person being assessed
*Behavioral Observations- monitoring actions of others in either a controlled or natural environment
*Role play test- asking assess to act ‘as if’ they are in a particular situation. Directed and expressed thoughts, behaviors
and abilities are then recorded.
*Simulation- the realistic imitation of a real world process which may involve the use of computer programs and/or
modelled job equipment. In contrast to being directed, assesses are told to act as themselves during simulations.
Henry Goddard
*Oversaw the translation of the Binet-Simon test and distributed thousands of copies to professionals working in US
*He was the one who coined the term moron and used it as a classification of mental deficiency
*Controversial Ellis Island Intelligence Testing Program where most immigrants were labeled “feeble-minded”
Limits to Confidentiality- confidential information can also be disclosed without consent from the individual only as
mandated by law for the purpose of:
*Providing needed professional service
*Obtain appropriate professional consultations
*Protect the client, psychologist, or others from harm
*When there is suspected child abuse or elder adult physical abuse
*When the court compels the psychologist to testify what is discussed in therapy
*Obtain payment of services from client (in which instance disclosure is limited to a minimum that is necessary to
achieve the purpose; such as usage of collection agencies or legal methods to collect fee.
Right to the least stigmatizing label
-Test results should be able to facilitate positive growth and development by avoiding labels that degrade the humanity
of the client.
-Labels ( e.g moron, schizophrenic, bipolar, etc.) are not easily understood by the public and lead to discrimination.
-Labels also lead to self – fulfilling prophecies, decrease responsibility for illness, cause lower stress tolerance and
difficulty in treatment.
Raymond Cattell
-Created an objective personality test of 16 multidimensional personality attributes which was the 16PF.
-Able to derive “source” (16) and “surface traits” (32) of an individual
-The personality traits were derived using Factor Analysis and with the guiding theory of the Lexical Hypothesis. Catell
also examined LQ-T data because he believed these were major sources in personality research.
A glimpse of CTT
-A standard deviation of the distribution of errors for each person tells us about the magnitude of measurement error.
-A standard error of measurement describes the standard deviation of errors. It is the basic measure of error.
Standard error of measurement - allows us to estimate the degree to which a test provides inaccurate readings. The
larger SEM, the more the tool is unable to give the true value; the lower SEM, the better it is at giving the true value. It
tells us how much an observed score varies from the true score.
Correlation - the degree of correspondence between two things. A statistical tool used to look for relationships between
variables. Expresses relationship from -1 to +1
Projective Tests/Techniques
-is influenced by the projective hypothesis—when a person attempts to understand ambiguous stimuli, their
interpretation reflects needs, feelings, experience, conflicts, desires, thought processes, etc..
-also called unstructured/subjective tests
-subtypes are: Association, Construction, Completion, Arrangement/Selection, Expression
-Have questionable psychometric properties (longstanding issue in psychological assessment history)
Standard scores
-These are linearly transformed raw scores that express the position of scores relative to the mean, in standard
deviation units.
-Also used as a common ground in order to compare different test results with different means, SDs and score ranges as
long as the same reference group is used.
-Raw scores are converted into standard scores because you are able to derive more meaningful interpretations
Other example of standard scores:
> T-scores (Mean= 50, SD= 10)
> Deviation IQ (Mean= 100, SD= 15)
> Stanine (Mean= 5, SD= 2)
> Sten (Mean= 5.5, SD= 2)
> Scholastic Aptitude Tests (Mean= 500, SD= 100)
> Normal Curve Equivalents (Mean= 50, SD= 21.06)
Assumptions in Testing
1) Psychological Traits and States exist
2) Psychological Traits and States can be quantified and measured
3) Test-Related Behavior predicts non-test-related behavior
4) Tests and other measurement techniques have strengths and weaknesses
5) Various sources of Error are part of the Assessment Process
6) Testing and Assessment can be conducted in a fair and unbiased manner
7) Testing and Assessment benefit society
Intelligence Tests
-Components of an intelligence test depend on the test depend on the test developer (i.e. the theory he/she employs &
the definition of intelligence)
-May be individualized or group
-In general, intelligence tests are measures of a person’s general potential to solve problems, adapt to changing
circumstances, think abstractly, and profit from experience
Item Difficulty
-Refers to the proportion of people who correctly answered a certain item in a test
-The higher the item difficulty, the easier the item
-Example: If 50 out 100 test takers answered item 1 correctly then 50/100 or item difficulty is .5 (p1= .5)
Skewness- indication of how the measurements in a distribution is distributed. Having a skewed distribution has been
seen by many as a negative implication but that isn’t always the case.
Norm-referenced testing and assessment is the method of comparing a test taker’s score with scores of a group of test
takers
Criterion-referenced testing and assessment provides information about a person’s level of proficiency in or mastery of
some skill or set of skills relative to a set of criteria.
Psychometrics Properties
Validity (accuracy) – the test measures what it purports to measure. It refers to appropriateness of inferences drawn
from test scores
Reliability (dependability)- the test consistently gives out the same result with repeated administrations
Utility
-refers to a test’s usefulness
- refers to the practical value of using a test, program or intervention to aid in decision-making
-test scores are said to have utility if their use in a particular situation helps us to make better decisions—in the sense
of being more cost-effective
Content Validation Ratio (C.H. Lawshe) – essential, useful but not essential, not necessary
Criterion Contamination
-happens when a criterion measure has been based on predictor measures (test results are used as both a predictor
and a criterion)
-Example: making a test to predict inmate’s potential for violence by gathering data from guards, inmates and other staff
then asking guards to rate each inmate again on their violence potential to validate the accuracy of the test
Incremental Validity
-extent to which additional predictors explain something not already explained by predictors in use.
-Example: using multiple tests to capture the condition of depression in a client
-assumes that each person has a true score that would be obtained if there were no errors in measurements
-a tool becomes more reliable when there is a greater proportion of the total variance attributed to true variance rather
than error variance
-true differences are assumed to be stable whether it be repeated administrations or equivalent forms of tests
-random error (not systematic error) is the problem in this case—it increases or decreases the test score by varying
amounts.
Error Variance: Random vs. Systematic error
Systematic Error – error that arise due to the characteristic of the tool, measurement process, or the participants’
characteristic (e.g. false reporting)
-this biases the measurement of the studied construct either in the positive or negative direction.
-persists under the same condition, with the same instruments, when testing the same subjects ( does not affect score
consistency)
Random Error –errors that arise at the same time of testing because of pure chance.
-effects that are momentary such as moods, feelings, distractions in the environment. Fluctuation in psychological state
-affects score consistency.
Assumptions in CTT
X=T=E
-Expected value of obtained scores (x) over time is equal to true score (T)
-Expected value of error (T) whether it be within a person or across people in a population, is 0. Thus, correlation of true
score with error score is o.
-Error scores on two tests are uncorrelated
-Error scores on one test are uncorrelated with true score on another test
Beck Scales