Action (Verb) Fluency: Test-Retest Reliability, Normative Standards, and Construct Validity
Action (Verb) Fluency: Test-Retest Reliability, Normative Standards, and Construct Validity
Copyright © 2005 INS. Published by Cambridge University Press. Printed in the USA.
DOI: 10.10170S1355617705050460
(Received January 7, 2005; Revised February 18, 2005; Accepted February 22, 2005)
Abstract
Action (verb) fluency is a newly developed verbal fluency task that requires the examinee to rapidly generate as
many verbs (i.e., “things that people do”) as possible within 1 min. Existing literature indicates that action fluency
may be more sensitive to frontal–basal ganglia loop pathophysiology than traditional noun fluency tasks (e.g.,
animal fluency), which is consistent with the hypothesized neural dissociation between noun and verb retrieval. In
the current study, a series of analyses were undertaken to examine the psychometric properties of action fluency in a
sample of 174 younger healthy participants. The first set of analyses describes the development of demographically
adjusted normative data for action fluency. Next, a group of hypothesis-driven correlational analyses reveals
significant associations between action fluency and putative tests of executive functions, verbal working memory,
verbal fluency, and information processing speed, but not between action fluency and tests of learning or
constructional praxis. The final set of analyses demonstrates the test–retest stability of the action fluency test and
provides standards for determining statistically reliable changes in performance. In sum, this study enhances the
potential clinical applicability of action fluency by providing demographically adjusted normative data and
demonstrating evidence for its reliability and construct validity. (JINS, 2005, 11, 408–415.)
Keywords: Verbal fluency, Verbs, Test reliability, Test standardization, Test validity, Neuropsychological
assessment
ber of perseverations (i.e., the repetition or inflection of a Pearson product-moment correlation coefficients (or the
previously generated response, including the participant’s nonparametric Spearman’s rank order correlation coeffi-
self-generated example word) and intrusions (i.e., responses cient) were used to examine the associations between raw
that were not verbs). Verb responses that humans could not scores on action fluency and tests selected on an a priori
plausibly perform (e.g., photosynthesize) and questionable conceptual basis from the larger battery to explore conver-
noun–verb homonyms (e.g., bear) were queried by the exam- gent and divergent validity. For the longitudinal analyses,
iner and coded as intrusions if indicated. paired t tests and Pearson product-moment correlation coef-
The broader neuropsychological test battery was admin- ficients (or their nonparametric counterparts) were used to
istered and scored by research psychometrists in accor- examine the correspondence between the action fluency raw
dance with published, standardized procedures. The battery scores at Time 1 and Time 2. The standard deviations of the
included the following tests: (1) Hopkins Verbal Learning Time 1 and Time 2 difference scores were also generated,
Test–Revised (HVLT–R; Brandt & Benedict, 2001); (2) Brief which allowed for the calculation of reliable change indices
Visuospatial Memory Test–Revised (BVMT–R; Benedict, (RCIs) with 90%, 95%, and 99% confidence intervals (Che-
1997); (3) Controlled Oral Word Association Test (COWAT– lune et al., 1993). The critical alpha level was set at .05 for
FAS; Benton et al., 1994); (4) animal fluency (Benton et al., all analyses, except for the construct validity correlational
1994); (5) Stroop Color-Word Test (Golden, 1978); (6) Trail analyses for which an alpha of .01 was used to reduce the
Making Test, Parts A and B (Reitan & Wolfson, 1985); (7) risk of Type I error due to multiple comparisons.
Wisconsin Card Sorting Test– 64 Card Version (WCST–
64; Kongs et al., 2000); (8) Halstead Category Test (Reitan
& Wolfson, 1985); (9) Paced Auditory Serial Addition Test RESULTS
(PASAT–200; Diehr et al., 1998); (10) Grooved Pegboard
Test (Kløve, 1963); (11) Letter–Number Sequencing, Digit Normative standards
Symbol, and Symbol Search subtests from the Wechsler
The distributions of action fluency total correct, intrusions,
Adult Intelligence Scale–Third Edition (WAIS–III; The Psy-
and perseverations are presented in Figure 1.
chological Corporation, 1997); and (12) the Reading0Word
There was no correspondence between action fluency total
Decoding subtest from the Wide Range Assessment Test–
raw scores and age, sex, or ethnicity (all ps . .05); how-
Revision 3 (WRAT–3; Wilkinson, 1993).
ever, a significant linear relationship emerged between action
fluency and years of education (r 5 .28, p 5 .0002). Thus,
Data Analyses only years of education was entered as a predictor variable
The methodology used to derive the demographically in the fractional polynomial regression equation predicting
adjusted normative standards was adapted from Heaton action fluency total (the distributions of raw scores across
and colleagues (Heaton et al., 2004). First, one-sample three levels of education are presented in Table 2). Action
Kolmogrov-Smirnov tests were conducted to evaluate the fluency raw scores were converted to scaled scores. Table 3
normality of action fluency raw scores. If a normal distri- displays the appropriate conversions for transforming raw
bution was evident (or could be achieved through validated scores to scaled scores. The fractional polynomial regres-
methods of data transformation), raw scores were then con-
verted to scaled scores (M 5 10, SD 5 3) whereby higher
scores reflect better performance. The fractional poly-
nomial regression procedure (Royston & Altman, 1994) was
used to examine possible linear (and nonlinear) associa-
tions between each demographic variable and the action
fluency total raw score. Demographic variables demonstrat-
ing a statistically significant association with action flu-
ency total score were then entered as predictors into the
final fractional polynomial regression procedure (Royston
& Altman, 1994). This procedure uses an iterative algo-
rithm to determine which combination of demographic
predictors (both linear and nonlinear) yields the most advan-
tageous fit of the action fluency scaled score data. The resid-
uals from the fractional polynomial regression were then
used to generate predicted scaled scores from which the
demographically adjusted action fluency T-scores (M 5 50,
SD 5 10) may be derived: Fig. 1. Box and whisker plots displaying the distribution charac-
teristics of Action Fluency Total Correct, Intrusions, and Persev-
T 5 (((Observed Scaled Score 2 Predicted Scaled Score)0 erations. Note that, the dashed lines represent median values, the
circles denote means, and the whiskers indicate the 10th and 90th
Root Mean Square Error) 3 10) 1 50. percentiles.
Action (verb) fluency 411
Table 2. Distribution of raw action fluency total scores Table 4. Distribution of action fluency perseverations by sex
by years of education
Percentile Men (n 5 118) Women (n 5 56)
Education
ⱖ97.5 ⱖ4 ⱖ4
6–12 years 13–15 years 16–20 years 90 3 3
Percentile (n 5 57) (n 5 67) (n 5 50) 75 2 3
50 1.5 2
ⱖ97.5 ⱖ29 ⱖ29 ⱖ32
25 1 1
90 24 24 28
10 0 1
75 21 22 24
ⱕ2.5 0 0
50 16 18 21
25 13 14 16 Note. The formula for calculating T-scores for perseverations is: (((observed
10 10 12 14 perseverations 2 sex M )0sex SD) 3 210) 1 50. “Sex M” and “sex SD”
ⱕ2.5 ⱕ7 ⱕ9 ⱕ13 indicate that separate means and standard deviations should be used for
men (M 51.5; SD 51.2) and women (M 5 2.0; SD 51.0) when generating
Note. The total years of educational attainment variable was operational- T-scores for this variable.
ized using the criteria recommended by Heaton et al. (2004).
Construct Validity
sion procedure revealed education to be a significant pre-
dictor of action fluency total scaled scores @R 2 5 .08; To examine the convergent and divergent validity of action
F(1,173) 5 14.05, p 5 .0002]. The resultant formula for fluency, hypothesis-driven correlational analyses were con-
generating education correct T-scores for the action fluency ducted between action fluency (raw scores) and measures
total variable is displayed in Table 3. selected from the larger neuropsychological battery (see
Results revealed no correspondence between action flu- Table 5). Results revealed significant associations between
ency intrusions and perseverations and demographic fac- the action fluency total score and tests of verbal working
tors of age, education, or ethnicity (all ps . .10). A sex memory, executive functions, fine motor skills, information
effect was evident on perseverations such that men gener- processing speed, and verbal fluency (all ps , .01). In con-
ated significantly fewer perseverative responses than did trast, there was no correspondence between action fluency
women ( p , .01). However, the severely skewed distribu- and measures of praxis, learning, or recognition discrimi-
tion of perseverations ( p , .01) would not permit the use of nation (all ps . .05). Exploratory analyses revealed no sig-
multivariate fractional polynomial regression methods for nificant correlations between action fluency intrusions and
generating sex-corrected normative data. Therefore, descrip- perseverations and the other neuropsychological tests, with
tive statistics and methods for generating sex-corrected the exception of a small, negative association between intru-
T-scores for perseverations are displayed in Table 4. sions and BVMT-R Recognition Discrimination ( p 5 .007).
Action fluency
Test variable Total Intrusions Perseverations
Verbal fluency
Action Total — 20.23** 0.03
Action Intrusions — — 20.04
Action Perseverations — — —
COWAT–FAS a 0.53**** 20.01 0.07
Animal Fluency a 0.59**** 20.10 0.02
Learning and memory
HVLT–R Learning 0.07 20.03 0.03
HVLT–R Recognition Discrimination 0.03 20.11 0.13
BVMT–R Learning 20.01 0.05 20.11
BVMT–R Recognition Discrimination 0.12 20.21** 20.02
Constructional praxis
BVMT–R Copy Trial 0.06 20.11 20.04
Verbal working memory
PASAT–200 0.29*** 0.02 0.02
WAIS–III Letter–Number Sequencing 0.33**** 20.04 0.04
Psychomotor
Grooved Pegboard 20.15† 0.18† 0.13
WAIS–III Digit Symbol a 0.30*** 20.17† 0.06
Executive functions
TMT B–A 20.21** 0.12 20.05
Halstead Category Test 20.20** 0.14 20.01
WCST– 64 Perseverative Responses 20.20** 0.10 20.02
Stroop Incongruent Trial a 0.31**** 20.12 20.02
Note. COWAT–FAS 5 Controlled Oral Word Association Test (FAS version); HVLT–R 5 Hopkins
Verbal Learning Test–Revised; BVMT–R 5 Brief Visuospatial Memory Test–Revised; PASAT–200 5
Paced Auditory Serial Addition Test; WAIS–III 5 Wechsler Adult Intelligence Scale–Third Edition;
WCST– 64 5 Wisconsin Card Sorting Test– 64 Card Version; TMT 5 Trail Making Test.
a Pearson product-moment correlation coefficients.
graphic factors are known to influence cognitive test per- observed a positive association between action fluency total
formance, the use of normative standards is critical to ensure score and educational attainment, but not with age, sex, or
accurate interpretation of an individual’s test performance ethnicity. Similar relationships between verbal fluency and
relative to demographically similar others (Heaton et al., education have also been observed with measures of animal
2004). Consistent with the findings of Piatt et al. (2004), we and letter fluency (e.g., Gladsjo et al., 1999). In contrast, no
demographic variable was associated with intrusions or per-
severations, with the exception of a very modest (d 5 0.5)
Table 6. Demographic composition of the test–retest study sex difference in perseverative responses. Thus, it is recom-
sample (N 5 82) mended that standard scores for action fluency persever-
ations be generated separately for men and women (see
Variable M SD Range Table 4).
Test–retest interval (months) 10.5 2.5 4.1–15.5 Extending prior studies of convergent validity in older
Age (years) 43.5 11.0 22– 66 adults (Piatt et al., 1999a) and persons with HIV–1 infec-
Education (years) 13.9 2.5 8–20 tion (Woods et al., in press), we observed significant asso-
WRAT–3 reading score 104.6 9.7 81–120 ciations between action fluency total and putative tests of
Handedness (% right) 90% executive functions, verbal working memory, verbal flu-
Sex (% male) 68% ency, and information processing speed. These findings were
Ethnicity consistent with our a priori hypotheses and indicate that
White 67%
action fluency shares a generally modest proportion of the
Hispanic 17%
African American 11%
variance with tests measuring these related cognitive con-
Other 4% structs. Importantly, evidence of divergent validity was pro-
vided by the lack of significant correlations between action
Note. WRAT–3 5 Wide Rage Achievement Test–Revision 3. fluency and tests of cognitive functions more associated
Action (verb) fluency 413
Table 7. Test–retest reliability and reliable change indices for action fluency
Note. Diff 5 difference (Time 2 2 Time 1); CI5 confidence interval; SD 5 standard deviation of the mean difference.
*p , .05. **p , .0001.
a Represents the 68% confidence interval (6 practice effect).
b Data are presented as Spearman’s rank order correlation coefficients.
with the posterior neocortex (i.e., learning, recognition dis- pants had a broad range of demographic characteristics, the
crimination, and constructional praxis). It is unlikely that sample was largely Caucasian, young, and had attained an
these non-significant correlations reflect Type II error as average of 14 years of education. Study sample demo-
the current study was adequately powered to detect small- graphic characteristics are a particularly important consid-
to-medium effect sizes (power 5 .85 to detect r 5 .25 with eration when using regression-based normative standards,
N 5 174 and alpha 5 .01). Exploratory analyses, however, which can be misleading in the event that an individual’s
revealed no discernible pattern of correlations between action particular demographic characteristics are not represented
fluency intrusions and perseverations and the battery of in the normative sample (see Fastenau, 1998; Fastenau &
neuropsychological tests. Such null findings raise ques- Adams, 1996). While the incorporation of the nonlinear
tions regarding the convergent validity of these variables as fractional polynomial regression equations somewhat mit-
indicators of executive functions in healthy populations; in igates the risk of misclassification (Heaton et al., 2004),
other words, errors are so infrequently generated that they prudent use of these normative data require that a given
are not highly informative in nonclinical samples. Error client’s demographic characteristics are compatible with that
analyses on traditional verbal fluency tests have histori- of the standardization sample. To this end, the Piatt et al.
cally yielded fairly inconsistent results (e.g., Suhr & Jones, (2004) normative sample is recommended for use with older
1998; cf. Butters et al., 1986), which may reflect the inher- adults given that the current sample contained only 7 per-
ent difficulty in analyzing variables with low base rates sons age 60 years or older. Moreover, only 10% of the
(Woods et al., 2004). Whether action fluency errors possess present sample reporting having attained less than a high-
predictive or discriminative value in clinical samples remains school education, which indicates that caution regarding
to be determined by future research. possible false positive classification errors is warranted when
Action fluency demonstrated good one-year test-retest applying these normative data to clients with lower levels
reliability. There was no indication of a practice effect in of education. Finally, the normative sample was largely Cau-
action fluency performance at one-year follow-up. The sta- casian, which may have restricted our ability to detect eth-
bility coefficient and standard deviation of change scores nicity differences in action fluency performance if they truly
for action fluency total scores are generally consistent with exist.
published data using letter fluency (e.g., Basso et al., 1999). Although a convergence of research shows that the neu-
The relatively lower reliability of intrusions and presever- ral networks involved in generating nouns and verbs are
ations may be related to the restricted range of observed dissociable, these processes likely overlap to some degree.
scores (i.e., floor effects), which is particularly problematic For example, Tranel et al. (2001) found that left premotor0
in research with younger, healthy adults (Woods et al., 2005). prefrontal lesions were associated with impairments in both
The RCIs provided in Table 7 are intended to assist clini- action and object naming. Moreover, the conceptual knowl-
cians and researchers in more accurately classifying statis- edge of actions is related to frontal, as well as posterior
tically reliable changes in action fluency performance. neocortical areas, including left parietal and posterior mid-
Change scores that fall outside the selected RCI confidence dle temporal regions (Tranel et al., 2003). Cerebellar struc-
interval are considered to represent a statistically reliable tures have also been linked to verb processing (e.g., Sach
improvement or decline in performance. The use of RCIs et al., 2004), although the nature and extent of this link
may reduce the risk of classification errors that can result remains controversial (Richter et al., 2004). As a verb gen-
from attempting to estimate practice effects and normal test- eration task, it is likely that action fluency requires a dis-
retest variability to determine whether a meaningful change tributed neural network that includes the frontal lobes, as
in performance has occurred without the aid of empirical well as more posterior aspects of the neocortex [e.g., pos-
standards. Studies are nevertheless needed to evaluate the terior middle temporal (MT) region] and adjoining white
predictive validity of these RCI data in detecting signifi- matter pathways (Tranel et al., 2003). Accordingly, inter-
cant changes in various clinical samples (i.e., sensitivity). pretation of action fluency as a pure measure of frontal lobe
It is important to highlight the limitations to the external functions is imprudent, despite promising evidence of its
validity of the current study. Although the study partici- divergent validity.
414 S.P. Woods et al.
Future studies may consider examining multiple trials of M.D. (P.I.), Dianne Langford, Ph.D.; Clinical Trials Component:
action fluency that incorporate unique rule-guided search J. Allen McCutchan, M.D., J. Hampton Atkinson, M.D., Ronald J.
strategies. For example, restrictions might be placed on the Ellis, M.D., Ph.D., Scott Letendre, M.D.; Data Management Unit:
generation of inflected verbs (e.g., Sach et al., 2004), noun– Daniel R. Masys, M.D. (P.I.), Michelle Frybarger, B.A. (Data
verb homonyms (e.g., Tranel et al., 2005), or other concep- Systems Manager); Statistics Unit: Ian Abramson, Ph.D. (P.I.),
and Deborah Lazzaretto, M.S.
tual factors, such as actions that require tools or that can
This study was supported by the following grants from the
only be performed by using one’s hands (e.g., Kemmerer & National Institutes of Health: MH62512, DA12065, and MH59745.
Tranel, 2000). Extending the verb generation literature (e.g., The views expressed in this article are those of the authors and do
Buckner et al., 1995) to action fluency, another interesting not reflect the official policy or position of the Department of the
possibility would be to place systematic restrictions on the Navy, Department of Defense, nor the United States Government.
semantic relatedness of dyadic noun–verb switching trials. The authors thank Daniel Tranel, Ph.D., Michael Weinborn, Ph.D.,
The incorporation of additional trials might allow the test and an anonymous reviewer for their helpful comments. We also
user to better delineate the specific nature of the action thank Deborah Lazzaretto and Jennifer Marquie-Beck for their
fluency deficit, as well as perhaps enhance the (already assistance with statistical analyses and figure preparation, respec-
strong) reliability of action fluency. tively. Portions of these data were presented at the 33rd Annual
In sum, findings from this study support the potential Meeting of the International Neuropsychological Society in St.
Louis, MO, USA.
clinical application of action fluency by providing demo-
graphically adjusted normative data in younger adults, actu-
arial standards for reliable change, and evidence of construct REFERENCES
validity. The development and validation of novel mea- Alexander, M.P. & Stuss, D.T. (2000). Disorders of frontal lobe
sures of executive functioning such as action fluency are functioning. Seminars in Neurology, 20, 427– 437.
worthwhile endeavors because traditional neuropsycholog- Basso, M.R., Bornstein, R.A., & Lang, J.M. (1999). Practice effects
ical tests of this domain often lack specificity (Alexander & on commonly used measures of executive function across twelve
Stuss, 2000). To this end, action fluency may provide a months. Clinical Neuropsychologist, 13, 283–292.
measure of frontal systems function with superior sensitiv- Benedict, R.H.B. (1997). Brief Visuospatial Memory Test–Revised.
ity and specificity relative to the traditional letter and ani- Odessa, FL: Psychological Assessment Resources, Inc.
mal fluency tasks (Piatt et al., 1999a, 1999b; Woods et al., Benton, A.L., Hamsher, K., & Sivan, A.B. (1994). Multilingual
in press), which place greater demands on posterior neocor- Aphasia Examination. Iowa City, IA: AJA Associates.
Brandt, J. & Benedict, R.H.B. (2001). Hopkins Verbal Learning
tical functions (e.g., Pihlajamaki et al., 2000). Accordingly,
Test–Revised. Professional manual. Lutz, FL: Psychological
action fluency might be a useful tool to complement the Assessment Resources, Inc.
existing armamentarium of clinical and research neuropsy- Buckner, R.L., Raichle, M.E., & Petersen, S.E. (1995). Dissocia-
chologists. Cautious interpretation of action fluency is nev- tion of human prefrontal cortical areas across different speech
ertheless recommended, as neuroimaging research indicates production tasks and gender groups. Journal of Neurophysiol-
that although verb generation reliably activates frontal sys- ogy, 74, 2163–2173.
tems, it also requires the contribution of the posterior neo- Butters, N., Wolfe, J., Granholm, E., & Martone, M. (1986). An
cortex (albeit perhaps to a lesser extent than noun generation; assessment of verbal recall, recognition, and fluency abilities
e.g., Perani et al., 1999). The action fluency test will require in patients with Huntington’s disease. Cortex, 22, 11–32.
further validation using neuroimaging technologies, as well Cappa, S.F., Sandrini, M., Rossini, P.M., Sosta, K., & Miniussi, C.
as in clinical studies of populations with quantified frontal (2002). The role of the left frontal lobe in action naming: rTMS
evidence. Neurology, 59, 720–723.
and posterior neocortical lesions, temporolimbic pathology
Chelune, G.J., Naugle, R.I., Lüders, H., Sedlack, J., & Awad, I.A.
(e.g., temporal lobe epilepsy), and various neurodegenera- (1993). Individual change after epilepsy surgery: Practice effects
tive disorders (e.g., Alzheimer’s disease and frontotempo- and base-rate information. Neuropsychology, 7, 41–52.
ral dementia). Damasio, A.R. & Tranel, D. (1993). Nouns and verbs are retrieved
with differently distributed neural systems. Proceedings of the
ACKNOWLEDGMENTS National Academy of Sciences of the United States of America,
90, 4957– 4960.
The San Diego HNRC group is affiliated with UCSD, the Naval Diehr, M.C., Heaton, R.K., Miller, W., & Grant, I. (1998). The
Hospital, San Diego, and the San Diego Veterans Affairs Health- Paced Auditory Serial Addition Task (PASAT): Norms for age,
care System, and includes: Director: Igor Grant, M.D.; Co- education, and ethnicity. Assessment, 5, 375–387.
Directors: J. Hampton Atkinson, M.D., J. Allen McCutchan, M.D.; Fastenau, P.S. & Adams, K.M. (1996). Heaton, Grant, and
Center Manager: Thomas D. Marcotte, Ph.D.; Naval Hospital San Matthews’ comprehensive norms: An overzealous attempt.
Diego: Mark R. Wallace, M.D. (P.I.); Neuromedical Core: J. Allen Journal of Clinical and Experimental Neuropsychology, 18,
McCutchan, M.D. (P.I.), Ronald J. Ellis, M.D., Ph.D., Scott 444– 448.
Letendre, M.D., Rachel Schrier, Ph.D.; Neurobehavioral Core: Rob- Fastenau, P.S. (1998). Validity of regression-based norms: An empir-
ert K. Heaton, Ph.D. (P.I.), Mariana Cherner, Ph.D., Joseph Sadek, ical test of the comprehensive norms with older adults. Journal
Ph.D., Steven Paul Woods, Psy.D., Corinna Young, Ph.D.; Imag- of Clinical and Experimental Neuropsychology, 20, 906–916.
ing Core: Terry Jernigan, Ph.D. (P.I.), John Hesselink, M.D., Gladsjo, J.A., Schuman, C.C., Evans, J.D., Peavy, G.M., Miller,
Michael J. Taylor, Ph.D.; Neuropathology Core: Eliezer Masliah, S.W., & Heaton, R.K. (1999). Norms for letter and category
Action (verb) fluency 415
fluency: Demographic corrections for age, education, and eth- E., Beck, A., Aurich, V., Ziegler, W., & Timmann, D. (2004).
nicity. Assessment, 6, 147–178. Preserved verb generation in patients with cerebellar atrophy.
Golden, C.J. (1978). Stroop Color and Word Test. Chicago: Neuropsychologia, 42, 1235–1246.
Stoelting. Royston, P. & Altman, D.G. (1994). Regression using fractional
Heaton, R.K., Miller, S.W., Taylor, M.J., & Grant, I. (2004). Revised polynomials of continuous covariates: Parsimonious paramet-
Comprehensive norms for an expanded Halstead-Reitan Bat- ric modeling. Applied Statistics, 43, 429– 467.
tery: Demographically adjusted neuropsychological norms for Sach, M., Seitz, R.J., & Indefrey, P. (2004). Unified inflectional
African American and Caucasian adults. Lutz, FL: Psycholog- processing of regular and irregular verbs: A PET study. Neuro-
ical Assessment Resources, Inc. report, 15, 533–537.
Kemmerer, D. & Tranel, D. (2000). Verb retrieval in brain- Suhr, J.A. & Jones, R.D. (1998). Letter and semantic fluency in
damaged subjects: 1. Analysis of stimulus, lexical, and concep- Alzheimer’s, Huntington’s, and Parkinson’s dementias. Archives
tual factors. Brain and Language, 73, 347–392. of Clinical Neuropsychology, 13, 447– 454.
Kløve, H. (1963). Clinical neuropsychology. In F.M. Forster (Ed.), Tranel, D., Adolphs, R., Damasio, H., & Damasio, A.R. (2001). A
The medical clinics of North America. New York: Saunders. neural basis for the retrieval of words for actions. Cognitive
Kongs, S.K., Thompson, L.L., Iverson, G.L., & Heaton, R.K. Neuropsychology, 18, 655– 670.
(2000).Wisconsin Card Sorting Test–64 card computerized ver- Tranel, D., Kemmerer, D., Adolphs, R., Damasio, H., & Damasio,
sion. Odessa, FL: Psychological Assessment Resources. A.R. (2003). Neural correlates of conceptual knowledge for
Perani, D., Cappa., S.F., Schnur, T., Tettamanti, M., Collina., S., actions. Cognitive Neuropsychology, 20, 409– 432.
Rosa., M.M., & Fazio, F. (1999). The neural correlates of verb Tranel, D., Martin, C., Damasio, H., Grabowski, T., & Hichwa, R.
and noun processing: A PET study. Brain, 122, 2337–2344. (2005). Effects of noun–verb homonymy on the neural corre-
Piatt, A.L., Fields, J.A., Paolo, A.M., & Tröster A.I. (1999a). Action lates of naming concrete entities and actions. Brain and Lan-
(verb naming) fluency as an executive function measure: Con- guage, 92, 288–299.
vergent and divergent evidence of validity. Neuropsychologia, Warburton, E., Wise, R.J., Price, C.J., Weiller, C., Hadar, U., Ram-
37, 1499–1503. say, S., & Frackowiak, R.S. (1996). Noun and verb retrieval by
Piatt, A.L., Fields, J.A., Paolo, A.M., Koller, W.C., & Tröster, A.I. normal subjects. Studies with PET. Brain, 119, 159–179.
(1999b). Lexical, semantic, and action verbal fluency in Williamson, D.J.G., Adair, J.C., Raymer, A.M., & Heilman, K.M.
Parkinson’s disease with and without dementia. Journal of Clin- (1998). Object and action naming in Alzheimer’s disease. Cor-
ical and Experimental Neuropsychology, 21, 435– 443. tex, 34, 601– 610.
Piatt, A.L., Fields, J.A., Paolo, A.M., & Tröster A.I. (2004). Action Wilkinson, G.S. (1993). Wide Range Achievement Test adminis-
verbal fluency normative data for the elderly. Brain and Lan- tration manual (3rd ed.). Wilmington, DE: Wide Range, Inc.
guage, 89, 580–583. Woods, S.P., Carey, C.L., Tröster, A.I., Grant, I., & The HNRC
Pihlajamaki, M., Tanila, H., Hanninen, T., Kononen, M., Laakso, Group (2005). Action (verb) generation in HIV–1 infection.
M., Partanen, K., Soininen, H., & Aronen, H.J. (2000). Verbal Neuropsychologia, 43, 1144–1151.
fluency activates the left medial temporal lobe: A functional Woods, S.P., Conover, E., Rippeth, J.D., Carey, C., Gonzalez, R.,
magnetic resonance imaging study. Annals of Neurology, 47, Marcotte, T.D., Heaton, R.K., Grant, I., & The HNRC Group
470– 476. (2004). Qualitative aspects of verbal fluency performance in
Psychological Corporation. (1997). Wechsler Adult Intelligence HIV-associated dementia: A deficit in rule-guided lexical–
Scale–Third edition. San Antonio, TX: Author. semantic search processes? Neuropsychologia, 42, 801–809.
Reitan, R.M. & Wolfson, D. (1985). The Halstead-Reitan Neuro- Woods, S.P., Scott, J.C., Conover, E., Grant, I., Heaton, R.K., &
psychological Test Battery: Theory and clinical interpretation. The HNRC Group. (2005). Test–retest reliability of compo-
Tucson, AZ: Neuropsychology Press. nent process variables within the Hopkins Verbal Learning Test–
Richter, S., Kaiser, O., Hein-Kropp, C., Dimitrova, A., Gizewski, Revised. Assessment, 12, 96–100.