A Tool For Assessing The Quality of Nursing Handovers: A Validation Study
A Tool For Assessing The Quality of Nursing Handovers: A Validation Study
I
at handovers, such as incomplete or inaccurate information
n healthcare settings, handover is commonly referred to as available, few chances to ask questions, repeated interruptions
the practice of exchanging clinical information regarding (Riesenberg et al, 2009;Welsh et al, 2010; Calleja et al, 2011), and
patients, between two or more professionals, during a insufficient time (Meissner et al, 2007; O’Connell et al, 2008).
change of shift, at discharge or patient transfer. Handover This can lead to errors such as omissions, misunderstanding,
implies transferring responsibility for a patient, including and delays (Pothier et al, 2005; Sharit et al, 2008).
clinical aspects and legal accountability, to another person Meissner et al (2007) reported that 53% of Italian nurses are
(Cohen and Hilligoss, 2010). Considering that patient transfers unsatisfied with handover and that the lack of rooms dedicated
are frequent, these aspects become of primary importance in to handover in hospitals has a negative influence on quality of
information. In fact, if the handover process takes place in noisy
and crowded rooms, as often happens when no dedicated places
Paolo Ferrara, Nurse Tutor and Lecturer in Nursing, San are available, the risk of errors and misunderstandings is likely to
Paolo Bachelor School of Nursing, University of Milan, San increase.The literature suggests using a common methodological
Paolo Teaching Hospital, Milan, Italy, paolo.ferrara@asst-
framework for nursing handovers, such as the SBAR (situation,
santipaolocarlo.it
background, assessment, recommendations) to mitigate the such
Stefano Terzoni, Nurse Tutor and Lecturer in Nursing, San Paolo problems (Porteous et al, 2009; Yee et al, 2009; Bulfone et al,
Bachelor School of Nursing, University of Milan, San Paolo
2012; Toccafondi et al, 2012; Quattrin et al, 2014).
Teaching Hospital, Milan, Italy
Developing adequate communication skills will help improve
Salvatore Davì, Nurse, Milan handovers and decrease the risk of adverse events (Finke et
Alberto Bisesti, Head Nurse, Policlinico Teaching Hospital, Milan, al, 2008; Keller et al, 2013; Moore et al, 2013; Kourkouta and
© 2017 MA Healthcare Ltd
adequate policies of patient safety involving handovers. The The Handoff CEX
Handoff CEX scale, introduced by Horwitz et al (2013) seems The scale includes two different forms, one for the nurse
quick and easy to use. An Italian translation following a proper giving the handover (Table 1) and the other for the receiver
methodology is needed as handover needs in Italy may be (Table 2).The first form includes six items investigating context,
different from those of the scale’s country of origin. organisation, communication skills, content, clinical judgement,
and human qualities.The second includes the same items except
Aims ‘content’, which is only applicable to the provider. Each area
This study aimed to produce and validate an Italian version includes indicators aimed at producing objective assessment;
of the Handoff CEX scale in a sample of medical and surgical in addition, an open question allows further considerations to
hospital units. It also aimed to investigate the quality of nursing be raised. All items are based on a Likert scale ranging from 1
handovers during different shift changes. Finally, it investigated to 9. Scores from 1 to 3 are ‘unsatisfactory’, 4 to 6 ‘satisfactory’,
the relationship between the results of the Handoff CEX 7 to 9 ‘very satisfactory’.
and the different characteristics of the nurses and the setting. Both forms also include a question investigating overall
impressions, as well as a score defining the degree of agreement
Materials and methods of the nurse undergoing evaluation with the results of the
Forward and back translations assessment. Finally, the tool comprises a section to be completed
Authorisation to begin the translation was obtained from the by the head nurse, which investigates demographic characteristics
authors of the original Handoff CEX scale prior to starting of the sample and the organisation of the ward.
the study (Horwitz et al, 2013). After obtaining consent and During every shift change, four assessments are carried
confirmation that no Italian version existed or was in production, out: two by the head nurse (one for the provider, one for the
the translation process began. receiver), one by the provider towards the receiver for evaluating
Two nurses holding certificates in English performed the the reception process, and one by the receiver towards the
forward translation independently and then agreed upon the provider for assessing the process.
Italian text; a teacher of English language back-translated the An observational, single-centre study was conducted. The
scale into English.The final version was approved by the original authors enrolled the head nurses of 10 different wards (medical,
author.This process ensured adherence to the original meaning surgical, paediatric, and mental health) as external evaluators;
of all items. Involving two people in the translation process they were instructed by means of a 20-minute presentation
was necessary to avoid any potential bias related to subjective on the aims of the study and how to use the scale. The nurses
interpretation of the items, or to the possibility of translating the involved in the assessment process were informed by their
scale using different synonyms.The teacher who back-translated respective head nurses at the end of each handover, in order to
the scale had never seen it before; this ensured objectivity in avoid the Hawthorne effect (adapting one’s behaviour when
the preparation of the text sent to the original author. under observation) (McCambridge et al, 2014).
Data were collected from 1 to 31 July 2016. A minimum of
Face and content validity three evaluations were performed in all hospital units, separated
The Italian version was evaluated by nine nurses (three academic by at least 7 days, and enrolling different nurses each time.
tutors also performing clinical activity, three nurses from hospital In order to investigate potential differences regarding quality
wards, and three head nurses). Based on their assessment, the of the handover process during the three shift changes, assessment
authors calculated the content validity index, which is a measure was performed in all units at each handover (morning-afternoon,
of content validity commonly used in validation studies. The afternoon-night, and night-morning).
index has two components, called CVI-I (regarding each of Exploratory factor analysis was used to study the internal
the items) and CVI-S (regarding the whole scale). structure of the scale. It is a statistical technique used for
The CVI-I is determined by the calculation of the evaluations assessing the ‘weight’ (called ‘loading’) of each item in defining
by a group of expert-specific experts evaluating how relevant the overall variability of the results. Prior to factor analysis,
the individual items of an instrument can be, on a scale of 0 (not the Kaiser-Meyer-Olkin value was calculated, in order to
relevant) to 10 (very significant). The CVI-S is calculated by ascertain whether the mathematical properties of data make
averaging the percentage of items classified as ‘relevant’ (score 6 them suitable for factor analysis.To understand if the loading
to 7) or ‘very significant’ (scores 8 to 10) (Polit and Beck, 2006). of each item is sufficiently high to justify its presence in the
A questionnaire based on the indications from Beaton et al scale, a cut-off point was calculated according to the method
(2000) was then handed out to the nine nurses, to investigate proposed by Stevens (Sun Park et al, 2002).
clarity, repetitiveness, and the need for changes to the scale. Homogeneity was investigated by means of Cronbach’s
alpha coefficient. Homogeneity is an extension of the
Ethical considerations correlation concept: if the items of the scales are strongly
© 2017 MA Healthcare Ltd
The study was conducted upon authorisation from the hospital correlated with each other, they are likely to have the same
management.The authors complied with the rules of the local meaning for all users; this suggests that the measures obtained
ethical committee, the principles contained in the Declaration through the scale are consistent across similar situations,
of Helsinki, and the Italian law on data protection.All data were which is the definition of statistical reliability (Norman
collected anonymously. and Streiner, 2014).
The median handover length was 17.5 [15;20] minutes. Table 4 the others (median 8.0 [7.0;9.0], p=0.03). To understand why,
shows the characteristics of the handovers. the authors analysed the single items and compared them to the
other units. Setting and organisation were the only two items
Analysis of the handovers with significantly higher scores (p<0.001 for both analyses).
In order to analyse in detail the most critical aspects of the Handovers between night and morning shifts showed the
Table 2: Handoff CEX: assessment of the receiver and the receiving process (English version)
Setting (* not observed)
≥5 interruptions; noisy, chaotic 1 2 3 4 5 6 7 8 9 No interruptions; silent
Unsatisfactory Satisfactory Superior
Organization/efficienty (* not observed)
Disorganised; ill-prepared 1 2 3 4 5 6 7 8 9 Prepared for note-taking; takes
Unsatisfactory Satisfactory Superior notes
lowest scores (Table 7).The difference between the scores of the suggests that such results might be owing to the influence
three shift changes was statistically significant (Kruskal-Wallis of the relationships between peers within the nursing staff
test: p<0.001). (Bahreini et al, 2011, Horwitz et al, 2013). Furthermore, it
should be considered that head nurses often have greater clinical
Discussion experience than staff nurses, which allows them to easily assess
Improving the communication process in nurse handovers is a handover quality.
priority considering its impact on quality of care, risk reduction, In order to analyse the most critical aspects of the process it
and thus the safety of patients (Manser and Foster, 2011). was decided to assess the overall median scores in each domain.
The purpose of this study was to validate the Italian version The high scores observed in the areas of ‘content’, ‘clinical
of the Handoff CEX, which lays the foundation for a more judgement’ and ‘human qualities’, provides important and
structured way of analysing the quality of nursing handovers. reassuring information about training and professionalism of
The Italian version of the scale showed satisfactory internal the nurses, being scarcely affected by setting. In particular, they
consistency; excluding the items one by one, the Cronbach’s confirm the mastery of core theoretical knowledge (‘content’
alpha remained above 0.75, which suggests homogeneity and area and ‘clinical judgement’) and the fundamental prerequisites
therefore reliability of the instrument. for a helping profession (the ‘human qualities’ area).
Factor analysis also confirmed that the scale has a one- The lowest scores were found in the areas of ‘context’,
dimensional structure, i.e. no sub-scales: each of the items ‘organisation’ and ‘communication skills’.
contributes in an important way to properly describe the The complexity of the relationship that is established between
characteristics of the handover. Finally, considering the excellent health professionals, particularly nurses and patients, makes it
face and content validity, the Italian version of the Handoff CEX necessary to develop appropriate communication skills. Effective
can be considered valid and reliable for the evaluation of nursing communication is key to developing feelings of trust and mutual
© 2017 MA Healthcare Ltd
care delivery and therefore applicable to the Italian setting. respect and contributes to the improvement in adherence to
The overall scores regarding quality of handovers were therapies and care plans (Ku and Minas, 2010) and nursing
satisfactory but not excellent. However, the median scores outcomes (Charlton et al, 2008; Tay et al, 2011). Having good
provided by head nurses were slightly lower than those expressed communication skills cannot be considered exclusively as an
by nurses. This finding is consistent with the literature, which innate characteristic and individual predisposition. It must
This study has provided the Italian nursing community Table 7. Median scores at each shift change
with a tool that can help evaluate handovers; further work Shift change Median IQR
is needed to confirm how useful the Handoff CEX scale Morning–afternoon 7 6–7
is helping to build safer care environments. Future research
Afternoon–night 6 5–7
should take into account the assessment of health records in
Night–morning 5 5–6
use, the data entered and the quality of written notes required
for obtaining a comprehensive assessment of the handover Joint Commission International (2017) International Patient Safety Goals.
process. The systematic use of the Handoff CEX scale can http://tinyurl.com/yd8ulex9 (accessed 28 July 2017)
be recommended for assessing and improving handovers in Keller KB, Eggenberger TL, Belkowitz J, Sarsekeyeva M, Zito AR (2013)
Implementing successful interprofessional communication opportunities
healthcare organisations. BJN in health care education: a qualitative analysis. Int J Med Educ 4: 253–9.
https://doi.org/10.5116/ijme.5290.bca6
Kourkouta L, Papathanasiou IV (2014) Communication in nursing practice.
Declaration of interest: none Mater Sociomed 26(1): 65–7. https://doi.org/10.5455/msm.2014.26.65-67
Adib Hajbaghery M, Rezaei Shahsavarloo Z (2014) Assessing the nursing and Ku TK, Minas H (2010) Development of the Nursing Relationships Scale: a
midwifery students’ competencies in communication with patients with measure of interpersonal approaches in nursing care. Int J Ment Health Syst
severe communication problems. Nurs Midwifery Stud 3(2): e18143 4: 12. https://doi.org/10.1186/1752-4458-4-12
Bahreini M, Moattari M, Ahmadi F, Kaveh MH, Hayatdavoudy P, Mirzaei Manias E, Geddes F, Watson B, Jones D, Della P (2016) Perspectives of clinical
M (2011) Comparison of head nurses and practicing nurses in nurse handover processes: a multi-site survey across different health professionals.
competence assessment. Iran J Nurs Midwifery Res 16(3): 227–34 J Clin Nurs 25(1–2): 80–91. https://doi.org/10.1111/jocn.12986
Beaton DE, Bombardier C, Guillemin F, Ferraz MB (2000) Guidelines for the Manser T, Foster S (2011) Effective handover communication: an overview
process of cross-cultural adaptation of self-report measures. Spine 25(24): of research and improvement efforts. Best Pract Res Clin Anaesthesiol 25(2):
3186–91 181–91. https://doi.org/10.1016/j.bpa.2011.02.006
Bulfone G, Sumathy M, Grubissa S, Palese A (2012) Effective transfer of McCabe C (2004) Nurse-patient communication: an exploration of patients’
information and responsibilities with handover: a literature review. Assist experiences. J Clin Nurs 13(1): 41–9
Inferm Ric 31(2): 91–101. https://doi.org/10.1702/1131.12471. [Article in McCambridge J, Witton J, Elbourne DR (2014) Systematic review of the
Italian, abstract available in English] Hawthorne effect: new concepts are needed to study research participation
Calleja P, Aitken LM, Cooke ML (2011) Information transfer for multi-trauma effects. J Clin Epidemiol 67(3): 267–77. https://doi.org/10.1016/j.
patients on discharge from the emergency department: mixed-method jclinepi.2013.08.015
narrative review. J Adv Nurs 67(1): 4–18. https://doi.org/10.1111/j.1365- Meissner A, Hasselhorn H-M, Estryn-Behar M, Nézet O, Pokorski J, Gould D
2648.2010.05494.x (2007) Nurses’ perception of shift handovers in Europe: results from the
Charlton CR, Dearing KS, Berry JA, Johnson MJ (2008) Nurse practitioners’ European Nurses’ Early Exit Study. J Adv Nurs 57(5): 535–42. https://doi.
communication styles and their impact on patient outcomes: an integrated org/10.1111/j.1365-2648.2006.04144.x
literature review. J Am Acad Nurse Pract 20(7): 382–8. https://doi. Moore PM, Rivera Mercado S, Grez Artigues M, Lawrie TA (2013)
org/10.1111/j.1745-7599.2008.00336.x Communication skills training for healthcare professionals working with
Cohen M, Hilligoss P (2009) Handoffs in hospitals: a review of the literature people who have cancer. Cochrane Database Syst Rev 3: CD003751. https://
on information exchange while transferring patient responsibility or doi.org/10.1002/14651858.CD003751.pub3
control. School of Information, University of Michigan. http://tinyurl. Norman GR, Streiner DL (2014) Biostatistics:The Bare Essentials. 4th edn.
com/y949rwa4 (accessed 28 July 2017) People’s Medical Publishing House, Shelton
Cohen MD, Hilligoss PB (2010) The published literature on handoffs in O’Connell B, Macdonald K, Kelly C (2008) Nursing handover: it’s time for a
hospitals: deficiencies identified in an extensive review. Qual Saf Health change. Contemp Nurse 30(1): 2–11
Care 19(6): 493–7. https://doi.org/10.1136/qshc.2009.033480 Polit DF, Beck CT (2006) The content validity index: are you sure you know
Ellison D (2015) Communication skills. Nurs Clin North Am 50(1): 45–57. what’s being reported? Critique and recommendations. Res Nurs Health
https://doi.org/10.1016/j.cnur.2014.10.004 29(5): 489–97. https://doi.org/10.1002/nur.20147
Finke EH, Light J, Kitko L (2008) A systematic review of the effectiveness of Porteous JM, Stewart-Wynne EG, Connolly M, Crommelin PF (2009)
nurse communication with patients with complex communication needs iSoBAR: a concept and handover checklist: the National Clinical
with a focus on the use of augmentative and alternative communication. Handover Initiative. Med J Aust 190(11 Suppl): S152-156
J Clin Nurs 17(16): 2102–15. https://doi.org/10.1111/j.1365- Pothier D, Monteiro P, Mooktiar M, Shaw A (2005) Pilot study to show the
loss of important data in nursing handover. Br J Nurs 14(20): 1090–3.
© 2017 MA Healthcare Ltd
2702.2008.02373.x
Horwitz LI, Dombroski J, Murphy TE, Farnan JM, Johnson JK, Arora https://doi.org/10.12968/bjon.2005.14.20.20053
VM (2013) Validation of a handoff assessment tool: the Handoff CEX. Quattrin R, Calligaris L, Londero C, Zalateu E, Brusaferro S (2014) Shift-to-
J Clin Nurs 22(9–10): 1477–86. https://doi.org/10.1111/j.1365- shift handoff: a comparison between two methods of conveying essential
2702.2012.04131.x information in a University Hospital in North-eastern Italy. SCIEDU
The Joint Commission (2016) Sentinel event data: event type by year. http:// Journal of Hospital Administration 3(5): 40-5.
tinyurl.com/yaf68fkl (accessed 28 July 2017) Riesenberg LA, Leitzsch J, Little BW (2009) Systematic review of handoff
mnemonics literature. Am J Med Qual 24(3): 196–204. https://doi.
IV THERAPY
Quarterly supplement covering all aspects
of IV therapy in nursing from infusion
therapy to vascular access and patient care
The British Journal of Nursing (BJN) IV Therapy Supplement aims to promote evidence-
based practice and the provision of high quality patient care. We welcome unsolicited
articles including literature reviews, care studies and
original research in all areas of IV therapy. To contribute
© 2017 MA Healthcare Ltd