D12 Pub
D12 Pub
net/publication/320552133
CITATIONS READS
23 13,884
8 authors, including:
All content following this page was uploaded by Rosario Caruso on 16 January 2018.
Original article
Summary. Background: Dyspnoea-12 is a valid and reliable scale to assess dyspneic symptom, considering its
severity, physical and emotional components. However, it is not available in Italian version due to it was not
yet translated and validated. For this reason, the aim of this study was to develop an Italian version Dysp-
noea-12, providing a cultural and linguistic validation, supported by the quantitative and qualitative content
validity. Methods: This was a methodological study, divided into two phases: phase one is related to the cultural
and linguistic validation, phase two is related to test the quantitative and qualitative content validity. Linguis-
tic validation followed a standardized translation process. Quantitative content validity was assessed comput-
ing content validity ratio (CVR) and index (I-CVIs and S-CVI) from expert panellists response. Qualitative
content validity was assessed by the narrative analysis on the answers of three open-ended questions to the
expert panellists, aimed to investigate the clarity and the pertinence of the Italian items. Results: The transla-
tion process found a good agreement in considering clear the items in both the six involved bilingual expert
translators and among the ten voluntary involved patients. CVR, I-CVIs and S-CVI were satisfactory for all
the translated items. Conclusions: This study has represented a pivotal step to use Dyspnoea-12 amongst Ital-
ian patients. Future researches are needed to deeply investigate the Italian version of Dyspnoea-12 construct
validity and its reliability, and to describe how dyspnoea components (i.e. physical and emotional) impact the
life of patients with cardiorespiratory diseases. (www.actabiomedica.it)
(i.e. face validity) aimed to explore patients under- faele (Italy) (Protocol n.112/INT/2016). The research
standing of the items and their views about the overall methodology was in full accordance with international
concept that they purport to measure (22). ethical principles, Italian legal and research ethics re-
The quantitative content validity was assessed us- quirements for non-interventional studies. All the par-
ing the viewpoints of a panel of experts, consisting in ticipants (i.e. patients, nurses, physicians, translators)
20 raters (i.e. 12 physicians, eight nurses). Their evalu- were informed about the aims and the method of the
ation was firstly based on a three-point Likert scale study, and they were asked to provide written informed
(1= not necessary; 2=useful but not essential; 3=essen- consent, as required in the Italian Legislative Decree
tial) to computed the content validity ratio (CVR). Its n. 196 of 30th June 2003. Participants of each phase
formula is CVR=(Ne - N/2)/(N/2), in which the Ne is were also informed about the confidentiality of their
the number of raters indicating “essential” and N is the responses and anonymity in data elaboration for the
total number of raters (21). CVR could varies between final report of the study.
+1 and -1. Higher score indicates further agreement
among raters on the necessity to keep the evaluated
item in the scale. Secondly, the panel of experts was Results
asked to rate translated Dysponea-12 items in terms of
its relevancy to the construct underlying the scale using Phase one: cultural and linguistic validation
a four-point ordinal scale (1=not relevant; 2=somewhat
relevant; 3=quite relevant; 4=highly relevant). CVI was The consensus discussion lasted approximately 90
calculated both for the items level (I-CVIs) and for the minutes. The characteristics of participants included in
scale-level (S-CVI). To obtain the relevancy of each the consensus discussion are shown in Table 1. Partici-
item (I-CVIs), the number of those judging the item pants were mainly male (n=5; 83,3%) and median age
as relevant (i.e. ratings ≥3) was divided by the number was 44,8 years (IQR=9,1). According to the combined
of content experts. Thus, I-CVIs were computed as the translation technique (19), participants discussed the
number of experts giving a rating 3 or 4 to the relevancy two prior translations and back-translations, trying to
of each item, divided by the total number of experts, and ensure the equivalence of the concepts. Finally, par-
expressing the proportion of agreement on the relevancy ticipants rated each translated item to assess consensus
of each item, where the index could range between zero in the items’ wording choice. All ratings were higher
and one (23). Furthermore, S-CVI was defined as the than four on a five-point Likert scale (1=completely
proportion of total items judged content validity (23), not agree; 5=completely agree). As shown in Table 2,
and it was computed as the average of the I-CVIs. the Fleiss’ K was 0,95 and it was computed consider-
To obtain the qualitative content validity, the ing two categories (i.e. 4 and 5 rates), 12 cases (i.e.
authors asked to the same panel of expert (n=20) to items) and six raters.
answer to three open-ended questions, transcribed Back-translation by an independent native Eng-
Verbatim. The questions were aimed to explore the lish speaker did not show any significant differences
difficulty level of the items’ wording, desired relation- with the original scale; thus the original scale develop-
ship between items and the main objective of Dysp- er endorsed the translated items. Pilot testing provided
noea-12, eventually to discuss about ambiguity and further information about the clarity of the wording of
misinterpretations of items. All the answers were ana- individual items (see table 1 for participant character-
lysed using a narrative analysis (20) to summarize the istics). The ratings indicated high agreement between
main emerging themes. the English and Italian meaning for each item (Fleiss’
K=0,81). Moreover, participants commented on the
Ethical considerations ‘simplicity’ in understanding the meaning of each item.
The translated items of Phase 1 are show in Table 4
This study obtained the approval from the Re- (i.e. items in italics).
search & Ethical Committee of Ospedale San Raf-
Phase two: quantitative and qualitative content validity dyspnoea in our patients, identifying both the physical and
emotional aspects, besides its severity”. Another example
Twenty patients participated in phase two (see ta- of comment that has shaped the theme ‘outrifhtness’
ble 3 for characteristics). The first quantitative content was (expert OG): “[...] It’s brilliant, items are immedi-
validity was assessed by CVR calculation and indicted ately understandable and direct”.
that all the items were considered relevant (all CVRs
higher than 0,70) and appropriate (see table 5).
The narrative analysis on the experts’ answers Discussion
to the three open-ended questions shows two main
themes: ‘usefulness’ and ‘outrightness’. For example, a The aim of this study was to develop and assess
comment (expert SC) that has shaped the theme ‘use- content validity of the Italian version of Dyspnoea-12.
fulness’ was: “[…] we need a scale like the one you are Thus, the methodology of this study was designed
validating, due to it could be very useful to rapidly assess to ensure the best cultural and linguistic translation,
Table 3. Participants characteristics (Phase 2) The core of the standardized translation process
N % (19) was the consensus discussion, where the experts
forward-translated the previous two back-translated
Gender Male 11 55
Female 9 45 versions, discussing about the best cultural equivalence
of the Italian translation. This methodology was in line
Profession Physician 12 60
Nurse 8 40 with a previous Arabic translation of Dyspnoea-12
(11), and as even in Italian translation there were no
Marital status Married 17 85
Unmarried 3 15 items or terms problematic to translate. This could
be explained because Dyspnoea-12 items are easy to
Median IQR
understand with clear concept elaboration and defini-
Age 41,6 6,3 tions shared between the author of the original ver-
sion and the project manager of the target language.
maintaining the original concept equivalence (19). Moreover, the pilot testing confirmed the clarity of the
Indeed, the assessment of quantitative and qualitative translation.
Italian version content validity supported the trans- Considering CVR evaluation, item 8 was the only
lated version, providing a solid basis for future imple- item with a borderline value (i.e. 0,70), but considered
mentations in clinical and research settings. to be relevant by from the panellists perspective. Fur-
thermore, all items were high rated by the panellists content validity (24); which showed a good response
for their pertinence evaluation (I-CVI and S-CVI). from the panellists.
These results provide solid support to the Italian The main limitation of the adopted methodology
translated Dyspnoea-12. As with every cross-cultural is previously described in relation to the possible diffi-
and international collaborative studies, Dyspnoea-12 culty to reach agreement during the consensus discus-
translation also required assessment for its qualitative sion (25). However, we did not experience such dif-
ficulty since our consensus discussion reached a very or inpatients settings), and for researches purposes.
good agreement level (Fleiss’ K=0,95). The main limi- Healthcare professionals should objectively assess
tation is related to the nature of bilingual technique their patients’ symptoms to implement tailored clinical
translation. It could be related to the possibility that pathways (26). Hence, future researches are needed to
bilingual people are acculturated to their host culture, deeply investigate the Italian version of Dyspnoea-12
so they could report different response from monolin- construct validity and its reliability, and to describe
gual people during consensus discussion (25). how dyspnoea components (i.e. physical and emotion-
Future investigations could are needed to pro- al) impact the life of patients with cardiorespiratory
vide evidence of the Italian version of Dyspnoea-12, diseases.
psychometric properties. Following that work, the
validate Dyspnoea-12 Italian version may be used to
investigate the relationships between dyspnoea and References
QoL, and other important psychosocial outcomes in
1. Tan J-Y, Yorke J, Harle A, Smith J, Blackhall F, Pilling M,
patients with cardiorespiratory diseases, such as anxi- et al. Assessment of Breathlessness in Lung Cancer: Psycho-
ety, depression and fatigue. It could be very useful es- metric Properties of the Dyspnea-12 Questionnaire. J Pain
pecially when the direct measurement of dyspnoea is Symptom Manage 2017; 53(2): 208-15.
difficult, such the context of palliative care (e.g. pa- 2. Yorke J, Moosavi SH, Shuldham C, Jones PW. Quantifica-
tion of dyspnoea using descriptors: development and initial
tients with walking difficulties). testing of the Dyspnoea-12. Thorax 2010; 65(1): 21-6.
3. Yorke J, Armstrong I. The assessment of breathlessness in
pulmonary arterial hypertension: Reliability and validity of
Conclusion the Dyspnoea-12. Eur J Cardiovasc Nurs 2014 Dec; 13(6):
506-14.
4. Neuman A, Gunnbjörnsdottir M, Tunsäter A, Nyström L,
This study has represented a pivotal step to use Franklin KA, Norrman E, et al. Dyspnea in relation to symp-
Dyspnoea-12 amongst Italian patients. The translated toms of anxiety and depression: A prospective population
Dyspnoea-12 was the main result of this study, as- study. Respir Med 2006; 100(10): 1843-9.
sessed by a robust methodological translation and sup- 5. Cully JA, Graham DP, Stanley MA, Ferguson CJ,
Sharafkhaneh A, Souchek J, et al. Quality of life in patients
ported by a good quantitative and qualitative validity. with chronic obstructive pulmonary disease and comorbid
This scale could have a number of future implication anxiety or depression. Psychosomatics 2006; 47(4): 312-9.
for both clinical practice (e.g., its use in outpatients 6. Khadawardi H, Mura M. A simple dyspnoea scale as part of
t he assessment to predict outcome across chronic interstitial in people with advanced lung cancer. J Pain Symptom Man-
lung disease. Respirology 2016; 21(8): Epub ahead of print. age 2012; 44(5): 741-9.
7. Nishiyama O, Taniguchi H, Kondoh Y, Kimura T, Kato 17. Chavez CA, Ski CF, Thompson DR. Psychometric Proper-
K, Kataoka K, et al. A simple assessment of dyspnoea as a ties of the Cardiac Depression Scale: A Systematic Review.
prognostic indicator in idiopathic pulmonary fibrosis. Eur Hear Lung Circ 2014; 23(7): 610-8.
Respir J 2010; 36(5): 1067-72. 18. Brislin RW. Back-Translation for Cross-Cultural Research.
8. Holland AE, Hill CJ, Conron M, Munro P, McDonald CF. J Cross Cult Psychol 1970; 1(3): 185-216.
Short term improvement in exercise capacity and symptoms 19. Jones PS, Lee JW, Phillips LR, Zhang XE, Jaceldo KB. An
following exercise training in interstitial lung disease. Tho- adaptation of Brislin’s translation model for cross-cultural
rax 2008; 63(6): 549-54. research. Nurs Res 2001; 50(5): 300-4.
9. Fierro-Carrion G, Mahler DA, Ward J, Baird JC. Compari- 20. Thorne S. Data analysis in qualitative research. Evid Based
son of Continuous and Discrete Measurements of Dyspnea Nurs 2000; 3(3): 68-70.
During Exercise in Patients With COPD and Normal Sub- 21. Lawshe C. A quantitative approach to content validity. Pers
jects. Chest 2004; 125(1): 77-84. Psychol 1975; 28: 563-75.
10. Jones PW, Quirk FH, Baveystock CM, Littlejohns P. A 22. Holden RR, Holden, R. R. Face Validity. In: The Corsini
Self-complete Measure of Health Status for Chronic Air- Encyclopedia of Psychology. 4th ed. Hoboken, NJ, USA:
flow Limitation: The St. George’s Respiratory Question- John Wiley & Sons, Inc.; 2010: 637-638.
naire. Am Rev Respir Dis 1992; 145(6): 1321-7. 23. Lynn MR. Determination and quantification of content va-
11. Al-Gamal E, Yorke J, Al-Shwaiyat MKEA. Dyspnea- lidity. Nurs Res 1986; 35(6): 382-5.
12-Arabic: Testing of an instrument to measure breathless- 24. Maneesriwongul W, Dixon JK. Instrument translation pro-
ness in Arabic patients with chronic obstructive pulmonary cess: a methods review. J Adv Nurs 2004; 48(2): 175-86.
disease. Hear Lung J Acute Crit Care 2014; 43(3): 244-8. 25. Cha E-S, Kim KH, Erlen JA. Translation of scales in cross-
12. Yorke J, Russell A-M, Swigris J, Shuldham C, Haigh C, cultural research: issues and techniques. J Adv Nurs 2007;
Rochnia N, et al. Assessment of dyspnea in asthma: valida- 58(4): 386-95.
tion of The Dyspnea-12. J Asthma 2011; 48(6): 602-8. 26. Caruso R, Fida R, Sili A, Arrigoni C. Towards an integrated
13. Yorke J, Swigris J, Russell A-M, Moosavi SH, Ng Man model of nursing competence: an overview of the literature
Kwong G, Longshaw M, et al. Dyspnea-12 Is a Valid and reviews and concept analysis. Prof Inferm 2016; 69(1): 35-43.
Reliable Measure of Breathlessness in Patients With Inter-
stitial Lung Disease. Chest 2011; 139(1): 159-64.
14. Lareau SC, Meek PM, Roos PJ. Development and testing Received: 5 April 2017
of the modified version of the pulmonary functional status Accepted: 29 May 2017
and dyspnea questionnaire (PFSDQ-M). Heart Lung 1998; Correspondence:
27(3): 159-68. Rosario Caruso RN, MSc, PhD
15. Tanaka K, Akechi T, Okuyama T, Nishiwaki Y, Uchitomi Head of Health Professions Research and Development Unit
Y. Development and validation of the Cancer Dyspnoea IRCCS Policlinico San Donato
Scale: a multidimensional, brief, self-rating scale. Br J Can- Via Agadir, 20-24
cer 2000; 82(4): 800-5. 20097 San Donato Milanese (Mi)
16. Uronis HE, Shelby RA, Currow DC, Ahmedzai SH, Bos- Tel. +39 0252774940
worth HB, Coan A, et al. Assessment of the psychometric Fax +39 0252774969
properties of an English version of the cancer dyspnea scale E-mail: rosario.caruso@grupposandonato.it