Pittsburgh Sleep Quality Index Paper
Pittsburgh Sleep Quality Index Paper
THIEME
Original Article
Alham Al-Sharman1,2
1 Department of Physiotherapy, College of Health Sciences, University Address for correspondence Ashokan Arumugam
of Sharjah, Sharjah, United Arab Emirates (email: ashokanpt@gmail.com; aarumugam@sharjah.ac.ae).
2 Neuromusculoskeletal Rehabilitation Research Group, Research
Institute of Medical and Health Sciences (RIMHS), University of
Sharjah, Sharjah, United Arab Emirates
3 Sustainable Engineering Asset Management Research Group, 4 Department of Physiotherapy, Manipal College of Health
Research Institute of Sciences and Engineering (RISE), University of Professions, Manipal Academy of Higher Education, Manipal,
Sharjah, Sharjah, United Arab Emirates Karnataka, India
Sleep Sci
Abstract Introduction The Pittsburg Sleep Quality Index (PSQI) is widely used in different
population groups to assess self-reported sleep quality over the previous month. As the
Arabic language is spoken by more than 400 million people, the PSQI has been
translated into Arabic for its optimal application to Arabic-speaking individuals.
However, the test-retest reliability of the Arabic version of the PSQI has not been
reported yet.
Objective To examine the reliability and agreement of a bilingual Arabic-English
version of the PSQI (AE-PSQI) among bilingual Arabic-English-speaking adolescents and
young adults of the United Arab Emirates (UAE) with good or poor sleep quality.
Materials and Methods We included 50 bilingual Arabic-English-speaking adoles-
cents and young adults (mean age of 20.82 2.7 years; 30/50 subjects classified as
poor sleepers [PSQI > 5] at baseline) who filled put the AE-PSQI twice, 7 days apart. The
internal consistency of the AE-PSQI was assessed through the Cronbach’s alpha. The
intraclass correlation coefficient (ICC[3,1]) was used to assess the test-retest reliability.
The standard error of measurement (SEM), the smallest real difference (SRD), and the
Keywords Bland-Altman plots were used to report agreement measures.
► PSQI Results The global score on the AE-PQSI showed an acceptable level of internal
► reliability consistency with a Cronbach’s alpha value of 0.65, and no floor and ceiling effects were
► sleep quality observed. The 95% confidence intervals (95%CI: 0.63-0.87) of the ICC(3,1) revealed
► young adults moderate to strong reliability estimates for overall AE-PSQI scores. The SEM and SRD
► psychometric were of 1.6 and 4.5 respectively, and the Bland-Altman plots revealed a moderate
property agreement between the baseline and retest global AE-PQSI scores.
received DOI https://doi.org/ © 2024. Brazilian Sleep Association. All rights reserved.
June 22, 2023 10.1055/s-0044-1782170. This is an open access article published by Thieme under the terms of the
accepted ISSN 1984-0659. Creative Commons Attribution-NonDerivative-NonCommercial-License,
November 16, 2023 permitting copying and reproduction so long as the original work is given
appropriate credit. Contents may not be used for commercial purposes, or
adapted, remixed, transformed or built upon. (https://creativecommons.org/
licenses/by-nc-nd/4.0/)
Thieme Revinter Publicações Ltda., Rua do Matoso 170, Rio de
Janeiro, RJ, CEP 20270-135, Brazil
Test-Retest Reliability of a Bilingual Arabic-English PSQI Arumugam et al.
from schools and universities in the UAE. Participants were distribution was considered nearly normal if the number of
excluded if they had a medical condition or had recently participants is considered large enough ( > 30).47 There-
undergone surgeries that affected their sleep. The ethical fore, we used parametric tests for the statistical analysis. The
approval for this study was approved by the Research Ethics McNemar test was used to compare the proportion of
Committee of the University of Sharjah (REC-22-02-23-01-S). participants with good and poor sleep quality regarding
the baseline and retest global scores on the AE-PSQI. The
Procedure IBM SPSS Statistics for Windows (IBM Corp., Armonk, NY,
Body weight was measured to the nearest 100 g using a United States) software, version 28.0, was used for the
standard portable digital weighing scale. Height was mea- statistical analysis, and values of p < 0.05 were set as the
sured to the nearest 1 cm using a portable stadiometer. The threshold for statistical significance.
Body Mass Index (BMI) was calculated for each participant as
body weight (kg) divided by height in meters squared. Floor and Ceiling Effects
The floor and ceiling effects were assessed with the percent-
Pittsburgh Sleep Quality Index (PSQI) age of participants who scored the lowest (0) and highest
The overall sleep quality over the preceding month22 in (21) respectively. If more than 15% participants scored lowest
adolescents and young adults was assessed using the or highest scores, then floor or ceiling effects were consid-
PSQI,33 considering that this questionnaire is used among ered to exist.48
adolescents and young adults as a reliable and valid tool.43,44
It consists of 19 items divided into 7 sleep-related variables: Internal Consistency
1) sleep quality; 2) sleep latency; 3) sleep duration; 4) sleep Internal consistency refers to the degree of consistency
efficiency; 5) sleep disturbance; 6) medication use; among all internal items of the questionnaire. The internal
and 7) daytime dysfunction. Every item is rated on a 4-point consistency of the AE-PSQI was assessed using the Cronbach
Likert scale in terms of frequency or severity. The sum of the alpha; in addition, the item-to-total correlation was assessed
component scores yields a global PSQI score ranging from 0 using the Pearson correlation coefficient and the alpha values
to 21, with higher scores indicating poor sleep quality. for the tool, if each item was deleted, were reported. The
Scores > 5 indicate poor sleep quality, while those 5 item-to-total correlation refers to the correlation between
indicate good sleep quality.45 each item/component and the global score on the PSQI. The
alpha score was interpreted according to the following
Sample Size Estimation criteria: lower than 0.60: “unacceptable”; 0.60 to 0.65:
Considering a minimum acceptable reliability (intraclass “undesirable”; 0.65 to 0.70: “minimally acceptable”; 0.70
correlation coefficient, ICC) of 0.60, an expected reliability to 0.80 “respectable”; 0.80 to 0.90 “very good”; and much
(ICC) of 0.80, a significance level of 0.05, and a power higher than 0.90: “consider shortening the scale”.49
of 0.80, the number of participants required is 49 for
2 measurements (test [baseline] versus retest [after Test-Retest Reliability
7 days]).46 Therefore, 50 participants were recruited for We compared the Pearson correlation coefficient, the Spear-
the present study. man correlation coefficient, and the ICC ([3,1]; two-way mixed
effects, consistency, single measurements, agreement) for the
Procedure test-rest reliability analysis of the baseline PSQI global and
The subjects were invited to participate in the study through component scores and seven-day retest scores. As the reliabil-
social media adverts, university/school notice boards, and ity estimates were almost the same for all three analyses for all
word of mouth. The study procedures were explained to the comparisons, and there were 50 participants, the ICC(3,1) was
interested participants. Prior to being enrolled in the study, used for further interpretation; ICC values > 0.75 are consid-
participants and/or their parents read the information sheet ered strong, those from 0.40 to 0.75 are moderate, and those
and informed consent was provided by them (in the case of < 0.40 are considered poor to estimate reliability.50 The stan-
adults) or by their parents/guardians (in the case of adoles- dard error of measurement (SEM), as a measure of agreement,
cents). We provided both English and the corresponding was calculated using the following equation: Sp √(1- r), in
Arabic translations of each item of the PSQI together to all which Sp is the pooled standard deviation of test-retest
participants. The participants were asked to fill the AE-PSQI measures and r is the reliability coefficient (ICC).51,52 Addi-
twice, seven days apart. tionally, the smallest real difference (SRD), the threshold to
detect a “real” change beyond the measurement error, was
Statistical Analysis analyzed using the formula 1.96 SEM √2.52
Descriptive characteristics of the participants were pre-
sented as mean and standard deviation (SD) values. Data Bland-Altman Plots
were tested for normal distribution using the Shapiro-Wilk To further explore the agreement of test-retest AE-PSQI
test and histograms. As the data were not normally distrib- scores, the Bland-Altman plot was used. The plots with
uted, log and square-root transformation were applied, but mean values against differences of global PSQI scores be-
the transformed data did not meet the required assumption tween baseline (1) and retest (2) with 95% limits of agree-
of normality. The distribution of means from any skewed ment (mean bias [1.96 SD]) were used. Here, mean bias
and SD are the mean SD values of differences respectively. Table 2 Item-to-total correlation.
A significance level < 0.050 was set for all analyses. While
assessing the test-retest agreement in the plot, the differ- Items Item-to-total Alpha if item
ences between the tests were arbitrarily considered high if correlation was deleted
they were 1.5 SDs, moderate if the differences ranged from Subjective sleep quality 0.71 0.56
1.0 to 1.49 SDs, and low if the differences were < 1.0 SD.53 Sleep latency 0.74 0.54
Sleep duration 0.70 0.58
Results Sleep efficiency 0.46 0.68
Participant Characteristics Sleep disturbances 0.44 0.64
This study included 50 participants. The mean age of the Use of sleeping medicine 0.31 0.66
sample was of 20.82 2.7 years, and it included 34 female Daytime dysfunction 0.55 0.63
(68%) and 16 male (32%) subjects. Participants character-
istics are shown in ►Table 1. The proportion of poor sleepers Note: Pearson correlation coefficient.
(PSQI > 5) at baseline was of 60% (n ¼ 30/50), which was
significantly different (p ¼ 0.039) from that of the retest
(46%; n ¼ 23/50).
Internal Consistency
A Cronbach alpha score of 0.65 was obtained, which met “the
minimally acceptable” criterion for the internal consistency
of the AE-PSQI. The alpha scores were nearly the same for
both the baseline and retest scores. The item-to-total corre-
lation coefficients ranged from 0.31 to 0.74, and the smallest Fig. 1 Bland-Altman plot showing agreement between baseline (T1)
component-total correlation coefficient was found for the and retest (T2) global PSQI scores.
Table 3 PSQI item characteristics, paired t-test (test 1 versus test 2) p-values, and intraclass correlation coefficients (ICC[3,1]) with
95% confidence intervals and p-values.
PSQI Items Test 1: Test 1: Test 2: Test 2: Paired ICC(3,1) 95%CI p-value
mean standard mean standard t-test:
Lower Upper
deviation deviation p-value
bound bound
Subjective sleep quality 1.16 0.91 1.16 0.79 1.000 0.66 0.48 0.79 < 0.001
Sleep 0.78 0.86 0.80 0.86 0.785 0.82 0.70 0.89 < 0.001
latency
Sleep duration 1.28 1.03 1.36 1.05 0.552 0.59 0.37 0.74 < 0.001
Sleep efficiency 0.56 0.97 0.52 0.84 0.799 0.26 0 0.50 0.034
Sleep disturbance 1.04 0.53 0.94 0.62 0.168 0.62 0.41 0.76 < 0.001
Use of sleep medication 0.12 0.39 0.08 0.34 0.322 0.70 0.52 0.82 < 0.001
Daytime dysfunction 1.22 0.84 1.10 0.79 0.182 0.70 0.53 0.82 < 0.001
Global PSQI 6.16 3.27 5.96 3.11 0.510 0.77 0.63 0.87 < 0.001
score
Abbreviations: 95%CI, 95% confidence interval; ICC, intraclass correlation coefficient; PSQI, Pittsburg Sleep Quality Index.
been reported to meet the quality assessment criteria for Future Recommendation
internal consistency.23 The internal consistency of the original Future research is essential to explore various population
PSQI was found to be fair to good, with a Cronbach alpha value groups, as a valid and reliable AE-PSQI is needed to support
ranging from 0.64 to 0.83.22,24 clinical decision-making for interventions that can improve
Overall, the test-retest reliability estimate for the AE-PSQI sleep quality. This is particularly relevant for bilingual indi-
global score was strong (ICC ¼ 0.77), while the reliability viduals who speak both Arabic and English and present
estimates of other subcomponents, except the sleep efficiency, issues such as insomnia, sleep disorders, chronic pain, fibro-
ranged from moderate to strong. Previous studies have found myalgia, multiple sclerosis etc. Moreover, other psychomet-
test-retest reliability estimates to be moderate (r ¼ 0.65) for ric properties (such as validity and responsiveness) of the AE-
the Brazilian PSQI version in healthy adolescents57 and strong PSQI should be investigated further.
(r ¼ 0.83) for the Italian PSQI version in healthy children.56
Furthermore, two other studies including both healthy and
Conclusion
symptomatic participants (with sleep problems) revealed a
high internal consistency (Cronbach α ¼ 0.84) and moderate The AE-PSQI was found to be a reliable instrument to assess
reliability (r ¼ 0.65) for the Korean PSQI,26 and good internal sleep quality in bilingual Arabic-English-speaking adoles-
consistency (Cronbach α ¼ 0.70) and strong reliability cents and young adults with good or poor sleep quality.
(r ¼ 0.83) for the Kurdish PSQI.58 Therefore, the PSQI has The AE-PSQI demonstrated no floor or ceiling effects, mini-
been found to have acceptable internal consistency and reli- mally acceptable internal consistency, and moderate to
ability, irrespective of the language used. strong test-retest reliability estimates.
The SEM of the AE-PSQI global score was of 1.6. Moreover,
the SEM of the Brazilian PSQI has been reported to be of 1.1 Authors Contributions
for healthy adolescents.57 As the previous study37 investi- AA: conceptualization, design, supervision, data curation,
gating the psychometric properties of the Arabic PSQI in data analysis, interpretation, drafting, and revision; SAM,
healthy adults has not reported agreement measures, com- HYA, ZAZ, TMEH, HIA, and FSJ: data collection, data
parisons of SEM/SRD values of the AE-PSQI with that of the curation, interpretation, drafting, and revision; SAM:
Arabic PSQI were not possible. data analysis; AAS: interpretation, drafting, and critical
revision; AA led the writing of the paper; all authors read
Strengths and Limitations of the Study and approved the final manuscript.
To our knowledge, the present study is the first of its kind
investigating the floor and ceiling effects, internal consisten- Funding
cy, and test-retest reliability of the AE-PSQI, and positive The authors declare that they have received no specific
findings were observed for the AE-PQSI using multiple grants from funding agencies in the public, private, or not-
reliability and agreement estimates. As only healthy adoles- for-profit sectors for the conduction of the present study.
cents and young adults with good or poor sleep quality were
included, the results cannot be generalized to individuals Conflict of Interests
with clinical conditions affecting sleep. The authors have no conflict of interests to declare.
with depressive symptoms. Womens Health Issues 2009;19(01): 47 Norman GR, Streiner DL. “Biostatistics: The Bare Essentials,”. In:
45–51. Doi: 10.1016/j.whi.2008.10.004 The Normal Distribution,. Hamilton:: B.C. Decker; 2008:32
36 Backhaus J, Junghanns K, Broocks A, Riemann D, Hohagen F. Test- 48 McHorney CA, Tarlov AR. Individual-patient monitoring in clini-
retest reliability and validity of the Pittsburgh Sleep Quality Index cal practice: are available health status surveys adequate? Qual
in primary insomnia. J Psychosom Res 2002;53(03):737–740. Doi: Life Res 1995;4(04):293–307. Doi: 10.1007/BF01593882
10.1016/S0022-3999(02)00330-6 49 DeVellis RF. Scale development: Theory and applications. Fourth
37 Suleiman KH, Yates BC, Berger AM, Pozehl B, Meza J. Translating Edition Sage publications; 2017
the pittsburgh sleep quality index into arabic. West J Nurs Res 50 Xiong P, Spira AP, Hall BJ. Psychometric and structural validity of
2010;32(02):250–268. Doi: 10.1177/0193945909348230 the pittsburgh sleep quality index among filipino domestic work-
38 Suleiman K, Hadid LA, Duhni A. Psychometric Testing of the ers. Int J Environ Res Public Health 2020;17(14):1–17. Doi:
Arabic version of the Pittsburgh Sleep Quality Index (A-PSQI) 10.3390/ijerph17145219
among Coronary Artery Disease Patients in Jordan. Journal of 51 Atkinson G, Nevill AM. Statistical methods for assessing measure-
Natural Sciences Research 2012;2(08):15–19 ment error (reliability) in variables relevant to sports medicine.
39 Al Maqbali M, Hughes C, Gracey J, Rankin J, Dunwoody L, Hacker E. Sports Med 1998;26(04):217–238. Doi: 10.2165/00007256-
Validation of the Pittsburgh Sleep Quality Index (PSQI) with 199826040-00002
Arabic cancer patients. Sleep Biol Rhythms 2020;18(03): 52 Schuck P, Zwingmann C. The ’smallest real difference’ as a
217–223. Doi: 10.1007/s41105-020-00258-w measure of sensitivity to change: a critical analysis. Int J Rehabil
40 Lee A, Lambert K, Byrne P, Lonergan M. PREVALENCE OF CONSTI- Res 2003;26(02):85–91. Doi: 10.1097/01.mrr.0000070759.
PATION IN PATIENTS WITH ADVANCED KIDNEY DISEASE. J Ren 63544.65. PubMed
Care 2016;42(03):144–149. Doi: 10.1111/jorc.12157 53 Jensen NSO, Camargo TdeFB, Bergamschi DP. Body mass index and
41 Anati NM, Ain A. Including Students with Disabilities in UAE waist circumference are good indicators for classifying children’s
Schools: A Descriptive Study. Int J Spec Educ 2012;27(02):75–85 nutritional status. Cien Saude Colet 2016;21(04):1175–1180. Doi:
42 Karami H. The Development and Validation of a Bilingual Version 10.1590/1413-81232015214.138712015
of the Vocabulary Size Test. RELC J 2012;43(01):53–67. Doi: 54 ElHafeez SA, Meira E Cruz M, Gouda S, et al. Sleep quality and
10.1177/0033688212439359 anxiety among Egyptian population during covid-19 pandemic.
43 Larche CL, Plante I, Roy M, Ingelmo PM, Ferland CE. The Pittsburgh Sleep Sci 2022;15(01):8–16. Doi: 10.5935/1984-0063.20210020
Sleep Quality Index: Reliability, Factor Structure, and Related 55 Albqoor MA, Shaheen AM. Prevalence and differences in habitual
Clinical Factors among Children, Adolescents, and Young Adults sleep efficiency, sleep disturbances, and using sleep medication: a
with Chronic Pain. Sleep Disord 2021;2021:5546484. Doi: national study of university students in Jordan. Sleep Breath
10.1155/2021/5546484 2021;25(02):1127–1134. Doi: 10.1007/s11325-020-02174-2
44 Farah NM, Saw Yee T, Mohd Rasdi HF. Self-Reported Sleep Quality 56 Scialpi A, Mignolli E, De Vito C, et al. Italian Validation of the
Using the Malay Version of the Pittsburgh Sleep Quality Index Pittsburgh Sleep Quality Index (PSQI) in a Population of Healthy
(PSQI-M) In Malaysian Adults. Int J Environ Res Public Health Children: A Cross Sectional Study. Int J Environ Res Public Health
2019;16(23):4750. Doi: 10.3390/ijerph16234750 2022;19(15):9132. Doi: 10.3390/ijerph19159132
45 Trabelsi K, Ammar A, Masmoudi L, et al; On Behalf Of The Eclb-Covid 57 Passos MHP, Silva HA, Pitangui ACR, Oliveira VMA, Lima AS, Araújo
Consortium. Sleep quality and physical activity as predictors of RC. Reliability and validity of the Brazilian version of the Pitts-
mental wellbeing variance in older adults during covid-19 lock- burgh Sleep Quality Index in adolescents. J Pediatr (Rio J) 2017;93
down: Eclb covid-19 international online survey. Int J Environ Res (02):200–206. Doi: 10.1016/j.jped.2016.06.006
Public Health 2021;18(08):4329. Doi: 10.3390/ijerph 18084329 58 Seidi PAM, Mohammadi H, Khazaie H, Abas NQ, Jaff D. Psycho-
46 “wnarifin.github.ioSample size calculator,” . [Cited 19 Janu- metric properties of the Kurdish version of Pittsburgh Sleep
ary 2023]. Available from: https://wnarifin.github.io/ssc/ssicc. Quality Index. Sleep Med 2019;63:75–81. Doi: 10.1016/J.
html SLEEP.2019.04.022