Development and Validation of a Brief Culture-of-Safety Survey. 2022

Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria

Culture of safety (COS) is recognized as a critical component of patient safety but can be burdensome to measure due to survey length. This project aimed to develop a shortened COS survey with comparable measurement properties to a validated 19-item instrument. Item response theory (IRT) was used to reduce items from a 19-item COS survey at a 10-hospital health system. Using a 50% random sample, IRT was applied to evaluate survey question discrimination and information. Concepts from the key questions in each subdomain were reworded into a new abbreviated scale. Cognitive interviews with clinicians were conducted to validate reworded questions for adequacy, clarity, and consistency of interpretation. The 19-item survey was reduced with IRT to 4 items. Cronbach's alpha for the 4-item IRT-derived scale was 0.80 (average inter-item covariance = 0.36) and was comparable to the original scale despite ∼75% reduction in items. Pearson correlation between the 4-item scale and the original scale was > 0.90. The 4-item scale demonstrated convergent validity. Results were replicated in a 50% random validation sample. Cognitive interviews revealed inadequacy of the shortened scale in assessing error-reporting culture. A fifth item was developed and qualitatively validated for this construct. Using a mixed methods approach, a lengthy COS survey was condensed and revised to a brief 5-question survey with comparable measurement properties and respondent interpretation. A shorter instrument necessarily loses detailed insight into multiple aspects of safety culture, and organizations should consider trade-offs in choosing to develop a briefer survey.

UI MeSH Term Description Entries
D011594 Psychometrics Assessment of psychological variables by the application of mathematical procedures. Psychometric
D011795 Surveys and Questionnaires Collections of data obtained from voluntary subjects. The information usually takes the form of answers to questions, or suggestions. Community Survey,Nonrespondent,Questionnaire,Questionnaires,Respondent,Survey,Survey Method,Survey Methods,Surveys,Baseline Survey,Community Surveys,Methodology, Survey,Nonrespondents,Questionnaire Design,Randomized Response Technique,Repeated Rounds of Survey,Respondents,Survey Methodology,Baseline Surveys,Design, Questionnaire,Designs, Questionnaire,Methods, Survey,Questionnaire Designs,Questionnaires and Surveys,Randomized Response Techniques,Response Technique, Randomized,Response Techniques, Randomized,Survey, Baseline,Survey, Community,Surveys, Baseline,Surveys, Community,Techniques, Randomized Response
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D015203 Reproducibility of Results The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results. Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D061214 Patient Safety Efforts to reduce risk, to address and reduce incidents and accidents that may negatively impact healthcare consumers. Patient Safeties,Safeties, Patient,Safety, Patient

Related Publications

Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
September 2022, Journal of patient safety,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
October 2007, Health services research,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
September 2021, International journal of environmental research and public health,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
November 2019, Healthcare policy = Politiques de sante,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
January 2011, Gerontology,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
January 2022, Frontiers in public health,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
January 2019, Journal of healthcare quality research,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
March 2005, Journal of critical care,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
January 2007, Medical care,
Cynthia Barnard, and Jeanette W Chung, and Vanessa Flaherty, and Julie K Johnson, and Kathryn Thomas, and Dea Hughes, and Monica Locker, and Karl Y Bilimoria
October 2017, International journal of environmental research and public health,
Copied contents to your clipboard!