Use of design effects and sample weights in complex health survey data: a review of published articles using data from 3 commonly used adolescent health surveys. 2012

Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
Educational Psychology, Research, and Foundations Program, University of South Carolina, Columbia SC 29208, USA. babell@sc.edu

OBJECTIVE We assessed how frequently researchers reported the use of statistical techniques that take into account the complex sampling structure of survey data and sample weights in published peer-reviewed articles using data from 3 commonly used adolescent health surveys. METHODS We performed a systematic review of 1003 published empirical research articles from 1995 to 2010 that used data from the National Longitudinal Study of Adolescent Health (n=765), Monitoring the Future (n=146), or Youth Risk Behavior Surveillance System (n=92) indexed in ERIC, PsycINFO, PubMed, and Web of Science. RESULTS Across the data sources, 60% of articles reported accounting for design effects and 61% reported using sample weights. However, the frequency and clarity of reporting varied across databases, publication year, author affiliation with the data, and journal. CONCLUSIONS Given the statistical bias that occurs when design effects of complex data are not incorporated or sample weights are omitted, this study calls for improvement in the dissemination of research findings based on complex sample data. Authors, editors, and reviewers need to work together to improve the transparency of published findings using complex sample data.

UI MeSH Term Description Entries

Related Publications

Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
October 2012, The Stata journal,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
January 2014, American journal of public health,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
May 1986, The American journal of clinical nutrition,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
May 2016, The Journal of adolescent health : official publication of the Society for Adolescent Medicine,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
July 2025, Child and adolescent psychiatry and mental health,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
July 2009, BMC medical research methodology,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
January 2000, Gaceta sanitaria,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
January 1987, Vestnik statistiki (Moscow, Russia : 1949),
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
February 2013, Revista de saude publica,
Bethany A Bell, and Anthony J Onwuegbuzie, and John M Ferron, and Qun G Jiao, and Susan T Hibbard, and Jeffrey D Kromrey
June 1983, International journal of epidemiology,
Copied contents to your clipboard!