Biomaterial Database

Sample size in psychological research over the past 30 years. 2011

Jacob M Marszalek, and Carolyn Barber, and Julie Kohlhart, and Cooper B Holmes

Division of Counseling and Educational Psychology, University of Missouri-Kansas City, 64110, USA. marszalekj@umkc.edu

The American Psychological Association (APA) Task Force on Statistical Inference was formed in 1996 in response to a growing body of research demonstrating methodological issues that threatened the credibility of psychological research, and made recommendations to address them. One issue was the small, even dramatically inadequate, size of samples used in studies published by leading journals. The present study assessed the progress made since the Task Force's final report in 1999. Sample sizes reported in four leading APA journals in 1955, 1977, 1995, and 2006 were compared using nonparametric statistics, while data from the last two waves were fit to a hierarchical generalized linear growth model for more in-depth analysis. Overall, results indicate that the recommendations for increasing sample sizes have not been integrated in core psychological research, although results slightly vary by field. This and other implications are discussed in the context of current methodological critique and practice.

UI	MeSH Term	Description	Entries
D010506	Periodicals as Topic	Works about publications issued at stated, more or less regular, intervals.	Journals as Topic,Magazines,Newsletters,Magazine,Newsletter
D011584	Psychology	The science dealing with the study of mental processes and behavior in man and animals.	Factors, Psychological,Psychological Factors,Psychological Side Effects,Psychologists,Psychosocial Factors,Side Effects, Psychological,Factor, Psychological,Factor, Psychosocial,Factors, Psychosocial,Psychological Factor,Psychological Side Effect,Psychologist,Psychosocial Factor,Side Effect, Psychological
D011643	Publishing	"The business or profession of the commercial production and issuance of literature" (Webster's 3d). It includes the publisher, publication processes, editing and editors. Production may be by conventional printing methods or by electronic publishing.	Electronic Publishing,Publishing, Electronic,Electronic Publishings,Publishings, Electronic
D012106	Research	Critical and exhaustive investigation or experimentation, having for its aim the discovery of new facts and their correct interpretation, the revision of accepted conclusions, theories, or laws in the light of newly discovered facts, or the practical application of such new or revised conclusions, theories, or laws. (Webster, 3d ed)	Research Priorities,Laboratory Research,Research Activities,Research and Development,Activities, Research,Activity, Research,Development and Research,Priorities, Research,Priority, Research,Research Activity,Research Priority,Research, Laboratory
D003627	Data Interpretation, Statistical	Application of statistical procedures to analyze specific observed or assumed facts from a particular study.	Data Analysis, Statistical,Data Interpretations, Statistical,Interpretation, Statistical Data,Statistical Data Analysis,Statistical Data Interpretation,Analyses, Statistical Data,Analysis, Statistical Data,Data Analyses, Statistical,Interpretations, Statistical Data,Statistical Data Analyses,Statistical Data Interpretations
D005544	Forecasting	The prediction or projection of the nature of future problems or existing conditions based upon the extrapolation or interpretation of existing scientific data or by the application of scientific methodology.	Futurology,Projections and Predictions,Future,Predictions and Projections
D006801	Humans	Members of the species Homo sapiens.	Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D015203	Reproducibility of Results	The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results.	Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D015982	Bias	Any deviation of results or inferences from the truth, or processes leading to such deviation. Bias can result from several sources: one-sided or systematic variations in measurement from the true value (systematic error); flaws in study design; deviation of inferences, interpretations, or analyses based on flawed data or data collection; etc. There is no sense of prejudice or subjectivity implied in the assessment of bias under these conditions.	Aggregation Bias,Bias, Aggregation,Bias, Ecological,Bias, Statistical,Bias, Systematic,Ecological Bias,Outcome Measurement Errors,Statistical Bias,Systematic Bias,Bias, Epidemiologic,Biases,Biases, Ecological,Biases, Statistical,Ecological Biases,Ecological Fallacies,Ecological Fallacy,Epidemiologic Biases,Experimental Bias,Fallacies, Ecological,Fallacy, Ecological,Scientific Bias,Statistical Biases,Truncation Bias,Truncation Biases,Bias, Experimental,Bias, Scientific,Bias, Truncation,Biase, Epidemiologic,Biases, Epidemiologic,Biases, Truncation,Epidemiologic Biase,Error, Outcome Measurement,Errors, Outcome Measurement,Outcome Measurement Error
D016014	Linear Models	Statistical models in which the value of a parameter for a given value of a factor is assumed to be equal to a + bx, where a and b are constants. The models predict a linear regression.	Linear Regression,Log-Linear Models,Models, Linear,Linear Model,Linear Regressions,Log Linear Models,Log-Linear Model,Model, Linear,Model, Log-Linear,Models, Log-Linear,Regression, Linear,Regressions, Linear