Jackknife bias reduction for polychotomous logistic regression. 1997

S B Bull, and C M Greenwood, and W W Hauck
Samuel Lunenfeld Research Institute, University of Toronto, Ontario, Canada.

Despite theoretical and empirical evidence that the usual MLEs can be misleading in finite samples and some evidence that bias reduced estimates are less biased and more efficient, they have not seen a wide application in practice. One can obtain bias reduced estimates by jackknife methods, with or without full iteration, or by use of higher order terms in a Taylor series expansion of the log-likelihood to approximate asymptotic bias. We provide details of these methods for polychotomous logistic regression with a nominal categorical response. We conducted a Monte Carlo comparison of the jackknife and Taylor series estimates in moderate sample sizes in a general logistic regression setting, to investigate dichotomous and trichotomous responses and a mixture of correlated and uncorrelated binary and normal covariates. We found an approximate two-step jackknife and the Taylor series methods useful when the ratio of the number of observations to the number of parameters is greater than 15, but we cannot recommend the two-step and the fully iterated jackknife estimates when this ratio is less than 20, especially when there are large effects, binary covariates, or multicollinearity in the covariates.

UI MeSH Term Description Entries
D008297 Male Males
D009010 Monte Carlo Method In statistics, a technique for numerically approximating the solution of a mathematical problem by studying the distribution of some random variable, often generated by a computer. The name alludes to the randomness characteristic of the games of chance played at the gambling casinos in Monte Carlo. (From Random House Unabridged Dictionary, 2d ed, 1993) Method, Monte Carlo
D011471 Prostatic Neoplasms Tumors or cancer of the PROSTATE. Cancer of Prostate,Prostate Cancer,Cancer of the Prostate,Neoplasms, Prostate,Neoplasms, Prostatic,Prostate Neoplasms,Prostatic Cancer,Cancer, Prostate,Cancer, Prostatic,Cancers, Prostate,Cancers, Prostatic,Neoplasm, Prostate,Neoplasm, Prostatic,Prostate Cancers,Prostate Neoplasm,Prostatic Cancers,Prostatic Neoplasm
D006505 Hepatitis INFLAMMATION of the LIVER. Hepatitides
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man
D015203 Reproducibility of Results The statistical reproducibility of measurements (often in a clinical context), including the testing of instrumentation or techniques to obtain reproducible results. The concept includes reproducibility of physiological measurements, which may be used to develop rules to assess probability or prognosis, or response to a stimulus; reproducibility of occurrence of a condition; and reproducibility of experimental results. Reliability and Validity,Reliability of Result,Reproducibility Of Result,Reproducibility of Finding,Validity of Result,Validity of Results,Face Validity,Reliability (Epidemiology),Reliability of Results,Reproducibility of Findings,Test-Retest Reliability,Validity (Epidemiology),Finding Reproducibilities,Finding Reproducibility,Of Result, Reproducibility,Of Results, Reproducibility,Reliabilities, Test-Retest,Reliability, Test-Retest,Result Reliabilities,Result Reliability,Result Validities,Result Validity,Result, Reproducibility Of,Results, Reproducibility Of,Test Retest Reliability,Validity and Reliability,Validity, Face
D015982 Bias Any deviation of results or inferences from the truth, or processes leading to such deviation. Bias can result from several sources: one-sided or systematic variations in measurement from the true value (systematic error); flaws in study design; deviation of inferences, interpretations, or analyses based on flawed data or data collection; etc. There is no sense of prejudice or subjectivity implied in the assessment of bias under these conditions. Aggregation Bias,Bias, Aggregation,Bias, Ecological,Bias, Statistical,Bias, Systematic,Ecological Bias,Outcome Measurement Errors,Statistical Bias,Systematic Bias,Bias, Epidemiologic,Biases,Biases, Ecological,Biases, Statistical,Ecological Biases,Ecological Fallacies,Ecological Fallacy,Epidemiologic Biases,Experimental Bias,Fallacies, Ecological,Fallacy, Ecological,Scientific Bias,Statistical Biases,Truncation Bias,Truncation Biases,Bias, Experimental,Bias, Scientific,Bias, Truncation,Biase, Epidemiologic,Biases, Epidemiologic,Biases, Truncation,Epidemiologic Biase,Error, Outcome Measurement,Errors, Outcome Measurement,Outcome Measurement Error
D016013 Likelihood Functions Functions constructed from a statistical model and a set of observed data which give the probability of that data for various values of the unknown model parameters. Those parameter values that maximize the probability are the maximum likelihood estimates of the parameters. Likelihood Ratio Test,Maximum Likelihood Estimates,Estimate, Maximum Likelihood,Estimates, Maximum Likelihood,Function, Likelihood,Functions, Likelihood,Likelihood Function,Maximum Likelihood Estimate,Test, Likelihood Ratio
D016015 Logistic Models Statistical models which describe the relationship between a qualitative dependent variable (that is, one which can take only certain discrete values, such as the presence or absence of a disease) and an independent variable. A common application is in epidemiology for estimating an individual's risk (probability of a disease) as a function of a given risk factor. Logistic Regression,Logit Models,Models, Logistic,Logistic Model,Logistic Regressions,Logit Model,Model, Logistic,Model, Logit,Models, Logit,Regression, Logistic,Regressions, Logistic

Related Publications

S B Bull, and C M Greenwood, and W W Hauck
February 2011, Statistics in medicine,
S B Bull, and C M Greenwood, and W W Hauck
June 1986, American journal of epidemiology,
S B Bull, and C M Greenwood, and W W Hauck
September 1994, Radiology,
S B Bull, and C M Greenwood, and W W Hauck
December 2009, Biometrics,
S B Bull, and C M Greenwood, and W W Hauck
April 1987, American journal of epidemiology,
S B Bull, and C M Greenwood, and W W Hauck
August 1988, American journal of epidemiology,
S B Bull, and C M Greenwood, and W W Hauck
January 1983, Statistics in medicine,
S B Bull, and C M Greenwood, and W W Hauck
January 1985, Statistics in medicine,
S B Bull, and C M Greenwood, and W W Hauck
September 1991, Hua xi yi ke da xue xue bao = Journal of West China University of Medical Sciences = Huaxi yike daxue xuebao,
S B Bull, and C M Greenwood, and W W Hauck
September 1996, International journal of cancer,
Copied contents to your clipboard!