A dual process item response theory model for polytomous multidimensional forced-choice items. 2023

Xuelan Qiu, and Jimmy de la Torre
Institute for Learning Sciences & Teacher Education, Australian Catholic University, Brisbane, Queensland, Australia.

The use of multidimensional forced-choice (MFC) items to assess non-cognitive traits such as personality, interests and values in psychological tests has a long history, because MFC items show strengths in preventing response bias. Recently, there has been a surge of interest in developing item response theory (IRT) models for MFC items. However, nearly all of the existing IRT models have been developed for MFC items with binary scores. Real tests use MFC items with more than two categories; such items are more informative than their binary counterparts. This study developed a new IRT model for polytomous MFC items based on the cognitive model of choice, which describes the cognitive processes underlying humans' preferential choice behaviours. The new model is unique in its ability to account for the ipsative nature of polytomous MFC items, to assess individual psychological differentiation in interests, values and emotions, and to compare the differentiation levels of latent traits between individuals. Simulation studies were conducted to examine the parameter recovery of the new model with existing computer programs. The results showed that both statement parameters and person parameters were well recovered when the sample size was sufficient. The more complete the linking of the statements was, the more accurate the parameter estimation was. This paper provides an empirical example of a career interest test using four-category MFC items. Although some aspects of the model (e.g., the nature of the person parameters) require additional validation, our approach appears promising.

UI MeSH Term Description Entries
D011581 Psychological Tests Standardized tests designed to measure abilities (as in intelligence, aptitude, and achievement tests) or to evaluate personality traits. Parenting Stress Index,Trier Social Stress Test,Trier Stress Test,Psychologic Tests,Psychological Test,Test, Psychological,Tests, Psychological,Index, Parenting Stress,Psychologic Test,Stress Index, Parenting,Stress Test, Trier,Test, Psychologic,Test, Trier Stress,Trier Stress Tests
D011594 Psychometrics Assessment of psychological variables by the application of mathematical procedures. Psychometric
D003198 Computer Simulation Computer-based representation of physical systems and phenomena such as chemical processes. Computational Modeling,Computational Modelling,Computer Models,In silico Modeling,In silico Models,In silico Simulation,Models, Computer,Computerized Models,Computer Model,Computer Simulations,Computerized Model,In silico Model,Model, Computer,Model, Computerized,Model, In silico,Modeling, Computational,Modeling, In silico,Modelling, Computational,Simulation, Computer,Simulation, In silico,Simulations, Computer
D006801 Humans Members of the species Homo sapiens. Homo sapiens,Man (Taxonomy),Human,Man, Modern,Modern Man

Related Publications

Xuelan Qiu, and Jimmy de la Torre
November 2006, The British journal of mathematical and statistical psychology,
Xuelan Qiu, and Jimmy de la Torre
June 2020, Educational and psychological measurement,
Xuelan Qiu, and Jimmy de la Torre
June 2024, Educational and psychological measurement,
Xuelan Qiu, and Jimmy de la Torre
August 2020, Educational and psychological measurement,
Xuelan Qiu, and Jimmy de la Torre
November 2017, Applied psychological measurement,
Xuelan Qiu, and Jimmy de la Torre
December 2021, Educational and psychological measurement,
Copied contents to your clipboard!