The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

Caterina Primi, Kinga Morsanyi, Francesca Chiesi, Maria Anna Donati, Jayne Hamilton

Research output: Contribution to journalArticlepeer-review

101 Citations (Scopus)
1530 Downloads (Pure)

Abstract

The cognitive reflection test (CRT) is a short measure of a person's ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.
Original languageEnglish
Number of pages17
JournalJournal of Behavioral Decision Making
Early online date14 Jun 2015
DOIs
Publication statusEarly online date - 14 Jun 2015

Fingerprint

Dive into the research topics of 'The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)'. Together they form a unique fingerprint.

Cite this