The cognitive reflection test (CRT) is a short measure of a person’s ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.

The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT) / Primi, Caterina; Morsanyi, Kinga; Chiesi, Francesca; Donati, Maria Anna; Hamilton, Jayne. - In: JOURNAL OF BEHAVIORAL DECISION MAKING. - ISSN 0894-3257. - STAMPA. - (2016), pp. 1-17. [10.1002/bdm.1883]

The Development and Testing of a New Version of the Cognitive Reflection Test Applying Item Response Theory (IRT)

PRIMI, CATERINA;CHIESI, FRANCESCA;DONATI, MARIA ANNA;
2016

Abstract

The cognitive reflection test (CRT) is a short measure of a person’s ability to resist intuitive response tendencies and to produce a normatively correct response, which is based on effortful reasoning. Although the CRT is a very popular measure, its psychometric properties have not been extensively investigated. A major limitation of the CRT is the difficulty of the items, which can lead to floor effects in populations other than highly educated adults. The present study aimed at investigating the psychometric properties of the CRT applying item response theory analyses (a two-parameter logistic model) and at developing a new version of the scale (the CRT-long), which is appropriate for participants with both lower and higher levels of cognitive reflection. The results demonstrated the good psychometric properties of the original, as well as the new scale. The validity of the new scale was also assessed by measuring correlations with various indicators of intelligence, numeracy, reasoning and decision-making skills, and thinking dispositions. Moreover, we present evidence for the suitability of the new scale to be used with developmental samples. Finally, by comparing the performance of adolescents and young adults on the CRT and CRT-long, we report the first investigation into the development of cognitive reflection.
2016
1
17
Primi, Caterina; Morsanyi, Kinga; Chiesi, Francesca; Donati, Maria Anna; Hamilton, Jayne
File in questo prodotto:
File Dimensione Formato  
JBDM_CRT_15.pdf

Accesso chiuso

Tipologia: Pdf editoriale (Version of record)
Licenza: Tutti i diritti riservati
Dimensione 542.87 kB
Formato Adobe PDF
542.87 kB Adobe PDF   Richiedi una copia
2158-1011727_postprint.pdf

Open Access dal 01/01/2019

Tipologia: Versione finale referata (Postprint, Accepted manuscript)
Licenza: Open Access
Dimensione 767.22 kB
Formato Adobe PDF
767.22 kB Adobe PDF

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1011727
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 199
  • ???jsp.display-item.citation.isi??? 179
social impact