Measuring probabilistic reasoning: The construction of a new scale applying Item Response Theory

Caterina Primi, Kinga Morsanyi, Maria Anna Donati, Silvia Galli, Francesca Chiesi

Research output: Contribution to journalArticle

4 Citations (Scopus)
94 Downloads (Pure)

Abstract

Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math-related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions.
Original languageEnglish
JournalJournal of Behavioral Decision Making
Early online date03 May 2017
DOIs
Publication statusEarly online date - 03 May 2017

Fingerprint

Aptitude
Language
Italian language
Educational Status
gender
ability
equivalence
English language
statistics
language
Probabilistic Reasoning
Item Response Theory
Item response theory

Cite this

@article{2dc35808a46f4f37af98cb0936e0a3bf,
title = "Measuring probabilistic reasoning: The construction of a new scale applying Item Response Theory",
abstract = "Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math-related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions.",
author = "Caterina Primi and Kinga Morsanyi and Donati, {Maria Anna} and Silvia Galli and Francesca Chiesi",
year = "2017",
month = "5",
day = "3",
doi = "10.1002/bdm.2011",
language = "English",
journal = "Journal of Behavioral Decision Making",
issn = "0894-3257",
publisher = "John Wiley and Sons Ltd",

}

Measuring probabilistic reasoning: The construction of a new scale applying Item Response Theory. / Primi, Caterina; Morsanyi, Kinga; Donati, Maria Anna; Galli, Silvia; Chiesi, Francesca.

In: Journal of Behavioral Decision Making, 03.05.2017.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Measuring probabilistic reasoning: The construction of a new scale applying Item Response Theory

AU - Primi, Caterina

AU - Morsanyi, Kinga

AU - Donati, Maria Anna

AU - Galli, Silvia

AU - Chiesi, Francesca

PY - 2017/5/3

Y1 - 2017/5/3

N2 - Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math-related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions.

AB - Probabilistic reasoning skills are important in various contexts. The aim of the present study was to develop a new instrument (the Probabilistic Reasoning Scale – PRS) to accurately measure low levels of probabilistic reasoning ability in order to identify people with difficulties in this domain. Item response theory was applied to construct the scale, and to investigate differential item functioning (i.e., whether the items were invariant) across genders, educational levels, and languages. Additionally, we tested the validity of the scale by investigating the relationships between the PRS and several other measures. The results revealed that the items had a low level of difficulty. Nonetheless, the discriminative measures showed that the items can discriminate between individuals with different trait levels, and the test information function showed that the scale accurately assesses low levels of probabilistic reasoning ability. Additionally, through investigating differential item functioning, the measurement equivalence of the scale at the item level was confirmed for gender, educational status, and language (i.e., Italian and English). Concerning validity, the results showed the expected correlations with numerical skills, math-related attitudes, statistics achievement, IQ, reasoning skills, and risky choices both in the Italian and British samples. In conclusion, the PRS is an ideal instrument for identifying individuals who struggle with basic probabilistic reasoning, and who could be targeted by specific interventions.

U2 - 10.1002/bdm.2011

DO - 10.1002/bdm.2011

M3 - Article

JO - Journal of Behavioral Decision Making

JF - Journal of Behavioral Decision Making

SN - 0894-3257

ER -