Estimating the Reproducibility of Experimental Philosophy

Florian Cova, Fiery Cushman, Paulo Sousa

Research output: Contribution to journalArticle

Abstract

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, weenlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.
Original languageEnglish
JournalReview of Philosophy and Psychology
DOIs
Publication statusPublished - 14 Jun 2018

Fingerprint

Practice Guidelines
Research
Psychology
Experimental philosophy
Replication
Reproducibility
Research Practice
Research Teams

Cite this

@article{34dc50e4586744bd94c24494e865bae1,
title = "Estimating the Reproducibility of Experimental Philosophy",
abstract = "Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, weenlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70{\%} of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.",
author = "Florian Cova and Fiery Cushman and Paulo Sousa",
year = "2018",
month = "6",
day = "14",
doi = "10.1007/s13164-018-0400-9",
language = "English",
journal = "Review of Philosophy and Psychology",
issn = "1878-5158",
publisher = "Springer Verlag",

}

Estimating the Reproducibility of Experimental Philosophy. / Cova, Florian; Cushman, Fiery; Sousa, Paulo.

In: Review of Philosophy and Psychology, 14.06.2018.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Estimating the Reproducibility of Experimental Philosophy

AU - Cova, Florian

AU - Cushman, Fiery

AU - Sousa, Paulo

PY - 2018/6/14

Y1 - 2018/6/14

N2 - Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, weenlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.

AB - Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, weenlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.

U2 - 10.1007/s13164-018-0400-9

DO - 10.1007/s13164-018-0400-9

M3 - Article

JO - Review of Philosophy and Psychology

JF - Review of Philosophy and Psychology

SN - 1878-5158

ER -