Publications

*OSF = Supplemental materials on Open Science Framework 

Preprints

Nuijten, M. B. & Wicherts, J. M. (2023). The effectiveness of implementing statcheck in the peer review process to avoid statistical reporting errors. PsyArXiv. doi:10.31234/osf.io/bxau9

preprint – OSF

D’Urso, D. E., Maassen, E., Van Assen, M. A. L. M., Nuijten, M. B., De Roover, K., & Wicherts, J. M. (2022). The dire disregard of measurement invariance testing in psychological science. PsyArXiv. doi: 10.31234/osf.io/n3f5u

preprint – OSF

2023

Van Assen, M. A. L. M., Van den Akker, O., Augusteijn, H. E. M., Bakker, M., Nuijten, M. B., Olsson-Collentine, A., … van Aert, R. C. M. (in press). The meta-plot: A graphical tool for interpreting the results of a meta-analysis. Zeitschrift für Psychologie, 231 (1), 65-78. doi: 10.1027/2151-2604/a000513

paper – preprint – OSF

2022

Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Almenberg, A. D., Fidler, F., Hilgard, J., Kline, M., Nuijten, M. B., Rohrer, J. M., Romero, F., Scheel, A. M., Scherer, L., Schönbrodt, F., & Vazire, S. (2022). Replicability, robustness, and reproducibility in psychological science. Annual Review of Psychology, 73, 719-748. doi: 10.1146/annurev-psych-020821-114157
paper – preprint – OSF

2021

Hardwicke, T. E., Szucs D., Thibault, R. T., Crüwell, S., van den Akker, O. R., Nuijten, M. B., & Ioannidis, J. P. A. (2021). Citation patterns following a strongly contradictory replication result: Four case studies from psychology. Advances in Methods and Practices in Psychological Science, 4, 1-14. doi: 10.1177/25152459211040837
paper – preprint – OSF

Tijdink, J., Horbach, S. P. J. M., Nuijten, M. B., & O’Neill, G., (2021). Towards a research agenda for promoting  responsible research practices. Journal of Empirical Research on Human Research Ethics. doi: 10.1177/15562646211018916
paper

Hardwicke, T. E., Bohn, M., MacDonald, K., Hembacher, E., Nuijten, M. B., Peloquin, B. N., . . . Frank, M. C. (2021). Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an observational study. Royal Society Open Science, 8, 201494. doi: 10.1098/rsos.201494
paper – OSF

2020

Nuijten, M. B., Van Assen, M. A. L. M., Augusteijn, H. E. M., Crompvoets, E. A. V., & Wicherts, J. M. (2020). Effect sizes, power, and biases in intelligence research: a meta-meta-analysis. Journal of Intelligence, 8(4), 36. doi: 10.3390/jintelligence8040036
paper – OSF

Nuijten, M. B., & Polanin, J. R. (2020). “statcheck”: Automatically detect statistical reporting inconsistencies to increase reproducibility of meta-analyses. Research Synthesis Methods, 11, 574-579. doi: 10.1002/jrsm.1408.
paper

Maassen, E., Van Assen, M. A. L. M., Nuijten, M. B., Olsson-Collentine, A., & Wicherts, J. M. (2020). Reproducibility of individual effect sizes in meta-analyses in psychology. PLoS ONE, 15(5), e0233107. doi: 10.1371/journal.pone.0233107.
paper

2019

Stoevenbelt, A. H., Nuijten, M. B., Pauli, B. E., & Wicherts, J. M. (2019). Rule out conflicts of interest in psychology awards. Nature, 572, 312. doi: 10.1038/d41586-019-02429-3.
paper

Nuijten, M. B. (2019). Practical tools and strategies for researchers to increase replicability. Developmental Medicine & Child Neurology. 61, 535-539. doi: 10.1111/dmcn.14054
paper

2018

Polanin, J. R., & Nuijten, M. B. (2018). Verifying the accuracy of statistical significance testing in Campbell Collaboration systematic reviews through the use of the R package statcheck. Campbell Systematic Reviews, 14(1), 1-36. doi: 10.4073/csrm.2018.1.
paper

Colombo, M., Duev, G., Nuijten, M. B., Sprenger, J. (2018). Statistical reporting inconsistencies in experimental philosophy. PLoS One, 13(4), e0194360. doi: 10.1371/journal.pone.0194360
paper

Nuijten, M. B., Bakker, M., Maassen, E., & Wicherts, J. M. (2018). Verify original results through reanalysis before replicating. Behavioral and Brain Sciences, 41, e143. doi: 10.1017/S0140525X18000791
paper

2017

Nuijten, M. B. (2017). Share analysis plans and results. Nature, 551, 559.
paper

Nuijten, M. B., Borghuis, J., Veldkamp, C. L. S., Dominguez-Alvarez, L., Van Assen, M. A. L. M., & Wicherts, J. M. (2017).  Journal data sharing policies and statistical reporting inconsistencies in psychology. Collabra: Psychology, 3(1), 1-22. doi: 10.1525/collabra.102.
paper – OSF

2016

Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., & Borsboom, D. (2016). Mental disorders as complex networks: An introduction and overview of a network approach to psychopathology. Clinical Neuropsychiatry, 13 (4/5), 68-76.
paper

Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., Costantini, G., & Borsboom, D. (2016). Disturbi mentali come complex network: Un’ introduzione e una panoramica all’ approccio network in psicopatologia. Cognitivismo Clinico, 13 (2), 135-149.
paper

Nuijten, M. B. (2016). Vals positieven: Geen gebrek aan integriteit, maar een teveel aan flexibiliteit. Tijdschrift voor Taalbeheersing, 38 (2), 175-180. doi: 10.5117/TVT2016.2.NUIJ
paper

Hartgerink, C. H. J., Van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M., Van Assen, M. A. L. M. (2016). Distributions of p-values smaller than .05 in Psychology: What is going on? PeerJ, 4, e1935,  doi: 10.7717/peerj.1935
paper

Nuijten, M. B. (2016). Preventing statistical errors in scientific journals. European Science Editing, 42 (1), 8-10.
paper

Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016). The prevalence of statistical reporting errors in psychology (1985-2013). Behavior Research Methods, 48 (4), 1205-1226. doi: 10.3758/s13428-015-0664-2
paper – OSF

2015

Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349 (6251). doi: 10.1126/science.aac4716
paper – OSF

Nuijten, M. B., van Assen, M. A. L. M., Veldkamp, C. L. S., & Wicherts, J. M. (2015). The replication paradox: Combining studies can decrease accuracy of effect size estimate. Review of General Psychology, 19 (2), 172-182. doi: 10.1037/gpr0000034
paper – OSF

Nuijten, M. B., Wetzels, R., Matzke, D., Dolan, C. V., & Wagenmakers, E. J. (2015). A default Bayesian hypothesis test for mediation. Behavior Research Methods, 47, 85-97. doi: 10.3758/s13428-014-0470-2.
paper – OSF

2014

Veldkamp, C. L. S., Nuijten, M. B., Dominguez-Alvarez, L., Van Assen, M. A. L. M., & Wicherts, J. M. (2014).  Statistical reporting errors and collaboration on statistical analyses in psychological science. PLoS One, 9 (12), e114876. doi: 10.1371/journal.pone.0114876
paper – OSF

Nuijten, M. B., van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2014). Standard analyses fail to show that US studies overestimate effect sizes in softer research. PNAS, 111 (7), E712-E713. doi: 10.1073/pnas.1322149111
paper

Van Assen, M. A. L. M., Van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M. (2014). Why publishing everything is more effective than selective publishing of statistically significant results. PLoS One, 9 (1), e84896. doi:10.1371/journal.pone.0084896.
paper

Unpublished Work

Nuijten, M. B., Van Assen, M. A. L. M., Hartgerink, C. H. J., Epskamp, S., & Wicherts, J. M. (2017). The validity of the tool “statcheck” in discovering statistical reporting inconsistencies. PsyArXiv. https://psyarxiv.com/tcxaj/

Books and Book Chapters

Nuijten, M. B. (accepted chapter). Assessing and improving robustness of psychological research findings in four steps. In W. O’Donohue, A. Masuda, and S. Lilienfeld (Eds.), Avoiding questionable practices in applied psychology. Springer.
preprint

Nuijten, M. B. (2020). Efficient scientific self-correction in times of crisis. In E. Aarts, H. Fleuren, M. Sitskoorn & T. Wilthagen (Eds.), The new common (pp. 161-167). Springer. doi: 10.1007/978-3-030-65355-2
chapter

Nuijten, M. B. (2019). Make open data the default. In Science under pressure: Essays on research integrity (pp. 18-25). Publication on occasion of the Dies Natalis 2019 of Tilburg University.
chapter

Nuijten, M. B. (2018). Research on research: a meta-scientific study of problems and solutions in psychological science. Doctoral dissertation.
dissertation

Lunansky, G., Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., & Borsboom, D. (2017). Een symptoom komt nooit alleen: Psychologische stoornissen als complexe netwerken [A symptom never comes alone: Psychological disorders as complex networks]. In E. H. M. Eurelings-Bontekoe, R. Verheul, & W. M. Snellen (Ed.), Handboek persoonlijkheidspathologie [Handbook of Personality Pathology] (pp. 245-266). Houten, The Netherlands: Bohn Stafleu van Loghum.
chapter

R Packages

Epskamp, S. & Nuijten, M. B.  (2014). statcheck: Extract statistics from articles and recompute p values. Retrieved from http://CRAN.R-project.org/package=statcheck. (R package version 1.0.0)

Nuijten, M. B., Wetzels, R., Matzke, D., Dolan, C. V., & Wagenmakers, E.-J. (2014). BayesMed: Default bayesian hypothesis tests for correlation, partial correlation, and mediation. Retrieved from http://CRAN.R-project.org/package=BayesMed. (R package version 1.0.0)

Popular Press

Nuijten, M. B. (2020). Statcheck: een spellingchecker voor statistiek. STAtOR.

Nuijten, M. B. (2017). Journal policies that encourage data sharing prove extremely effective. LSE Impact Blog. URL

Nuijten, M. B. (2017). BayesMed and statcheck. APS Observer. URL

Nuijten, M. B., Deserno, M., Cramer, A. O. J., & Borsboom, D. (2013). Een symptoom komt nooit alleen: Psychologische stoornissen als complexe netwerken. De Psycholoog. PDF

Publicity

Tsang, E., (2019). Innovator Story: Learning from errors. eLife. URL

Adam, D. (2019). How a data detective exposed suspicious medical trials. Nature.  URL

Resnick, B. (2019). The mlitary wants to build a bullshit detector for social science studies. Vox. URL

Heaven, D. (2018). AI peer reviewers unleashed to ease publishing grind. Nature.
URL

Stokstad, E. (2018). This research group seeks to expose weaknesses in scienceand
they’ll step on some toes if they have to. Science. URL

Radio interview about my dissertation for the Dutch radio show “Dr Kelder &
Co”, on NPO Radio 1. URL

Guest on the podcast The Bayes Factor in an episode on organizing and attending
SIPS, open science, and teaching, hosted by Alexander Etz and JP de Ruiter. URL

Singh Chawla, D. (2017). Controversial software is proving surprisingly accurate at spotting errors in psychology papers. Science. URL

Keulen, J. P. (2017). “Onderzoek moet gepubliceerd worden, ongeacht de uitkomst”. New Scientist. URL

Beek, S. (2017). Fouten filteren uit de wetenschap. NEMO KennisLink. URL

McCluskey, B. (2017). Replication: how to address failure. Technologist. URL

Short video on Data Sharing and Open Data for the SPSP Experts video series, created in collaboration with SIPS and the OSF. URL

Guest on the podcast on the Guardian’s Science Weekly Podcast with Hannah Devlin. URL

Guest on the podcast “PLOScast” with Elizabeth Seiver. URL

Guest on the podcast “Everything Hertz” with Dan Quintana and James Heathers. URL

Buranyi, S. (2017). The hi-tech war on science fraud. The Guardian. URL

Nature Editorial (2016). Post-publication criticism is crucial, but should be constructive: In an era of online discussion, debate must remain nuanced and courteous. Nature, 540, 7-8. DOI: 10.1038/540007b. URL

Baker, M. (2016). Stat-checking software stirs up psychology. Nature, 540, 151–152. DOI: 0.1038/540151a. URL

Buranyi, S. (2016). Scientists are worried about `peer review by algorithm’. Motherboard (VICE). URL

Resnick, B. (2016). A bot crawled thousands of studies looking for simple math errors. The results are concerning. Vox. URL

Kershner, K. (2016). Statcheck: when bots `correct’ academics. How Stuff Works.  URL

Keulemans, M. (2016). Worden sociale wetenschappen geterroriseerd door jonge onderzoekers?: Oorlog onder psychologen. De Volkskrant. URL

Baker, M. (2015). Smart software spots statistical errors in psychology papers: One in eight articles contain data-reporting mistakes that affect their conclusions. Nature News. URL

BNR Nieuwsradio (2015). Radiointerview: URL

Vermeulen, M. (2015). ‘Grove onzorgvuldigheden’ in deel psychologische studies: Gevolgen voor uitkomst in 1 op 8 papers. De Volkskrant. URL

Aan de Brugh, M. (2015). Psycholoog tobt met statistiek. NRC Handelsblad. URL

Keulemans, M. (2015). De psychologie van gebrekkig onderzoek. De Volkskrant, 41-43. URL

Huis in ‘t Veld, E. M. J. (2014). Replication Paradox: Met Michèle Nuijten. De Psychonoom, 17-20. PDF

Verbeke, R. (2014). Barsten in betrouwbaarheid. Eos Wetenschap, 28-33. PDF