*OSF = Supplemental materials on Open Science Framework
2024
Nuijten, M. B. & Wicherts, J. M. (accepted manuscript). Implementing statcheck during peer review is related to a steep decline in statistical reporting errors. Advances in Methods and Practices in Psychological Science.
2023
Maassen, E., D’Urso, E. D., van Assen, M. A. L. M., Nuijten, M. B., De Roover, K., & Wicherts, J. M. (2023). The dire disregard of measurement invariance testing in psychological science. Psychological Methods. Advance online publication. doi: 10.1037/met0000624
Van Aert, R. C. M., Nuijten, M. B.*, Olsson-Collentine, J. A. E., Stoevenbelt, A. H., Van den Akker, O. R., Klein, R. A., & Wicherts, J. M. (2023). Comparing the prevalence of statistical reporting inconsistencies in COVID-19 preprints and matched controls: A Registered Report. Royal Society Open Science, 10, 202326. doi: 10.1098/rsos.202326
*shared first authorship
Van Assen, M. A. L. M., Van den Akker, O., Augusteijn, H. E. M., Bakker, M., Nuijten, M. B., Olsson-Collentine, A., … van Aert, R. C. M. (in press). The meta-plot: A graphical tool for interpreting the results of a meta-analysis. Zeitschrift für Psychologie, 231 (1), 65-78. doi: 10.1027/2151-2604/a000513
2022
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Almenberg, A. D., Fidler, F., Hilgard, J., Kline, M., Nuijten, M. B., Rohrer, J. M., Romero, F., Scheel, A. M., Scherer, L., Schönbrodt, F., & Vazire, S. (2022). Replicability, robustness, and reproducibility in psychological science. Annual Review of Psychology, 73, 719-748. doi: 10.1146/annurev-psych-020821-114157
paper – preprint – OSF
2021
Hardwicke, T. E., Szucs D., Thibault, R. T., Crüwell, S., van den Akker, O. R., Nuijten, M. B., & Ioannidis, J. P. A. (2021). Citation patterns following a strongly contradictory replication result: Four case studies from psychology. Advances in Methods and Practices in Psychological Science, 4, 1-14. doi: 10.1177/25152459211040837
paper – preprint – OSF
Tijdink, J., Horbach, S. P. J. M., Nuijten, M. B., & O’Neill, G., (2021). Towards a research agenda for promoting responsible research practices. Journal of Empirical Research on Human Research Ethics. doi: 10.1177/15562646211018916
paper
Hardwicke, T. E., Bohn, M., MacDonald, K., Hembacher, E., Nuijten, M. B., Peloquin, B. N., . . . Frank, M. C. (2021). Analytic reproducibility in articles receiving open data badges at the journal Psychological Science: an observational study. Royal Society Open Science, 8, 201494. doi: 10.1098/rsos.201494
paper – OSF
2020
Nuijten, M. B., Van Assen, M. A. L. M., Augusteijn, H. E. M., Crompvoets, E. A. V., & Wicherts, J. M. (2020). Effect sizes, power, and biases in intelligence research: a meta-meta-analysis. Journal of Intelligence, 8(4), 36. doi: 10.3390/jintelligence8040036
paper – OSF
Nuijten, M. B., & Polanin, J. R. (2020). “statcheck”: Automatically detect statistical reporting inconsistencies to increase reproducibility of meta-analyses. Research Synthesis Methods, 11, 574-579. doi: 10.1002/jrsm.1408.
paper
Maassen, E., Van Assen, M. A. L. M., Nuijten, M. B., Olsson-Collentine, A., & Wicherts, J. M. (2020). Reproducibility of individual effect sizes in meta-analyses in psychology. PLoS ONE, 15(5), e0233107. doi: 10.1371/journal.pone.0233107.
paper
2019
Stoevenbelt, A. H., Nuijten, M. B., Pauli, B. E., & Wicherts, J. M. (2019). Rule out conflicts of interest in psychology awards. Nature, 572, 312. doi: 10.1038/d41586-019-02429-3.
paper
Nuijten, M. B. (2019). Practical tools and strategies for researchers to increase replicability. Developmental Medicine & Child Neurology. 61, 535-539. doi: 10.1111/dmcn.14054
paper
2018
Polanin, J. R., & Nuijten, M. B. (2018). Verifying the accuracy of statistical significance testing in Campbell Collaboration systematic reviews through the use of the R package statcheck. Campbell Systematic Reviews, 14(1), 1-36. doi: 10.4073/csrm.2018.1.
paper
Colombo, M., Duev, G., Nuijten, M. B., Sprenger, J. (2018). Statistical reporting inconsistencies in experimental philosophy. PLoS One, 13(4), e0194360. doi: 10.1371/journal.pone.0194360
paper
Nuijten, M. B., Bakker, M., Maassen, E., & Wicherts, J. M. (2018). Verify original results through reanalysis before replicating. Behavioral and Brain Sciences, 41, e143. doi: 10.1017/S0140525X18000791
paper
2017
Nuijten, M. B. (2017). Share analysis plans and results. Nature, 551, 559.
paper
Nuijten, M. B., Borghuis, J., Veldkamp, C. L. S., Dominguez-Alvarez, L., Van Assen, M. A. L. M., & Wicherts, J. M. (2017). Journal data sharing policies and statistical reporting inconsistencies in psychology. Collabra: Psychology, 3(1), 1-22. doi: 10.1525/collabra.102.
paper – OSF
2016
Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., & Borsboom, D. (2016). Mental disorders as complex networks: An introduction and overview of a network approach to psychopathology. Clinical Neuropsychiatry, 13 (4/5), 68-76.
paper
Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., Costantini, G., & Borsboom, D. (2016). Disturbi mentali come complex network: Un’ introduzione e una panoramica all’ approccio network in psicopatologia. Cognitivismo Clinico, 13 (2), 135-149.
paper
Nuijten, M. B. (2016). Vals positieven: Geen gebrek aan integriteit, maar een teveel aan flexibiliteit. Tijdschrift voor Taalbeheersing, 38 (2), 175-180. doi: 10.5117/TVT2016.2.NUIJ
paper
Hartgerink, C. H. J., Van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M., Van Assen, M. A. L. M. (2016). Distributions of p-values smaller than .05 in Psychology: What is going on? PeerJ, 4, e1935, doi: 10.7717/peerj.1935
paper
Nuijten, M. B. (2016). Preventing statistical errors in scientific journals. European Science Editing, 42 (1), 8-10.
paper
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016). The prevalence of statistical reporting errors in psychology (1985-2013). Behavior Research Methods, 48 (4), 1205-1226. doi: 10.3758/s13428-015-0664-2
paper – OSF
2015
Open Science Collaboration (2015). Estimating the reproducibility of psychological science. Science, 349 (6251). doi: 10.1126/science.aac4716
paper – OSF
Nuijten, M. B., van Assen, M. A. L. M., Veldkamp, C. L. S., & Wicherts, J. M. (2015). The replication paradox: Combining studies can decrease accuracy of effect size estimate. Review of General Psychology, 19 (2), 172-182. doi: 10.1037/gpr0000034
paper – OSF
Nuijten, M. B., Wetzels, R., Matzke, D., Dolan, C. V., & Wagenmakers, E. J. (2015). A default Bayesian hypothesis test for mediation. Behavior Research Methods, 47, 85-97. doi: 10.3758/s13428-014-0470-2.
paper – OSF
2014
Veldkamp, C. L. S., Nuijten, M. B., Dominguez-Alvarez, L., Van Assen, M. A. L. M., & Wicherts, J. M. (2014). Statistical reporting errors and collaboration on statistical analyses in psychological science. PLoS One, 9 (12), e114876. doi: 10.1371/journal.pone.0114876
paper – OSF
Nuijten, M. B., van Assen, M. A. L. M., van Aert, R. C. M., & Wicherts, J. M. (2014). Standard analyses fail to show that US studies overestimate effect sizes in softer research. PNAS, 111 (7), E712-E713. doi: 10.1073/pnas.1322149111
paper
Van Assen, M. A. L. M., Van Aert, R. C. M., Nuijten, M. B., Wicherts, J. M. (2014). Why publishing everything is more effective than selective publishing of statistically significant results. PLoS One, 9 (1), e84896. doi:10.1371/journal.pone.0084896.
paper
Unpublished Work
Nuijten, M. B., Van Assen, M. A. L. M., Hartgerink, C. H. J., Epskamp, S., & Wicherts, J. M. (2017). The validity of the tool “statcheck” in discovering statistical reporting inconsistencies. PsyArXiv. https://psyarxiv.com/tcxaj/
Books and Book Chapters
Nuijten, M. B. (2022). Assessing and improving robustness of psychological research findings in four steps. In W. O’Donohue, A. Masuda, and S. Lilienfeld (Eds.), Avoiding questionable practices in applied psychology (pp. 379-400). Springer. doi: 10.1007/978-3-031-04968-2_17
chapter
Nuijten, M. B. (2020). Efficient scientific self-correction in times of crisis. In E. Aarts, H. Fleuren, M. Sitskoorn & T. Wilthagen (Eds.), The new common (pp. 161-167). Springer. doi: 10.1007/978-3-030-65355-2
chapter
Nuijten, M. B. (2019). Make open data the default. In Science under pressure: Essays on research integrity (pp. 18-25). Publication on occasion of the Dies Natalis 2019 of Tilburg University.
chapter
Nuijten, M. B. (2018). Research on research: a meta-scientific study of problems and solutions in psychological science. Doctoral dissertation.
dissertation
Lunansky, G., Nuijten, M. B., Deserno, M. K., Cramer, A. O. J., & Borsboom, D. (2017). Een symptoom komt nooit alleen: Psychologische stoornissen als complexe netwerken [A symptom never comes alone: Psychological disorders as complex networks]. In E. H. M. Eurelings-Bontekoe, R. Verheul, & W. M. Snellen (Ed.), Handboek persoonlijkheidspathologie [Handbook of Personality Pathology] (pp. 245-266). Houten, The Netherlands: Bohn Stafleu van Loghum.
chapter
R Packages
Epskamp, S. & Nuijten, M. B. (2014). statcheck: Extract statistics from articles and recompute p values. Retrieved from http://CRAN.R-project.org/package=statcheck. (R package version 1.0.0)
Nuijten, M. B., Wetzels, R., Matzke, D., Dolan, C. V., & Wagenmakers, E.-J. (2014). BayesMed: Default bayesian hypothesis tests for correlation, partial correlation, and mediation. Retrieved from http://CRAN.R-project.org/package=BayesMed. (R package version 1.0.0)
Popular Press
Nuijten, M. B. (2020). Statcheck: een spellingchecker voor statistiek. STAtOR.
Nuijten, M. B. (2017). Journal policies that encourage data sharing prove extremely effective. LSE Impact Blog. URL
Nuijten, M. B. (2017). BayesMed and statcheck. APS Observer. URL
Nuijten, M. B., Deserno, M., Cramer, A. O. J., & Borsboom, D. (2013). Een symptoom komt nooit alleen: Psychologische stoornissen als complexe netwerken. De Psycholoog. PDF
Publicity
Tsang, E., (2019). Innovator Story: Learning from errors. eLife. URL
Adam, D. (2019). How a data detective exposed suspicious medical trials. Nature. URL
Resnick, B. (2019). The mlitary wants to build a bullshit detector for social science studies. Vox. URL
Heaven, D. (2018). AI peer reviewers unleashed to ease publishing grind. Nature.
URL
Stokstad, E. (2018). This research group seeks to expose weaknesses in scienceand
they’ll step on some toes if they have to. Science. URL
Radio interview about my dissertation for the Dutch radio show “Dr Kelder &
Co”, on NPO Radio 1. URL
Guest on the podcast The Bayes Factor in an episode on organizing and attending
SIPS, open science, and teaching, hosted by Alexander Etz and JP de Ruiter. URL
Singh Chawla, D. (2017). Controversial software is proving surprisingly accurate at spotting errors in psychology papers. Science. URL
Keulen, J. P. (2017). “Onderzoek moet gepubliceerd worden, ongeacht de uitkomst”. New Scientist. URL
Beek, S. (2017). Fouten filteren uit de wetenschap. NEMO KennisLink. URL
McCluskey, B. (2017). Replication: how to address failure. Technologist. URL
Short video on Data Sharing and Open Data for the SPSP Experts video series, created in collaboration with SIPS and the OSF. URL
Guest on the podcast on the Guardian’s Science Weekly Podcast with Hannah Devlin. URL
Guest on the podcast “PLOScast” with Elizabeth Seiver. URL
Guest on the podcast “Everything Hertz” with Dan Quintana and James Heathers. URL
Buranyi, S. (2017). The hi-tech war on science fraud. The Guardian. URL
Nature Editorial (2016). Post-publication criticism is crucial, but should be constructive: In an era of online discussion, debate must remain nuanced and courteous. Nature, 540, 7-8. DOI: 10.1038/540007b. URL
Baker, M. (2016). Stat-checking software stirs up psychology. Nature, 540, 151–152. DOI: 0.1038/540151a. URL
Buranyi, S. (2016). Scientists are worried about `peer review by algorithm’. Motherboard (VICE). URL
Resnick, B. (2016). A bot crawled thousands of studies looking for simple math errors. The results are concerning. Vox. URL
Kershner, K. (2016). Statcheck: when bots `correct’ academics. How Stuff Works. URL
Keulemans, M. (2016). Worden sociale wetenschappen geterroriseerd door jonge onderzoekers?: Oorlog onder psychologen. De Volkskrant. URL
Baker, M. (2015). Smart software spots statistical errors in psychology papers: One in eight articles contain data-reporting mistakes that affect their conclusions. Nature News. URL
BNR Nieuwsradio (2015). Radiointerview: URL
Vermeulen, M. (2015). ‘Grove onzorgvuldigheden’ in deel psychologische studies: Gevolgen voor uitkomst in 1 op 8 papers. De Volkskrant. URL
Aan de Brugh, M. (2015). Psycholoog tobt met statistiek. NRC Handelsblad. URL
Keulemans, M. (2015). De psychologie van gebrekkig onderzoek. De Volkskrant, 41-43. URL
Huis in ‘t Veld, E. M. J. (2014). Replication Paradox: Met Michèle Nuijten. De Psychonoom, 17-20. PDF
Verbeke, R. (2014). Barsten in betrouwbaarheid. Eos Wetenschap, 28-33. PDF
Michèle B. Nuijten 