I am an Assistant Professor at Tilburg University. My research focuses on meta-science, including topics such as replication, publication bias, statistical errors, and questionable research practices.
I am part of the Meta-Research Center at Tilburg University: http://metaresearch.nl.
Work phone: (+31) (0) 13 466 2053
On February 21st 2020, I gave an online talk for the Webcast Series on Transparency from Project TIER on how to efficiently assess and improve the robustness of scientific findings in four steps. The full talk can be found below. More details are posted on the Project TIER website. Also check out the other talks in these series here.
Last month, the QUEST center in Berlin organized the first METAxDATA meeting on building automated screening tools for data-driven meta-research. On the first night of the meeting, 13 researchers gave lightning talks about their tools. The clip below features my <2 minute lightning talk about statcheck.
All lightning talks were recorded and can be found here.
In a comment in Nature that came out today, we address the potential problem of conflicts of interest in psychology awards. We went over the websites of 58 psychological societies, and found that the large majority did not mention any conflict of interest policy with respect to awards. This means we can’t rule out the possibility that recipients of the awards may be closely affiliated with the award committee (e.g., a supervisor selecting his/her PhD student for an award). We urge societies to be open about their award procedures, to avoid the impression of hidden nepotism.
We thank everyone who helped us coding the websites at the 2019 SIPS meeting.
Read the Nature comment here.
Read the working paper here.
Yesterday, I was part of the discussion panel at the “KennisCafé: De Foute Avond”. The KennisCafé is a monthly night at de Balie, Amsterdam, where scientists and other experts discuss a certain topic for a laymen’s audience. This night, the theme was: problems and mistakes in science.
Together with panel members Lotty Hooft (director Cochrane Netherlands), Lex Bouter (professor in scientific integrity and methodology), and Paul Iske (“Chief Failure Officer”), I discussed topics such as statistical mistakes, problems with replication, and possible directions for solutions.
The livestream (in Dutch) can be found here:
The KennisCafé is a production of NEMO Science Museum, KNAW, de Volkskrant, and de Balie. More information can be found here.
I am proud and happy to announce that I was elected Teacher of the Year of Tilburg University.
In teaching, I hold on to a famous Dutch saying: “beter goed gejat, dan slecht bedacht”, or “it’s better to steal something good, than to come up with something bad”. There are so many smart people coming up with innovative, educational tips, tricks, and tools, that it doesn’t make sense (to me) to try and reinvent the wheel.
I’m always trying to improve my teaching and my courses, and I’m incredibly thankful that my students seem to notice that 🙂
Yesterday I was awarded the Tilburg University Dissertation Prize. It is a great honor, but I’m especially grateful because this as a sign that Tilburg University thinks it is good to be critical about the current scientific system, and that open science is an important step forward.
I would like to thank my advisors and collaborators, without whom this dissertation would not exist.
My full dissertation, “Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological Science”, can be downloaded here.
In a recent letter to the editor in the Chronicle, we reply to an earlier article that
presented the open science movement as “burning things to the ground”. We disagreed. We mainly see cooperative, constructive, and pragmatic initiatives to improve the state of psychological science.
Read the full letter here.
Chartier, C. R., Kline, M. E., McCarthy, R. J., Nuijten, M. B., Dunleavy, D. J., & Ledgerwood, A. A cooperative revolution in psychology. The Chronicle of Higher Education.
Our research group, the Meta-Research Center, is featured in a profile in Science Magazine. We talk about our work and our drives to improve psychological research. Read the whole piece here.
At the Solid Science Workshop in Bordeaux (September 6-7, 2018), I gave a workshop about free software to facilitate solid research practices. During this workshop, we collaboratively worked on a list of resources/software/tools that can be used to improve different stages of the research process.
Check out the list, share it with colleagues, or add your own resources to it here: https://bit.ly/opensciencesoftware.
The slides of the workshop can be found here: https://osf.io/s8wpz/.
I wrote an invited review for Developmental Medicine & Child Neurology about “Practical tools and strategies for researchers to increase replicability”.
Problems with replicability have been widely discussed over the last years, especially in psychology. By now, a lot of promising solutions have been proposed, but my sense is that researchers are sometimes a bit overwhelmed by all the possibilities.
My goal in this review was to make a list of some of the current recommendations that can be easily implemented. Not every solutions is always feasible for every project, so my advice is: copy best practices from other fields, see what works on a case-by-case basis, and improve your research step by step.
The preprint can be found here: https://psyarxiv.com/emyux.