Nature published a series of comments all focused on ways to fix our statistics. In my comment, I argue that the main problem is the flexibility in data analysis, combined with incentives to find significant results. A possible solution would be to preregister analysis plans, and to share data.
Read the entire piece here, for the following set of solutions:
- Jeff Leek: Adjust for human cognition
- Blake McShane, Andrew Gelman, David Gal, Christian Robert, and Jennifer Tackett: Abandon statistical significance
- David Colquhoun: State false-positive risk, too
- Michèle Nuijten: Share analysis plans and results
- Steven Goodman: Change norms from within