There are so many ways that science can go wrong (by scientists) that it’s a wonder that any science gets done at all.
This is even before the problems of interference by finance and politics.
How science can go wrong:
- Rejection of outliers (eg. delayed the discovery of the ozone hole) https://en.wikipedia.org/wiki/Outlier
- Cherry picking data https://en.wikipedia.org/wiki/Cherry_picking
- Low-hanging fruit
- https://en.wikipedia.org/wiki/Streetlight_effect
- https://en.wikipedia.org/wiki/Texas_sharpshooter_fallacy
- Feud (eg. Cope vs Marsh)
- https://en.wikipedia.org/wiki/Id%C3%A9e_fixe_(psychology)
- https://en.wikipedia.org/wiki/Confirmation_bias
- Seeing things that aren’t there (eg. cold fusion, inkblot test, free quarks)
- Martian nanobes ALH84001 (ask me for details)
- False analogy
- “What I tell you three times is true” (how we learn)
- Accept as true what I fail to disprove
- Hoop jumping necessary for publication
- Lack of confidence
- Overconfidence
- Failure to see an alternative
- Delay in acceptance
- Holding onto a disproved idea (eg. Hoyle’s steady state)
- Bias of editors
- A little knowledge is a dangerous thing
- Knee-jerk reaction
- Lack of caring by reviewers
- Valid conclusion rejected because methods are suboptimal
- Proliferation of jargon
- “It’s been done before”
- P-value = miscalculated significance
- Time constraints
- Murphy’s Law (eg. “under the most carefully controlled conditions, the organism will do whatever it damn well pleases)
- Distraction
- “Failure is always an option”
- Inadequate quality control (eg. contamination)
- In chemistry, inability to purify
- Known errors become so familiar that they’re ignored (eg. fluid mechanics)
- Stability vs accuracy
- Correlation does not imply causation
- Small thinking
- Thinking that one possibility is the only possibility
- The right answer to the wrong question
- Inappropriate use of Occam’s razor
- Too hard basket
- Gaps in old work never filled in (eg. mesons and baryons)
- No repetition, failure to independently confirm
With all these innate problems, it’s a minor miracle that any good science ever gets done.