The Credibility Crisis in Science: Tweakers, Fraudsters, and the Manipulation of Empirical Results

In The Credibility Crisis in Science, leading social scientists Thomas Plper and Eric Neumayer argue that the most important fraudulent strategy is crucially underappreciated. While data fabrication and manipulation are widely recognized as fraudulent, "tweaks"--the intentional selection of research designs and model specifications based on the results they give--are not.
The authors of this book contend that the term "scientific fraud" must include tweaks. Tweakers, like other fraudsters, deceive readers by concealing their manipulation of empirical results and they do so to further their own interests.

The authors show how easily observational data analyses, experimental designs, and causal models are tweaked in ways that are extremely difficult, often impossible, to detect. As a consequence, the credibility crisis in science is even more severe than both scientists and the public believe.

Plper and Neumayer argue that conventional strategies to deter, prevent, and detect fraud will not work for tweaks. The authors put forth two potential solutions: first, a classification system that categorizes data based on its susceptibility to manipulation and the probability of such manipulation being identified, and second, the proposal that journal editors and reviewers, rather than authors, select robustness tests.