A critical comment on residual tests in the analysis of planned contrasts

Richter, M A critical comment on residual tests in the analysis of planned contrasts. Psychological Methods. ISSN 1939-1463 (Accepted)

Warning
There is a more recent version of this item available.
[thumbnail of Richter_2015_PsychologicalMethods_GOA.pdf]
Preview
Text
Richter_2015_PsychologicalMethods_GOA.pdf - Accepted Version

Download (305kB) | Preview

Abstract

It is current practice that researchers testing specific, theory-driven predictions do not only use a planned contrast to model and test their hypotheses but also test the residual variance (the C+R approach). This analysis strategy relies on work by Abelson and Prentice (1997) who suggested that the result of a planned contrast needs to be interpreted in the light of the variance that is left after the variance explained by the contrast has been subtracted from the variance explained by the factors of the statistical model. Unfortunately, the C+R approach leads to six fundamental problems. In particular, the C+R approach (1) relies on the interpretation of a non-significant result as evidence for no effect, (2) neglects the impact of sample size, (3) creates problems for a priori power analyses, (4) may lead to significant effects that lack a meaningful interpretation, (5) may give rise to misinterpretations, and (6) is inconsistent with the interpretation of other statistical analyses. Given these flaws, researchers should refrain from testing the residual variance when conducting planned contrasts. Single contrasts, Bayes factors, and likelihood ratios provide reasonable alternatives that are less problematic

Item Type: Article
Additional Information: This article may not exactly replicate the final version published in the APA journal. It is not the copy of record.
Subjects: B Philosophy. Psychology. Religion > BF Psychology
Divisions: Natural Sciences and Psychology (closed 31 Aug 19)
Publisher: American Psychological Association
Date of acceptance: 1 March 2015
Date of first compliant Open Access: 11 November 2015
Date Deposited: 09 Jul 2015 10:31
Last Modified: 04 Sep 2021 14:13
URI: https://ljmu-9.eprints-hosting.org/id/eprint/1539

Available Versions of this Item

View Item View Item