The Two-Out-of-Five test is a method of unspecified difference testing. Although its low guessing probability (1/10) gives promise that it might have high power, the theoretical underpinnings of the method have not yet been investigated. In this article, we offer the first such investigation, via Thurstonian analysis. This investigation reveals that the standard form of the Two-Out-of-Five test is more statistically powerful than the Triangle test, but not as powerful as the Tetrad test. We then propose a new way of scoring Two-Out-of-Five data that yields a test with higher power and lower sample size requirements than the Tetrad test, under the assumption that there is no additional noise from the evaluation of an additional stimulus. This last result is achieved without any experimental modification of the Two-Out-of-Five protocol. Tables for estimating the Thurstonian measure of sensory effect size, d, for calculating the error in such estimates, and for recommended sample sizes are given. Finally, caution is given against incorrect instructions in the Two-Out-of-Five test – if respondents are asked simply to identify the two most similar samples, the resulting test has almost no power.
Ennis, J. M. (2013). A Thurstonian Analysis of the Two-Out-of-Five Test. Journal of Sensory Studies, 28, 297-310.
Colleagues can request this journal article here:
A Thurstonian Analysis of the Two-Out-of-Five Test
Not a Colleague? Click here to join for free.