Check-all-that-apply (CATA) lists are commonly used in both survey research and sensory science. A related technique, referred to in this paper as applicability scoring, requires respondents to respond positively or negatively to the item of interest – applicability scoring differs from CATA as CATA only requires a check when the item applies to the object being scored. Both hypothesis testing and scale estimation for applicability scoring of sequentially tested products are considered in this paper. For the former, we demonstrate the use of McNemar’s test and for the latter, we present a Thurstonian model. Using applicability scores for scale estimation is important because a connection can then be made to other methods through a common framework, allowing cross-comparison and validation. In addition, applicability scoring provides a sensitive method for assessing product differences and may be particularly useful when an attribute cannot be conveniently expressed in a rating or 2-alternative forced choice (2-AFC) format.
Ennis, D.M., & Ennis, J.M. (2013) Analysis and Thurstonian scaling of applicability scores. Journal of Sensory Studies. 28(3), 188-193..
Colleagues can request this journal article here:
Analysis and Thurstonian scaling of applicability scores
Not a Colleague? Click here to join for free