Theory of conjoint measurement


The theory of conjoint measurement is a general, formal theory of continuous quantity. It was independently discovered by the French economist Gérard Debreu and by the American mathematical psychologist R. Duncan Luce and statistician John Tukey.
The theory concerns the situation where at least two natural attributes, A and X, non-interactively relate to a third attribute, P. It is not required that A, X or P are known to be quantities. Via specific relations between the levels of P, it can be established that P, A and X are continuous quantities. Hence the theory of conjoint measurement can be used to quantify attributes in empirical circumstances where it is not possible to combine the levels of the attributes using a side-by-side operation or concatenation. The quantification of psychological attributes such as attitudes, cognitive abilities and utility is therefore logically plausible. This means that the scientific measurement of psychological attributes is possible. That is, like physical quantities, a magnitude of a psychological quantity may possibly be expressed as the product of a real number and a unit magnitude.
Application of the theory of conjoint measurement in psychology, however, has been limited. It has been argued that this is due to the high level of formal mathematics involved and that the theory cannot account for the "noisy" data typically discovered in psychological research. It has been argued that the Rasch model is a stochastic variant of the theory of conjoint measurement, however, this has been disputed. Order restricted methods for conducting probabilistic tests of the cancellation axioms of conjoint measurement have been developed in the past decade.
The theory of conjoint measurement is related to conjoint analysis, which is a statistical-experiments methodology employed in marketing to estimate the parameters of additive utility functions. Different multi-attribute stimuli are presented to respondents, and different methods are used to measure their preferences about the presented stimuli. The coefficients of the utility function are estimated using alternative regression-based tools.

Historical overview

In the 1930s, the British Association for the Advancement of Science established the Ferguson Committee to investigate the possibility of psychological attributes being measured scientifically. The British physicist and measurement theorist Norman Robert Campbell was an influential member of the committee. In its Final Report, Campbell and the Committee concluded that because psychological attributes were not capable of sustaining concatenation operations, such attributes could not be continuous quantities. Therefore, they could not be measured scientifically. This had important ramifications for psychology, the most significant of these being the creation in 1946 of the operational theory of measurement by Harvard psychologist Stanley Smith Stevens. Stevens' non-scientific theory of measurement is widely held as definitive in psychology and the behavioural sciences generally.
Whilst the German mathematician Otto Hölder anticipated features of the theory of conjoint measurement, it was not until the publication of Luce & Tukey's seminal 1964 paper that the theory received its first complete exposition. Luce & Tukey's presentation was algebraic and is therefore considered more general than Debreu's topological work, the latter being a special case of the former. In the first article of the inaugural issue of the Journal of Mathematical Psychology, proved that via the theory of conjoint measurement, attributes not capable of concatenation could be quantified. N.R. Campbell and the Ferguson Committee were thus proven wrong. That a given psychological attribute is a continuous quantity is a logically coherent and empirically testable hypothesis.
Appearing in the next issue of the same journal were important papers by Dana Scott, who proposed a hierarchy of cancellation conditions for the indirect testing of the solvability and Archimedean axioms, and David Krantz who connected the Luce & Tukey work to that of Hölder.
Work soon focused on extending the theory of conjoint measurement to involve more than just two attributes. and Amos Tversky developed what became known as polynomial conjoint measurement, with providing a schema with which to construct conjoint measurement structures of three or more attributes. Later, the theory of conjoint measurement received a thorough and highly technical treatment with the publication of the first volume of Foundations of Measurement, which Krantz, Luce, Tversky and philosopher Patrick Suppes cowrote.
Shortly after the publication of Krantz, et al.,, work focused upon developing an "error theory" for the theory of conjoint measurement. Studies were conducted into the number of conjoint arrays that supported only single cancellation and both single and double cancellation. Later enumeration studies focused on polynomial conjoint measurement. These studies found that it is highly unlikely that the axioms of the theory of conjoint measurement are satisfied at random, provided that more than three levels of at least one of the component attributes has been identified.
Joel Michell later identified that the "no test" class of tests of the double cancellation axiom was empty. Any instance of double cancellation is thus either an acceptance or a rejection of the axiom. Michell also wrote at this time a non-technical introduction to the theory of conjoint measurement which also contained a schema for deriving higher order cancellation conditions based upon Scott's work. Using Michell's schema, Ben Richards discovered that some instances of the triple cancellation axiom are "incoherent" as they contradict the single cancellation axiom. Moreover, he identified many instances of the triple cancellation which are trivially true if double cancellation is supported.
The axioms of the theory of conjoint measurement are not stochastic; and given the ordinal constraints placed on data by the cancellation axioms, order restricted inference methodology must be used. George Karabatsos and his associates developed a Bayesian Markov chain Monte Carlo methodology for psychometric applications. Karabatsos & Ullrich 2002 demonstrated how this framework could be extended to polynomial conjoint structures. Karabatsos generalised this work with his multinomial Dirichlet framework, which enabled the probabilistic testing of many non-stochastic theories of mathematical psychology. More recently, Clintin Davis-Stober developed a frequentist framework for order restricted inference that can also be used to test the cancellation axioms.
Perhaps the most notable use of the theory of conjoint measurement was in the prospect theory proposed by the Israeli – American psychologists Daniel Kahneman and Amos Tversky. Prospect theory was a theory of decision making under risk and uncertainty which accounted for choice behaviour such as the Allais Paradox. David Krantz wrote the formal proof to prospect theory using the theory of conjoint measurement. In 2002, Kahneman received the Nobel Memorial Prize in Economics for prospect theory.

Measurement and quantification

The classical / standard definition of measurement

In physics and metrology, the standard definition of measurement is the estimation of the ratio between a magnitude of a continuous quantity and a unit magnitude of the same kind. For example, the statement "Peter's hallway is 4 m long" expresses a measurement of an hitherto unknown length magnitude as the ratio of the unit to the length of the hallway. The number 4 is a real number in the strict mathematical sense of this term.
For some other quantities, invariant are ratios between attribute differences. Consider temperature, for example. In the familiar everyday instances, temperature is measured using instruments calibrated in either the Fahrenheit or Celsius scales. What are really being measured with such instruments are the magnitudes of temperature differences. For example, Anders Celsius defined the unit of the Celsius scale to be 1/100th of the difference in temperature between the freezing and boiling points of water at sea level. A midday temperature measurement of 20 degrees Celsius is simply the difference of the midday temperature and the temperature of the freezing water divided by the difference of the Celsius unit and the temperature of the freezing water.
Formally expressed, a scientific measurement is:
where Q is the magnitude of the quantity, r is a real number and is a unit magnitude of the same kind.

Extensive and intensive quantity

Length is a quantity for which natural concatenation operations exist. That is, we can combine in a side-by-side fashion lengths of rigid steel rods, for example, such that the additive relations between lengths is readily observed. If we have four 1 m lengths of such rods, we can place them end to end to produce a length of 4 m. Quantities capable of concatenation are known as extensive quantities and include mass, time, electrical resistance and plane angle. These are known as base quantities in physics and metrology.
Temperature is a quantity for which there is an absence of concatenation operations. We cannot pour a volume of water of temperature 40 °C into another bucket of water at 20 °C and expect to have a volume of water with a temperature of 60 °C. Temperature is therefore an intensive quantity.
Psychological attributes, like temperature, are considered to be intensive as no way of concatenating such attributes has been found. But this is not to say that such attributes are not quantifiable. The theory of conjoint measurement provides a theoretical means of doing this.

Theory

Consider two natural attributes A, and X. It is not known that either A or X is a continuous quantity, or that both of them are. Let a, b, and c represent three independent, identifiable levels of A; and let x, y and z represent three independent, identifiable levels of X. A third attribute, P, consists of the nine ordered pairs of levels of A and X. That is,,,..., . The quantification of A, X and P depends upon the behaviour of the relation holding upon the levels of P. These relations are presented as axioms in the theory of conjoint measurement.

Single cancellation or independence axiom

The single cancellation axiom is as follows. The relation upon P satisfies single cancellation if and only if for all a and b in A, and x in X, > is implied for every w in X such that >. Similarly, for all x and y in X and a in A, > is implied for every d in A such that >. What this means is that if any two levels, a, b, are ordered, then this order holds irrespective of each and every level of X. The same holds for any two levels, x and y of X with respect to each and every level of A.
Single cancellation is so-called because a single common factor of two levels of P cancel out to leave the same ordinal relationship holding on the remaining elements. For example, a cancels out of the inequality > as it is common to both sides, leaving x > y. Krantz, et al., originally called this axiom independence, as the ordinal relation between two levels of an attribute is independent of any and all levels of the other attribute. However, given that the term independence causes confusion with statistical concepts of independence, single cancellation is the preferable term. Figure One is a graphical representation of one instance of single cancellation.
Satisfaction of the single cancellation axiom is necessary, but not sufficient, for the quantification of attributes A and X. It only demonstrates that the levels of A, X and P are ordered. Informally, single cancellation does not sufficiently constrain the order upon the levels of P to quantify A and X. For example, consider the ordered pairs, and. If single cancellation holds then > and >. Hence via transitivity >. The relation between these latter two ordered pairs, informally a left-leaning diagonal, is determined by the satisfaction of the single cancellation axiom, as are all the "left leaning diagonal" relations upon P.

Double cancellation axiom

Single cancellation does not determine the order of the "right-leaning diagonal" relations upon P. Even though by transitivity and single cancellation it was established that >, the relationship between and remains undetermined. It could be that either > or > and such ambiguity cannot remain unresolved.
The double cancellation axiom concerns a class of such relations upon P in which the common terms of two antecedent inequalities cancel out to produce a third inequality. Consider the instance of double cancellation graphically represented by Figure Two. The antecedent inequalities of this particular instance of double cancellation are:
and
Given that:
is true if and only if and
is true if and only if, it follows that:
Cancelling the common terms results in:
Hence double cancellation can only obtain when A and X are quantities.
Double cancellation is satisfied if and only if the consequent inequality does not contradict the antecedent inequalities. For example, if the consequent inequality above was:
then double cancellation would be violated and it could not be concluded that A and X are quantities.
Double cancellation concerns the behaviour of the "right leaning diagonal" relations on P as these are not logically entailed by single cancellation. discovered that when the levels of A and X approach infinity, then the number of right leaning diagonal relations is half of the number of total relations upon P. Hence if A and X are quantities, half of the number of relations upon P are due to ordinal relations upon A and X and half are due to additive relations upon A and X.
The number of instances of double cancellation is contingent upon the number of levels identified for both A and X. If there are n levels of A and m of X, then the number of instances of double cancellation is n! × m!. Therefore, if n = m = 3, then 3! × 3! = 6 × 6 = 36 instances in total of double cancellation. However, all but 6 of these instances are trivially true if single cancellation is true, and if any one of these 6 instances is true, then all of them are true. One such instance is that shown in Figure Two. calls this a Luce–Tukey instance of double cancellation.
If single cancellation has been tested upon a set of data first and is established, then only the Luce–Tukey instances of double cancellation need to be tested. For n levels of A and m of X, the number of Luce–Tukey double cancellation instances is. For example, if n = m = 4, then there are 16 such instances. If n = m = 5 then there are 100. The greater the number of levels in both A and X, the less probable it is that the cancellation axioms are satisfied at random and the more stringent test of quantity the application of conjoint measurement becomes.

Solvability and Archimedean axioms

The single and double cancellation axioms by themselves are not sufficient to establish continuous quantity. Other conditions must also be introduced to ensure continuity. These are the solvability and Archimedean conditions.
Solvability means that for any three elements of a, b, x and y, the fourth exists such that the equation a x = b y is solved, hence the name of the condition. Solvability essentially is the requirement that each level P has an element in A and an element in X. Solvability reveals something about the levels of A and X — they are either dense like the real numbers or equally spaced like the integers.
The Archimedean condition is as follows. Let I be a set of consecutive integers, either finite or infinite, positive or negative. The levels of A form a standard sequence if and only if there exists x and y in X where x ≠ y and for all integers i and i + 1 in I:
What this basically means is that if x is greater than y, for example, there are levels of A which can be found which makes two relevant ordered pairs, the levels of P, equal.
The Archimedean condition argues that there is no infinitely greatest level of P and so hence there is no greatest level of either A or X. This condition is a definition of continuity given by the ancient Greek mathematician Archimedes whom wrote that "Further, of unequal lines, unequal surfaces, and unequal solids, the greater exceeds the less by such a magnitude as, when added to itself, can be made to exceed any assigned magnitude among those which are comparable with one another ". Archimedes recognised that for any two magnitudes of a continuous quantity, one being lesser than the other, the lesser could be multiplied by a whole number such that it equalled the greater magnitude. Euclid stated the Archimedean condition as an axiom in Book V of the Elements, in which Euclid presented his theory of continuous quantity and measurement.
As they involve infinitistic concepts, the solvability and Archimedean axioms are not amenable to direct testing in any finite empirical situation. But this does not entail that these axioms cannot be empirically tested at all. Scott's finite set of cancellation conditions can be used to indirectly test these axioms; the extent of such testing being empirically determined. For example, if both A and X possess three levels, the highest order cancellation axiom within Scott's hierarchy that indirectly tests solvability and Archimedeaness is double cancellation. With four levels it is triple cancellation. If such tests are satisfied, the construction of standard sequences in differences upon A and X are possible. Hence these attributes may be dense as per the real numbers or equally spaced as per the integers. In other words, A and X are continuous quantities.

Relation to the scientific definition of measurement

Satisfaction of the conditions of conjoint measurement means that measurements of the levels of A and X can be expressed as either ratios between magnitudes or ratios between magnitude differences. It is most commonly interpreted as the latter, given that most behavioural scientists consider that their tests and surveys "measure" attributes on so-called "interval scales". That is, they believe tests do not identify absolute zero levels of psychological attributes.
Formally, if P, A and X form an additive conjoint structure, then there exist functions from A and X into the real numbers such that for a and b in A and x and y in X:
If and are two other real valued functions satisfying the above expression, there exist and real valued constants satisfying:
That is, and are measurements of A and X unique up to affine transformation. The mathematical proof of this result is given in.
This means that the levels of A and X are magnitude differences measured relative to some kind of unit difference. Each level of P is a difference between the levels of A and X. However, it is not clear from the literature as to how a unit could be defined within an additive conjoint context. proposed a scaling method for conjoint structures but he also did not discuss the unit.
The theory of conjoint measurement, however, is not restricted to the quantification of differences. If each level of P is a product of a level of A and a level of X, then P is another different quantity whose measurement is expressed as a magnitude of A per unit magnitude of X. For example, A consists of masses and X consists of volumes, then P consists of densities measured as mass per unit of volume. In such cases, it would appear that one level of A and one level of X must be identified as a tentative unit prior to the application of conjoint measurement.
If each level of P is the sum of a level of A and a level of X, then P is the same quantity as A andX. For example, A and X are lengths so hence must be P. All three must therefore be expressed in the same unit. In such cases, it would appear that a level of either A or X must be tentatively identified as the unit. Hence it would seem that application of conjoint measurement requires some prior descriptive theory of the relevant natural system.

Applications of conjoint measurement

Empirical applications of the theory of conjoint measurement have been sparse.
Several empirical evaluations of the double cancellation have been conducted. Among these, evaluated the axiom to the psychophysics of binaural loudness. They found the double cancellation axiom was rejected. conducted a similar investigation and replicated Levelt, et al.' findings. observed that the evaluation of double
cancellation involves considerable redundancy that complicates its empirical testing. Therefore, evaluated instead the equivalent Thomsen condition axiom, which avoids this redundancy, and found the property supported in binaural loudness., summarized the literature to that date, including the observation that the evaluation of the Thomsen Condition also involves an empirical challenge that they find remedied by the conjoint commutativity axiom, which they show to be equivalent to the Thomsen Condition. found conjoint commutativity supported for binaural loudness and brightness.
applied the theory to L. L. Thurstone's theory of paired comparisons, multidimensional scaling and Coombs' theory of unidimensional unfolding. He found support of the cancellation axioms only with Coombs' theory. However, the statistical techniques employed by Michell in testing Thurstone's theory and multidimensional scaling did not take into consideration the ordinal constraints imposed by the cancellation axioms.
, Kyngdon, Michell and tested the cancellation axioms of upon the interstimulus midpoint orders obtained by the use of Coombs' theory of unidimensional unfolding. Coombs' theory in all three studies was applied to a set of six statements. These authors found that the axioms were satisfied, however, these were applications biased towards a positive result. With six stimuli, the probability of an interstimulus midpoint order satisfying the double cancellation axioms at random is.5874. This is not an unlikely event. Kyngdon & Richards employed eight statements and found the interstimulus midpoint orders rejected the double cancellation condition.
applied conjoint measurement to item response data to a convict parole questionnaire and to intelligence test data gathered from Danish troops. They found considerable violation of the cancellation axioms in the parole questionnaire data, but not in the intelligence test data. Moreover, they recorded the supposed "no test" instances of double cancellation. Interpreting these correctly as instances in support of double cancellation, the results of are better than what they believed.
applied conjoint measurement to performance on sequence completion tasks. The columns of their conjoint arrays were defined by the demand placed upon working memory capacity through increasing numbers of working memory place keepers in letter series completion tasks. The rows were defined by levels of motivation, which consisted in different amount of times available for completing the test. Their data consisted of completion times and average number of series correct. They found support for the cancellation axioms, however, their study was biased by the small size of the conjoint arrays and by statistical techniques that did not take into consideration the ordinal restrictions imposed by the cancellation axioms.
Kyngdon used Karabatsos's order-restricted inference framework to test a conjoint matrix of reading item response proportions where the examinee reading ability comprised the rows of the conjoint array and the difficulty of the reading items formed the columns of the array. The levels of reading ability were identified via raw total test score and the levels of reading item difficulty were identified by the Lexile Framework for Reading. Kyngdon found that satisfaction of the cancellation axioms was obtained only through permutation of the matrix in a manner inconsistent with the putative Lexile measures of item difficulty. Kyngdon also tested simulated ability test response data using polynomial conjoint measurement. The data were generated using Humphry's extended frame of reference Rasch model. He found support of distributive, single and double cancellation consistent with a distributive polynomial conjoint structure in three variables.