Raven paradox


The raven paradox, also known as Hempel's paradox, Hempel's ravens, or rarely the paradox of indoor ornithology, is a paradox arising from the question of what constitutes evidence for a statement. Observing objects that are neither black nor ravens may formally increase the likelihood that all ravens are black even though, intuitively, these observations are unrelated.
This problem was proposed by the logician Carl Gustav Hempel in the 1940s to illustrate a contradiction between inductive logic and intuition.

Paradox

Hempel describes the paradox in terms of the hypothesis:
Via contraposition, this statement is equivalent to:
In all circumstances where is true, is also true—and likewise, in all circumstances where is false, is also false.
Given a general statement such as all ravens are black, a form of the same statement that refers to a specific observable instance of the general class would typically be considered to constitute evidence for that general statement. For example,
is evidence supporting the hypothesis that all ravens are black.
The paradox arises when this same process is applied to statement. On sighting a green apple, one can observe:
By the same reasoning, this statement is evidence that if something is not black then it is not a raven. But since this statement is logically equivalent to all ravens are black, it follows that the sight of a green apple is evidence supporting the notion that all ravens are black. This conclusion seems paradoxical because it implies that information has been gained about ravens by looking at an apple.

Proposed resolutions

's criterion says that only observations of ravens should affect one's view as to whether all ravens are black. Observing more instances of black ravens should support the view, observing white or coloured ravens should contradict it, and observations of non-ravens should not have any influence.
Hempel's equivalence condition states that when a proposition, X, provides evidence in favor of another proposition Y, then X also provides evidence in favor of any proposition that is logically equivalent to Y.
Realistically, the set of ravens is finite. The set of non-black things is either infinite or beyond human enumeration. To confirm the statement 'All ravens are black', it would be necessary to observe all ravens. This is difficult but possible. To confirm the statement 'All non-black things are non-ravens', it would be necessary to examine all non-black things. This is not possible. Observing a black raven could be considered a finite amount of confirmatory evidence, but observing a non-black non-raven would be an infinitesimal amount of evidence.
The paradox shows that Nicod's criterion and Hempel's equivalence condition are not mutually consistent. A resolution to the paradox must reject at least one out of:
  1. negative instances having no influence,
  2. equivalence condition, or,
  3. validation by positive instances.
A satisfactory resolution should also explain why there naively appears to be a paradox. Solutions that accept the paradoxical conclusion can do this by presenting a proposition that we intuitively know to be false but that is easily confused with, while solutions that reject or should present a proposition that we intuitively know to be true but that is easily confused with or.

Accepting non-ravens as relevant

Although this conclusion of the paradox seems counter-intuitive, some approaches accept that observations of non-ravens can in fact constitute valid evidence in support for hypotheses about ravens.

Hempel's resolution

Hempel himself accepted the paradoxical conclusion, arguing that the reason the result appears paradoxical is that we possess prior information without which the observation of a non-black non-raven would indeed provide evidence that all ravens are black.
He illustrates this with the example of the generalization "All sodium salts burn yellow," and asks us to consider the observation that occurs when somebody holds a piece of pure ice in a colorless flame that does not turn yellow:

Standard Bayesian solution

One of the most popular proposed resolutions is to accept the conclusion that the observation of a green apple provides evidence that all ravens are black but to argue that the amount of confirmation provided is very small, due to the large discrepancy between the number of ravens and the number of non-black objects. According to this resolution, the conclusion appears paradoxical because we intuitively estimate the amount of evidence provided by the observation of a green apple to be zero, when it is in fact non-zero but extremely small.
I. J. Good's presentation of this argument in 1960 is perhaps the best known, and variations of the argument have been popular ever since, although it had been presented in 1958 and early forms of the argument appeared as early as 1940.
Good's argument involves calculating the weight of evidence provided by the observation of a black raven or a white shoe in favor of the hypothesis that all the ravens in a collection of objects are black. The weight of evidence is the logarithm of the Bayes factor, which in this case is simply the factor by which the odds of the hypothesis changes when the observation is made. The argument goes as follows:
Many of the proponents of this resolution and variants of it have been advocates of Bayesian probability, and it is now commonly called the Bayesian Solution, although, as Chihara observes, "there is no such thing as the Bayesian solution. There are many different 'solutions' that Bayesians have put forward using Bayesian techniques." Noteworthy approaches using Bayesian techniques include Earman, Eells, Gibson, Hosiasson-Lindenbaum, Howson and Urbach, Mackie, and Hintikka, who claims that his approach is "more Bayesian than the so-called 'Bayesian solution' of the same paradox". Bayesian approaches that make use of Carnap's theory of inductive inference include Humburg, Maher, and Fitelson & Hawthorne. Vranas introduced the term "Standard Bayesian Solution" to avoid confusion.

Carnap approach

Maher accepts the paradoxical conclusion, and refines it:
To reach, he appeals to Carnap's theory of inductive probability, which is a way of assigning prior probabilities that naturally implements induction. According to Carnap's theory, the posterior probability,, that an object,, will have a predicate,, after the evidence has been observed, is:
where is the initial probability that has the predicate ; is the number of objects that have been examined ; is the number of examined objects that turned out to have the predicate, and is a constant that measures resistance to generalization.
If is close to zero, will be very close to one after a single observation of an object that turned out to have the predicate, while if is much larger than, will be very close to regardless of the fraction of observed objects that had the predicate.
Using this Carnapian approach, Maher identifies a proposition we intuitively know is false, but easily confuse with the paradoxical conclusion. The proposition in question is that observing non-ravens tells us about the color of ravens. While this is intuitively false and is also false according to Carnap's theory of induction, observing non-ravens causes us to reduce our estimate of the total number of ravens, and thereby reduces the estimated number of possible counterexamples to the rule that all ravens are black.
Hence, from the Bayesian-Carnapian point of view, the observation of a non-raven does not tell us anything about the color of ravens, but it tells us about the prevalence of ravens, and supports "All ravens are black" by reducing our estimate of the number of ravens that might not be black.

Role of background knowledge

Much of the discussion of the paradox in general and the Bayesian approach in particular has centred on the relevance of background knowledge. Surprisingly, Maher shows that, for a large class of possible configurations of background knowledge, the observation of a non-black non-raven provides exactly the same amount of confirmation as the observation of a black raven. The configurations of background knowledge that he considers are those that are provided by a sample proposition, namely a proposition that is a conjunction of atomic propositions, each of which ascribes a single predicate to a single individual, with no two atomic propositions involving the same individual. Thus, a proposition of the form "A is a black raven and B is a white shoe" can be considered a sample proposition by taking "black raven" and "white shoe" to be predicates.
Maher's proof appears to contradict the result of the Bayesian argument, which was that the observation of a non-black non-raven provides much less evidence than the observation of a black raven. The reason is that the background knowledge that Good and others use can not be expressed in the form of a sample proposition – in particular, variants of the standard Bayesian approach often suppose that the total numbers of ravens, non-black objects and/or the total number of objects, are known quantities. Maher comments that, "The reason we think there are more non-black things than ravens is because that has been true of the things we have observed to date. Evidence of this kind can be represented by a sample proposition. But... given any sample proposition as background evidence, a non-black non-raven confirms A just as strongly as a black raven does... Thus my analysis suggests that this response to the paradox cannot be correct."
Fitelson & Hawthorne examined the conditions under which the observation of a non-black non-raven provides less evidence than the observation of a black raven. They show that, if is an object selected at random, is the proposition that the object is black, and is the proposition that the object is a raven, then the condition:
is sufficient for the observation of a non-black non-raven to provide less evidence than the observation of a black raven. Here, a line over a proposition indicates the logical negation of that proposition.
This condition does not tell us how large the difference in the evidence provided is, but a later calculation in the same paper shows that the weight of evidence provided by a black raven exceeds that provided by a non-black non-raven by about. This is equal to the amount of additional information that is provided when a raven of unknown color is discovered to be black, given the hypothesis that not all ravens are black.
Fitelson & Hawthorne explain that:
The authors point out that their analysis is completely consistent with the supposition that a non-black non-raven provides an extremely small amount of evidence although they do not attempt to prove it; they merely calculate the difference between the amount of evidence that a black raven provides and the amount of evidence that a non-black non-raven provides.

Disputing the induction from positive instances

Some approaches for resolving the paradox focus on the inductive step. They dispute whether observation of a particular instance is the kind of evidence that necessarily increases confidence in the general hypothesis.

Red herring

Good gives an example of background knowledge with respect to which the observation of a black raven decreases the probability that all ravens are black:
Good concludes that the white shoe is a "red herring": Sometimes even a black raven can constitute evidence against the hypothesis that all ravens are black, so the fact that the observation of a white shoe can support it is not surprising and not worth attention. Nicod's criterion is false, according to Good, and so the paradoxical conclusion does not follow.
Hempel rejected this as a solution to the paradox, insisting that the proposition 'c is a raven and is black' must be considered "by itself and without reference to any other information", and pointing out that it "... was emphasized in section 5.2 of my article in Mind... that the very appearance of paradoxicality in cases like that of the white shoe results in part from a failure to observe this maxim."
The question that then arises is whether the paradox is to be understood in the context of absolutely no background information, or in the context of the background information that we actually possess regarding ravens and black objects, or with regard to all possible configurations of background information.
Good had shown that, for some configurations of background knowledge, Nicod's criterion is false. The possibility remained that, with respect to our actual configuration of knowledge, which is very different from Good's example, Nicod's criterion might still be true and so we could still reach the paradoxical conclusion. Hempel, on the other hand, insists our background knowledge itself is the red herring, and that we should consider induction with respect to a condition of perfect ignorance.

Good's baby

In his proposed resolution, Maher implicitly made use of the fact that the proposition "All ravens are black" is highly probable when it is highly probable that there are no ravens. Good had used this fact before to respond to Hempel's insistence that Nicod's criterion was to be understood to hold in the absence of background information:
This, according to Good, is as close as one can reasonably expect to get to a condition of perfect ignorance, and it appears that Nicod's condition is still false. Maher made Good's argument more precise by using Carnap's theory of induction to formalize the notion that if there is one raven, then it is likely that there are many.
Maher's argument considers a universe of exactly two objects, each of which is very unlikely to be a raven and reasonably unlikely to be black. Using Carnap's formula for induction, he finds that the probability that all ravens are black decreases from 0.9985 to 0.8995 when it is discovered that one of the two objects is a black raven.
Maher concludes that not only is the paradoxical conclusion true, but that Nicod's criterion is false in the absence of background knowledge.

Distinguished predicates

Quine argued that the solution to the paradox lies in the recognition that certain predicates, which he called natural kinds, have a distinguished status with respect to induction. This can be illustrated with Nelson Goodman's example of the predicate grue. An object is grue if it is blue before and green afterwards. Clearly, we expect objects that were blue before to remain blue afterwards, but we do not expect the objects that were found to be grue before to be blue after, since after they would be green. Quine's explanation is that "blue" is a natural kind; a privileged predicate we can use for induction, while "grue" is not a natural kind and using induction with it leads to error.
This suggests a resolution to the paradox – Nicod's criterion is true for natural kinds, such as "blue" and "black", but is false for artificially contrived predicates, such as "grue" or "non-raven". The paradox arises, according to this resolution, because we implicitly interpret Nicod's criterion as applying to all predicates when in fact it only applies to natural kinds.
Another approach, which favours specific predicates over others, was taken by Hintikka. Hintikka was motivated to find a Bayesian approach to the paradox that did not make use of knowledge about the relative frequencies of ravens and black things. Arguments concerning relative frequencies, he contends, cannot always account for the perceived irrelevance of evidence consisting of observations of objects of type A for the purposes of learning about objects of type not-A.
His argument can be illustrated by rephrasing the paradox using predicates other than "raven" and "black". For example, "All men
are tall" is equivalent to "All short people are women", and so observing that a randomly selected person is a short woman should provide evidence that all men are tall. Despite the fact that we lack background knowledge to indicate that there are dramatically fewer men than short people, we still find ourselves inclined to reject the conclusion. Hintikka's example is: "... a generalization like 'no material bodies are infinitely divisible' seems to be completely unaffected by questions concerning immaterial entities, independently of what one thinks of the relative frequencies of material and immaterial entities in one's universe of discourse."
His solution is to introduce an order into the set of predicates. When the logical system is equipped with this order, it is possible to restrict the scope of a generalization such as "All ravens are black" so that it applies to ravens only and not to non-black things, since the order privileges ravens over non-black things. As he puts it:

Rejections of Hempel's equivalence condition

Some approaches for the resolution of the paradox reject Hempel's equivalence condition. That is, they may not consider evidence supporting the statement all non-black objects are non-ravens to necessarily support logically-equivalent statements such as all ravens are black.

Selective confirmation

Scheffler and Goodman took an approach to the paradox that incorporates Karl Popper's view that scientific hypotheses are never really confirmed, only falsified.
The approach begins by noting that the observation of a black raven does not prove that "All ravens are black" but it falsifies the contrary hypothesis, "No ravens are black". A non-black non-raven, on the other hand, is consistent with both "All ravens are black" and with "No ravens are black". As the authors put it:
Selective confirmation violates the equivalence condition since a black raven selectively confirms "All ravens are black" but not "All non-black things are non-ravens".
Probabilistic or non-probabilistic induction
Scheffler and Goodman's concept of selective confirmation is an example of an interpretation of "provides evidence in favor of..." which does not coincide with "increase the probability of..." This must be a general feature of all resolutions that reject the equivalence condition, since logically equivalent propositions must always have the same probability.
It is impossible for the observation of a black raven to increase the probability of the proposition "All ravens are black" without causing exactly the same change to the probability that "All non-black things are non-ravens". If an observation inductively supports the former but not the latter, then "inductively support" must refer to something other than changes in the probabilities of propositions. A possible loophole is to interpret "All" as "Nearly all" – "Nearly all ravens are black" is not equivalent to "Nearly all non-black things are non-ravens", and these propositions can have very different probabilities.
This raises the broader question of the relation of probability theory to inductive reasoning. Karl Popper argued that probability theory alone cannot account for induction. His argument involves splitting a hypothesis,, into a part that is deductively entailed by the evidence,, and another part. This can be done in two ways.
First, consider the splitting:
where, and are probabilistically independent: and so on. The condition that is necessary for such a splitting of H and E to be possible is, that is, that is probabilistically supported by.
Popper's observation is that the part,, of that receives support from actually follows deductively from, while the part of that does not follow deductively from receives no support at all from – that is,.
Second, the splitting:
separates into, which as Popper says, "is the logically strongest part of that follows from ", and, which, he says, "contains all of that goes beyond ". He continues:

Orthodox approach

The orthodox Neyman–Pearson theory of hypothesis testing considers how to decide whether to accept or reject a hypothesis, rather than what probability to assign to the hypothesis. From this point of view, the hypothesis that "All ravens are black" is not accepted gradually, as its probability increases towards one when more and more observations are made, but is accepted in a single action as the result of evaluating the data that has already been collected. As Neyman and Pearson put it:
According to this approach, it is not necessary to assign any value to the probability of a hypothesis, although one must certainly take into account the probability of the data given the hypothesis, or given a competing hypothesis, when deciding whether to accept or to reject. The acceptance or rejection of a hypothesis carries with it the risk of error.
This contrasts with the Bayesian approach, which requires that the hypothesis be assigned a prior probability, which is revised in the light of the observed data to obtain the final probability of the hypothesis. Within the Bayesian framework there is no risk of error since hypotheses are not accepted or rejected; instead they are assigned probabilities.
An analysis of the paradox from the orthodox point of view has been performed, and leads to, among other insights, a rejection of the equivalence condition:

Rejecting material implication

The following propositions all imply one another: "Every object is either black or not a raven", "Every raven is black", and "Every non-black object is a non-raven." They are therefore, by definition, logically equivalent. However, the three propositions have different domains: the first proposition says something about "every object", while the second says something about "every raven".
The first proposition is the only one whose domain of quantification is unrestricted, so this is the only one that can be expressed in first-order logic. It is logically equivalent to:
and also to
where indicates the material conditional, according to which "If then " can be understood to mean " or ".
It has been argued by several authors that material implication does not fully capture the meaning of "If then ". "For every object,, is either black or not a raven" is true when there are no ravens. It is because of this that "All ravens are black" is regarded as true when there are no ravens. Furthermore, the arguments that Good and Maher used to criticize Nicod's criterion relied on this fact – that "All ravens are black" is highly probable when it is highly probable that there are no ravens.
To say that all ravens are black in the absence of any ravens is an empty statement. It refers to nothing. "All ravens are white" is equally relevant and true, if this statement is considered to have any truth or relevance.
Some approaches to the paradox have sought to find other ways of interpreting "If then " and "All are," which would eliminate the perceived equivalence between "All ravens are black" and "All non-black things are non-ravens."
One such approach involves introducing a many-valued logic according to which "If then " has the truth value, meaning "Indeterminate" or "Inappropriate" when is false. In such a system, contraposition is not automatically allowed: "If then " is not equivalent to "If then ". Consequently, "All ravens are black" is not equivalent to "All non-black things are non-ravens".
In this system, when contraposition occurs, the modality of the conditional involved changes from the indicative to the counterfactual. According to this argument, this removes the alleged equivalence that is necessary to conclude that yellow cows can inform us about ravens:

Differing results of accepting the hypotheses

Several commentators have observed that the propositions "All ravens are black" and "All non-black things are non-ravens" suggest different procedures for testing the hypotheses. E.g. Good writes:
More recently, it has been suggested that "All ravens are black" and "All non-black things are non-ravens" can have different effects when accepted. The argument considers situations in which the total numbers or prevalences of ravens and black objects are unknown, but estimated. When the hypothesis "All ravens are black" is accepted, according to the argument, the estimated number of black objects increases, while the estimated number of ravens does not change.
It can be illustrated by considering the situation of two people who have identical information regarding ravens and black objects, and who have identical estimates of the numbers of ravens and black objects. For concreteness, suppose that there are 100 objects overall, and, according to the information available to the people involved, each object is just as likely to be a non-raven as it is to be a raven, and just as likely to be black as it is to be non-black:
and the propositions are independent for different objects, and so on. Then the estimated number of ravens is 50; the estimated number of black things is 50; the estimated number of black ravens is 25, and the estimated number of non-black ravens is 25.
One of the people performs a statistical test of the hypothesis that "All ravens are black", while the other tests the hypothesis that "All non-black objects
are non-ravens". For simplicity, suppose that the evidence used for the test has nothing to do with the collection of 100 objects dealt with here. If the first person accepts the hypothesis that "All ravens are black" then, according to the argument, about 50 objects whose colors were previously in doubt are now thought to be black, while nothing different is thought about the remaining objects. Consequently, he should estimate the number of black ravens at 50, the number of black non-ravens at 25 and the number of non-black non-ravens at 25. By specifying these changes, this argument explicitly restricts the domain of "All ravens are black" to ravens.
On the other hand, if the second person accepts the hypothesis that "All non-black objects are non-ravens", then the approximately 50 non-black objects about which it was uncertain whether each was a raven, will be thought to be non-ravens. At the same time, nothing different will be thought about the approximately 50 remaining objects. Consequently, he should estimate the number of black ravens at 25, the number of black non-ravens at 25 and the number of non-black non-ravens at 50. According to this argument, since the two people disagree about their estimates after they have accepted the different hypotheses, accepting "All ravens are black" is not equivalent to accepting "All non-black things are non-ravens"; accepting the former means estimating more things to be black, while accepting the latter involves estimating more things to be non-ravens. Correspondingly, the argument goes, the former requires as evidence ravens that turn out to be black and the latter requires non-black things that turn out to be non-ravens.

Existential presuppositions

A number of authors have argued that propositions of the form "All are " presuppose that there are objects that are. This analysis has been applied to the raven paradox:
A modified logic can take account of existential presuppositions using the presuppositional operator, '*'. For example,
can denote "All ravens are black" while indicating that it is ravens and not non-black objects which are presupposed to exist in this example.