Probabilistic logic
The aim of a probabilistic logic is to combine the capacity of probability theory to handle uncertainty with the capacity of deductive logic to exploit structure of formal argument. The result is a richer and more expressive formalism with a broad range of possible application areas. Probabilistic logics attempt to find a natural extension of traditional logic truth tables: the results they define are derived through probabilistic expressions instead. A difficulty with probabilistic logics is that they tend to multiply the computational complexities of their probabilistic and logical components. Other difficulties include the possibility of counter-intuitive results, such as those of Dempster-Shafer theory in evidence-based subjective logic. The need to deal with a broad variety of contexts and issues has led to many different proposals.
Historical context
There are numerous proposals for probabilistic logics. Very roughly, they can be categorized into two different classes: those logics that attempt to make a probabilistic extension to logical entailment, such as Markov logic networks, and those that attempt to address the problems of uncertainty and lack of evidence.That probability and uncertainty are not quite the same thing may be understood by noting that, despite the mathematization of probability in the Enlightenment, mathematical probability theory remains, to this very day, entirely unused in criminal courtrooms, when evaluating the "probability" of the guilt of a suspected criminal.
More precisely, in evidentiary logic, there is a need to distinguish the truth of a statement from the confidence in its truth: thus, being uncertain of a suspect's guilt is not the same as assigning a numerical probability to the commission of the crime. A single suspect may be guilty or not guilty, just as a coin may be flipped heads or tails. Given a large collection of suspects, a certain percentage may be guilty, just as the probability of flipping "heads" is one-half. However, it is incorrect to take this law of averages with regard to a single criminal : the criminal is no more "a little bit guilty" than a single coin flip is "a little bit heads and a little bit tails": we are merely uncertain as to which it is. Conflating probability and uncertainty may be acceptable when making scientific measurements of physical quantities, but it is an error, in the context of "common sense" reasoning and logic. Just as in courtroom reasoning, the goal of employing uncertain inference is to gather evidence to strengthen the confidence of a proposition, as opposed to performing some sort of probabilistic entailment.
Historically, attempts to quantify probabilistic reasoning date back to antiquity. There was a particularly strong interest starting in the 12th century, with the work of the Scholastics, with the invention of the half-proof, the elucidation of moral certainty, the development of Catholic probabilism, the case-based reasoning of casuistry, and the scandal of Laxism.
Modern proposals
Below is a list of proposals for probabilistic and evidentiary extensions to classical and predicate logic.- The term "probabilistic logic" was first used in a paper by Nils Nilsson published in 1986, where the truth values of sentences are probabilities. The proposed semantical generalization induces a probabilistic logical entailment, which reduces to ordinary logical entailment when the probabilities of all sentences are either 0 or 1. This generalization applies to any logical system for which the consistency of a finite set of sentences can be established.
- The central concept in the theory of subjective logic are opinions about some of the propositional variables involved in the given logical sentences. A binomial opinion applies to a single proposition and is represented as a 3-dimensional extension of a single probability value to express various degrees of ignorance about the truth of the proposition. For the computation of derived opinions based on a structure of argument opinions, the theory proposes respective operators for various logical connectives, such as e.g. multiplication, comultiplication, division and co-division of opinions as well as conditional deduction and abduction.
- Approximate reasoning formalism proposed by fuzzy logic can be used to obtain a logic in which the models are the probability distributions and the theories are the lower envelopes. In such a logic the question of the consistency of the available information is strictly related with the one of the coherence of partial probabilistic assignment and therefore with Dutch book phenomenon.
- Markov logic networks implement a form of uncertain inference based on the maximum entropy principle—the idea that probabilities should be assigned in such a way as to maximize entropy, in analogy with the way that Markov chains assign probabilities to finite state machine transitions.
- Systems such as Pei Wang's Non-Axiomatic Reasoning System or Ben Goertzel's Probabilistic Logic Networks add an explicit confidence ranking, as well as a probability to atoms and sentences. The rules of deduction and induction incorporate this uncertainty, thus side-stepping difficulties in purely Bayesian approaches to logic, while also avoiding the paradoxes of Dempster-Shafer theory. The implementation of PLN attempts to use and generalize algorithms from logic programming, subject to these extensions.
- In the field of probabilistic argumentation, various formal frameworks have been put forward. The framework of "probabilistic labellings", for example, refers to probability spaces where a sample space is a set of labellings of argumentation graphs. In the framework of "probabilistic argumentation systems" probabilities are not directly attached to arguments or logical sentences. Instead it is assumed that a particular subset of the variables involved in the sentences defines a probability space over the corresponding sub-σ-algebra. This induces two distinct probability measures with respect to, which are called degree of support and degree of possibility, respectively. Degrees of support can be regarded as non-additive probabilities of provability, which generalizes the concepts of ordinary logical entailment and classical posterior probabilities. Mathematically, this view is compatible with the Dempster-Shafer theory.
- The theory of evidential reasoning also defines non-additive probabilities of probability as a general notion for both logical entailment and probability. The idea is to augment standard propositional logic by considering an epistemic operator K that represents the state of knowledge that a rational agent has about the world. Probabilities are then defined over the resulting epistemic universe Kp of all propositional sentences p, and it is argued that this is the best information available to an analyst. From this view, Dempster-Shafer theory appears to be a generalized form of probabilistic reasoning.
Possible application areas
- Argumentation theory
- Artificial intelligence
- Artificial general intelligence
- Bioinformatics
- Explainable artificial intelligence
- Formal epistemology
- Game theory
- Philosophy of science
- Psychology
- Statistics
- Life