Baillie–PSW primality test


The Baillie–PSW primality test is a probabilistic primality testing algorithm that determines whether a number is composite or is a probable prime. It is named after Robert Baillie, Carl Pomerance, John Selfridge, and Samuel Wagstaff.
The Baillie-PSW test is a combination of a strong Fermat probable prime test to base 2 and a strong Lucas probable prime test. The Fermat and Lucas test each have their own list of pseudoprimes, that is, composite numbers that pass the test. For example, the first ten strong pseudoprimes to base 2 are
The first ten strong Lucas pseudoprimes are
There is no known overlap between these lists of strong Fermat pseudoprimes and strong Lucas pseudoprimes, and there is even evidence that the numbers in these lists tend to be different kinds of numbers. For example, Fermat pseudoprimes to base 2 tend to fall into the residue class 1 for many small m, whereas Lucas pseudoprimes tend to fall into the residue class −1. As a result, a number that passes both a strong Fermat and a strong Lucas test is very likely to be prime.
No composite number below 264 passes the Baillie-PSW test. Consequently, this test is a deterministic primality test on numbers below that bound. There are also no known composite numbers above that bound that pass the test, in other words, there are no known Baillie-PSW pseudoprimes. Despite this, there are conjectured to be infinitely many.
In 1980 the authors Pomerance, Selfridge, and Wagstaff offered $30 for the discovery of a counterexample, that is, a composite number that passed this test. Richard Guy incorrectly stated that the value of this prize had been raised to $620, but he was confusing the Lucas sequence with the Fibonacci sequence, and his remarks really apply only to a Conjecture of Selfridge's. As of June 2014 the prize remains unclaimed. However, a heuristic argument by Pomerance suggests that there are infinitely many counterexamples.
Moreover, Chen and Greene
have constructed a set S of 1248 primes such that, among the nearly 21248 products of distinct primes in S, there may be about 740 counterexamples. However, they are talking about the weaker PSW test that substitutes a Fibonacci test for the Lucas one.

The test

Let n be the odd positive integer that we wish to test for primality.
  1. Optionally, perform trial division to check if n is divisible by a small prime number less than some convenient limit.
  2. Perform a base 2 strong probable prime test. If n is not a strong probable prime base 2, then n is composite; quit.
  3. Find the first D in the sequence 5, −7, 9, −11, 13, −15, ... for which the Jacobi symbol is −1. Set P = 1 and Q = / 4.
  4. Perform a strong Lucas probable prime test on n using parameters D, P, and Q. If n is not a strong Lucas probable prime, then n is composite. Otherwise, n is almost certainly prime.
Remarks.
  1. The first step is for efficiency only. The Baillie-PSW test works without this step, but if n has small prime factors, then the quickest way to show that n is composite is to find a factor by trial division.
  2. The second step is a single application of the Miller-Rabin primality test using base 2. There is nothing special about using base 2; other bases might work just as well. However, much work has been done to verify that the combination of the base 2 strong probable prime test and a strong Lucas test does a good job of distinguishing primes from composites.
  3. Baillie and Wagstaff proved in Theorem 9 on page 1413 of that the average number of Ds that must be tried is about 3.147755149.
  4. If n is a perfect square, then step 3 will never yield a D with = −1; this is not a problem because perfect squares are easy to detect using Newton's method for square roots. If step 3 fails to produce a D quickly, one should check whether n is a perfect square.
  5. Given n, there are other methods for choosing D, P, and Q. What is important is that the Jacobi symbol be −1. Bressoud and Wagon explain why we want the Jacobi symbol to be −1, as well as why one gets more powerful primality tests if Q ≠ ±1.
  6. Section 6 of recommends that if Q ≠ ±1, a good primality test should also check two additional congruence conditions. These two congruences involve almost no extra computational cost, and are only rarely true if n is composite: and .
  7. There are weaker versions of the Baillie-PSW test, and this one is sometimes referred to as the Strong Baillie-PSW test.
  8. If the Lucas test is replaced by a Fibonacci test, then it shouldn't be called a Baillie-PSW test, but rather a Selfridge test or a PSW test. See Selfridge's Conjecture on Primality Testing.
  9. Pomerance, Selfridge and Wagstaff offered $30 in 1980 for a composite number passing a weaker version of the Baillie-PSW test. Such a number passing the Baillie-PSW test would qualify.

    The danger of relying only on Fermat tests

There is significant overlap among the lists of pseudoprimes to different bases.
Choose a base a. If n is a pseudoprime to base a, then n is likely to be one of those few numbers that is a pseudoprime to many bases.
For example, n = 341 is a pseudoprime to base 2. It follows from Theorem 1 on page 1392 of that there are 100 values of a for which 341 is a pseudoprime base a.
.
The proportion of such a compared to n is usually much smaller.
Therefore, if n is a pseudoprime to base a, then n is more likely than average to be a pseudoprime to some other base. For example, there are 21853 pseudoprimes to base 2 up to 25·109.
This is only about two out of every million odd integers in this range.
However:
29341 is the smallest pseudoprime to bases 2 through 12.
All of this suggests that probable prime tests to different bases are not independent of each other, so that performing Fermat probable prime tests to more and more bases will give diminishing returns.
On the other hand, the calculations in and the calculations up to 264 mentioned above suggest that Fermat and Lucas probable prime tests are independent, so that a combination of these types of tests would make a powerful primality test, especially if the strong forms of the tests are used.
Note that a number that is pseudoprime to all prime bases 2,..., p is also pseudoprime to all bases that are p-smooth.
There is also overlap among strong pseudoprimes to different bases.
For example, 1373653 is the smallest strong pseudoprime to bases 2 through 4, and 3215031751 is the smallest strong pseudoprime to bases 2 through 10.
Arnault
gives a 397-digit Carmichael number N that is a strong pseudoprime to all prime bases less than 307. Because this N is a Carmichael number, N is also a pseudoprime to all bases less than p, where p is the 131-digit smallest prime factor of N. A quick calculation shows that N is not a Lucas probable prime when D, P, and Q are chosen by the method described above, so this number would be correctly determined by the Baillie-PSW test to be composite.

Applications of combined Fermat and Lucas primality tests

The following computer algebra systems and software packages use some version of the Baillie–PSW primality test.
Maple's isprime function
Mathematica's PrimeQ function
PARI/GP's isprime and ispseudoprime functions
and SageMath's is_pseudoprime function
all use a combination of a Fermat strong probable prime test and a Lucas test.
Maxima's primep function uses such a test for numbers greater than 341550071728321
The FLINT library has functions n_is_probabprime and n_is_probabprime_BPSW that use a combined test, as well as other functions that perform Fermat and Lucas tests separately
The BigInteger class in standard versions of Java and in open-source implementations like OpenJDK,
has a method called isProbablePrime.
This method does one or more Miller-Rabin tests with random bases. If n, the number being tested, has 100 bits or more,
this method also does a non-strong Lucas test that checks whether Un+1 is 0.
The use of random bases in the Miller-Rabin tests has an advantage and a drawback compared to doing a single base 2 test as specified in the Baillie–PSW test.
The advantage is that, with random bases, one can get a bound on the probability that n is composite.
The drawback is that, unlike the Baillie–PSW test, one cannot say with certainty that if n is less than some fixed bound such as 264, then n is prime.
In Perl, the Math::Primality and Math::Prime::Util modules have functions to perform the strong Baillie-PSW test as well as separate functions for strong pseudoprime and strong Lucas tests. In Python, the NZMATH library has the strong pseudoprime and Lucas tests, but does not have a combined function. The SymPy library does implement this.
As of 6.2.0, GNU Multiple Precision Arithmetic Library's mpz_probab_prime_p function uses a strong Lucas test and a Miller-Rabin test; previous versions did not make use of Baillie-PSW.
Magma's
IsProbablePrime and IsProbablyPrime functions use 20 Miller-Rabin tests for numbers > 34·1013, but do not combine them with a Lucas probable prime test.
Cryptographic libraries often have prime-testing functions. Albrecht et al. discuss the tests used in these libraries. Some use a combined Fermat and Lucas test; many do not. For some of the latter, Albrecht, et al. were able to construct composite numbers that the libraries declared to be prime.