If A is an matrix and B is a matrix, then the Kronecker product is the block matrix: more explicitly: More compactly, we have Similarly Using the identity, where denotes the remainder of, this may be written in a more symmetric form If A and B represent linear transformations and, respectively, then represents the tensor product of the two maps,.
Examples
Similarly:
Properties
Relations to other matrix operations
Abstract properties
Matrix equations
The Kronecker product can be used to get a convenient representation for some matrix equations. Consider for instance the equation, where A, B and C are given matrices and the matrix X is the unknown. We can use the "vec trick" to rewrite this equation as Here, vec denotes the vectorization of the matrix X formed by stacking the columns of X into a single column vector. It now follows from the properties of the Kronecker product that the equation has a unique solution if and only ifA and B are nonsingular. If X and AXB are row-ordered into the column vectorsu and v, respectively, then The reason is that
Applications
For an example of the application of this formula, see the article on the Lyapunov equation. This formula also comes in handy in showing that the matrix normal distribution is a special case of the multivariate normal distribution. This formula is also useful for representing 2D image processing operations in matrix-vector form. Another example is when a matrix can be factored as a Hadamard product, then matrix multiplication can be performed faster by using the above formula. This can be applied recursively, as done in the radix-2 FFT and the Fast Walsh–Hadamard transform. Splitting a known matrix into the Hadamard product of two smaller matrices is known as the "nearest Kronecker Product" problem, and can be solved exactly by using the SVD. To split a matrix into the Hadamard product of more than two matrices, in an optimal fashion, is a difficult problem and the subject of ongoing research; some authors cast it as a tensor decomposition problem. In conjunction with the least squares method, the Kronecker product can be used as an accurate solution to the hand eye calibration problem.
Related matrix operations
Two related matrix operations are the Tracy–Singh and Khatri–Rao products which operate on partitioned matrices. Let the matrix A be partitioned into the blocks Aij and matrix B into the blocks Bkl with of course,, and.
Tracy–Singh product
The Tracy–Singh product is defined as which means that the -th subblock of the product is the matrix, of which the -th subblock equals the matrix. Essentially the Tracy–Singh product is the pairwise Kronecker product for each pair of partitions in the two matrices. For example, if A and B both are partitioned matrices e.g.: we get: