In mathematics, the subderivative, subgradient, and subdifferential generalize the derivative to convex functions which are not necessarily differentiable. Subderivatives arise in convex analysis, the study of convex functions, often in connection to convex optimization. Let be a real-valued convex function defined on an open interval of the real line. Such a function need not be differentiable at all points: For example, the absolutevalue functionf=|x| is nondifferentiable when x=0. However, as seen in the graph on the right, for any x0 in the domain of the function one can draw a line which goes through the point and which is everywhere either touching or below the graph of f. The slope of such a line is called a subderivative.
Definition
Rigorously, a subderivative of a convex function at a point x0 in the open intervalI is a real numberc such that for all x in I. One may show that the set of subderivatives at x0 for a convex function is a nonemptyclosed interval , where a and b are the one-sided limits which are guaranteed to exist and satisfy a ≤ b. The set of all subderivatives is called the subdifferential of the function f at x0. Since f is convex, if its subdifferential at contains exactly one subderivative, then f is differentiable at.
Examples
Consider the function f=|x| which is convex. Then, the subdifferential at the origin is the interval . The subdifferential at any point x0<0 is the singleton set, while the subdifferential at any point x0>0 is the singleton set. This is similar to the sign function, but is not a single-valued function at 0, instead including all possible subderivatives.
Properties
A convex function f:I→R is differentiable at x0if and only if the subdifferential is made up of only one point, which is the derivative at x0.
A point x0 is a global minimum of a convex function f if and only if zero is contained in the subdifferential, that is, in the figure above, one may draw a horizontal "subtangent line" to the graph of f at. This last property is a generalization of the fact that the derivative of a function differentiable at a local minimum is zero.
If and are convex functions with subdifferentials and, then the subdifferential of is . This reads as "the subdifferential of a sum is the sum of the subdifferentials."
The subgradient
The concepts of subderivative and subdifferential can be generalized to functions of several variables. If f:U→ R is a real-valued convex function defined on a convex open set in the Euclidean spaceRn, a vector in that space is called a subgradient at a point x0 in U if for any x in U one has where the dot denotes the dot product. The set of all subgradients at x0 is called the subdifferential at x0 and is denoted ∂f. The subdifferential is always a nonempty convex compact set. These concepts generalize further to convex functions f:U→ R on a convex set in a locally convex spaceV. A functional ∗ in the dual space V∗ is called subgradient at x0 in U if for all x in U The set of all subgradients at x0 is called the subdifferential at x0 and is again denoted ∂f. The subdifferential is always a convex closed set. It can be an empty set; consider for example an unbounded operator, which is convex, but has no subgradient. If f is continuous, the subdifferential is nonempty.
History
The subdifferential on convex functions was introduced by Jean Jacques Moreau and R. Tyrrell Rockafellar in the early 1960s. The generalized subdifferential for nonconvex functions was introduced by F.H. Clarke and R.T. Rockafellar in the early 1980s.
