Skewness


In probability theory and statistics, skewness is a measure of the asymmetry of the probability distribution of a real-valued random variable about its mean. The skewness value can be positive, zero, negative, or undefined.
For a unimodal distribution, negative skew commonly indicates that the tail is on the left side of the distribution, and positive skew indicates that the tail is on the right. In cases where one tail is long but the other tail is fat, skewness does not obey a simple rule. For example, a zero value means that the tails on both sides of the mean balance out overall; this is the case for a symmetric distribution, but can also be true for an asymmetric distribution where one tail is long and thin, and the other is short but fat.

Introduction

Consider the two distributions in the figure just below. Within each graph, the values on the right side of the distribution taper differently from the values on the left side. These tapering sides are called tails, and they provide a visual means to determine which of the two kinds of skewness a distribution has:
  1. ': The left tail is longer; the mass of the distribution is concentrated on the right of the figure. The distribution is said to be left-skewed, left-tailed, or skewed to the left, despite the fact that the curve itself appears to be skewed or leaning to the right; left instead refers to the left tail being drawn out and, often, the mean being skewed to the left of a typical center of the data. A left-skewed distribution usually appears as a right-leaning curve.
  2. ': The right tail is longer; the mass of the distribution is concentrated on the left of the figure. The distribution is said to be right-skewed, right-tailed, or skewed to the right, despite the fact that the curve itself appears to be skewed or leaning to the left; right instead refers to the right tail being drawn out and, often, the mean being skewed to the right of a typical center of the data. A right-skewed distribution usually appears as a left-leaning curve.
Skewness in a data series may sometimes be observed not only graphically but by simple inspection of the values. For instance, consider the numeric sequence, whose values are evenly distributed around a central value of 50. We can transform this sequence into a negatively skewed distribution by adding a value far below the mean, which is probably a negative outlier, e.g.. Therefore, the mean of the sequence becomes 47.5, and the median is 49.5. Based on the formula of nonparametric skew, defined as the skew is negative. Similarly, we can make the sequence positively skewed by adding a value far above the mean, which is probably a positive outlier, e.g., where the mean is 52.5, and the median is 50.5.
As mentioned earlier, a unimodal distribution with zero value of skewness does not imply that this distribution is symmetric necessarily. However, a symmetric unimodal or multimodal distribution always has zero skewness.

Relationship of mean and median

The skewness is not directly related to the relationship between the mean and median: a distribution with negative skew can have its mean greater than or less than the median, and likewise for positive skew.
In the older notion of nonparametric skew, defined as where is the mean, is the median, and is the standard deviation, the skewness is defined in terms of this relationship: positive/right nonparametric skew means the mean is greater than the median, while negative/left nonparametric skew means the mean is less than the median. However, the modern definition of skewness and the traditional nonparametric definition do not always have the same sign: while they agree for some families of distributions, they differ in some of the cases, and conflating them is misleading.
If the distribution is symmetric, then the mean is equal to the median, and the distribution has zero skewness. If the distribution is both symmetric and unimodal, then the mean = median = mode. This is the case of a coin toss or the series 1,2,3,4,... Note, however, that the converse is not true in general, i.e. zero skewness does not imply that the mean is equal to the median.
A 2005 journal article points out:
Many textbooks teach a rule of thumb stating that the mean is right of the median under right skew, and left of the median under left skew. This rule fails with surprising frequency. It can fail in multimodal distributions, or in distributions where one tail is long but the other is heavy. Most commonly, though, the rule fails in discrete distributions where the areas to the left and right of the median are not equal. Such distributions not only contradict the textbook relationship between mean, median, and skew, they also contradict the textbook interpretation of the median.

For example, in the distribution of adult residents across US households, the skew is to the right. However, due to the majority of cases is less or equal to the mode, which is also the median, the mean sits in the heavier left tail. As a result, the rule of thumb that the mean is right of the median under right skew failed.

Definition

Pearson's moment coefficient of skewness

The skewness of a random variable X is the third standardized moment, defined as:
where μ is the mean, σ is the standard deviation, E is the expectation operator, μ3 is the third central moment, and κt are the t-th cumulants. It is sometimes referred to as Pearson's moment coefficient of skewness, or simply the moment coefficient of skewness, but should not be confused with Pearson's other skewness statistics. The last equality expresses skewness in terms of the ratio of the third cumulant κ3 to the 1.5th power of the second cumulant κ2. This is analogous to the definition of kurtosis as the fourth cumulant normalized by the square of the second cumulant.
The skewness is also sometimes denoted Skew.
If σ is finite, μ is finite too and skewness can be expressed in terms of the non-central moment E by expanding the previous formula,

Examples

Skewness can be infinite, as when
where the third cumulants are infinite, or as when
where the third cumulant is undefined.
Examples of distributions with finite skewness include the following.
For a sample of n values, a natural method of moments estimator of the population skewness is
where is the sample mean, s is the sample standard deviation, and the numerator m3 is the sample third central moment. This formula can be thought of as the average cubed deviation in the sample divided by the cubed sample standard deviation.
Another common definition of the sample skewness is
where is the unique symmetric unbiased estimator of the third cumulant and is the symmetric unbiased estimator of the second cumulant.
In general, the ratios and are both biased estimators of the population skewness ; their expected values can even have the opposite sign from the true skewness. Nevertheless, and each have obviously the correct expected value of zero for any symmetric distribution with a finite third moment, including a normal distribution.
Under the assumption that the underlying random variable is normally distributed, it can be shown that, i.e., its distribution converges to a normal distribution with mean 0 and variance 6. The variance of the skewness of a random sample of size n from a normal distribution is
An approximate alternative is 6/n, but this is inaccurate for small samples.
In normal samples, has the smaller variance of the two estimators, with
where m2 in the denominator is the sample second central moment.
The adjusted Fisher–Pearson standardized moment coefficient is the version found in Excel and several statistical packages including Minitab, SAS and SPSS.

Applications

Skewness is a descriptive statistic that can be used in conjunction with the histogram and the normal quantile plot to characterize the data or distribution.
Skewness indicates the direction and relative magnitude of a distribution's deviation from the normal distribution.
With pronounced skewness, standard statistical inference procedures such as a confidence interval for a mean will be not only incorrect, in the sense that the true coverage level will differ from the nominal level, but they will also result in unequal error probabilities on each side.
Skewness can be used to obtain approximate probabilities and quantiles of distributions via the Cornish-Fisher expansion.
Many models assume normal distribution; i.e., data are symmetric about the mean. The normal distribution has a skewness of zero. But in reality, data points may not be perfectly symmetric. So, an understanding of the skewness of the dataset indicates whether deviations from the mean are going to be positive or negative.
D'Agostino's K-squared test is a goodness-of-fit normality test based on sample skewness and sample kurtosis.

Other measures of skewness

Other measures of skewness have been used, including simpler calculations suggested by Karl Pearson. These other measures are:

Pearson's first skewness coefficient (mode skewness)

The Pearson mode skewness, or first skewness coefficient, is defined as

Pearson's second skewness coefficient (median skewness)

The Pearson median skewness, or second skewness coefficient, is defined as
Which is a simple multiple of the nonparametric skew.

Quantile-based measures

Bowley's measure of skewness, also called Yule's coefficient is defined as:
When writing it as, it is easier to see that the numerator is difference between the average of the upper and lower quartiles and the median, while the denominator is the semi-interquartile range /2, which for symmetric distributions is the MAD measure of dispersion.
Other names for this measure are Galton's measure of skewness, the Yule–Kendall index and the quartile skewness,
A more general formulation of a skewness function was described by Groeneveld, R. A. and Meeden, G. :
where F is the cumulative distribution function. This leads to a corresponding overall measure of skewness defined as the supremum of this over the range 1/2 ≤ u < 1. Another measure can be obtained by integrating the numerator and denominator of this expression. The function γ satisfies −1 ≤ γ ≤ 1 and is well defined without requiring the existence of any moments of the distribution. Quantile-based skewness measures are at first glance easy to interpret, but they often show significantly larger sample variations, than moment-based methods. This means that often samples from a symmetric distribution have a large quantile-based skewness, just by chance.
Bowley's measure of skewness is γ evaluated at u = 3/4. Kelley's measure of skewness uses u = 0.1.

Groeneveld & Meeden’s coefficient

Groeneveld & Meeden have suggested, as an alternative measure of skewness,
where μ is the mean, ν is the median, |...| is the absolute value, and E is the expectation operator. This is closely related in form to Pearson's second skewness coefficient.

L-moments

Use of L-moments in place of moments provides a measure of skewness known as the L-skewness.

Distance skewness

A value of skewness equal to zero does not imply that the probability distribution is symmetric. Thus there is a need for another measure of asymmetry that has this property: such a measure was introduced in 2000. It is called distance skewness and denoted by dSkew. If X is a random variable taking values in the d-dimensional Euclidean space, X has finite expectation, X is an independent identically distributed copy of X, and denotes the norm in the Euclidean space, then a simple measure of asymmetry with respect to location parameter θ is
and dSkew := 0 for X = θ. Distance skewness is always between 0 and 1, equals 0 if and only if X is diagonally symmetric with respect to θ and equals 1 if and only if X is a constant c with probability one. Thus there is a simple consistent statistical test of diagonal symmetry based on the sample distance skewness:

Medcouple

The medcouple is a scale-invariant robust measure of skewness, with a breakdown point of 25%. It is the median of the values of the kernel function
taken over all couples such that, where is the median of the sample. It can be seen as the median of all possible quantile skewness measures.

Citations