Integral nonlinearity


Integral nonlinearity is a commonly used measure of performance in digital-to-analog and analog-to-digital converters. In DACs, it is a measure of the deviation between the ideal output value and the actual measured output value for a certain input code. In ADCs, it is the deviation between the ideal input threshold value and the measured threshold level of a certain output code. This measurement is performed after offset and gain errors have been compensated.
The ideal transfer function of a DAC or ADC is a straight line. The INL measurement depends on what line is chosen as ideal. One common option is the line that connects the endpoints of the transfer function, in other words, the line connecting the smallest and largest measured input/output value. An alternative is to use a best fit line, where one minimizes the average INL.
While the INL can be measured for every possible input/output code, often only the maximal error is provided when reporting the INL of a converter.

Formulas

INL of a DAC

The INL of a code of a DAC with output codes is defined as the absolute value of the difference of the real output voltage minus the ideal value:
where

INL of an ADC

For an ADC, the INL of a code is defined as the deviation of the mid-points of the quantization steps between the ideal and real transfer function.

Maximum INL of a converter

When referring to the INL of a converter usually the maximum INL maximized over all codes is meant. For the line through the endpoints, the INL of a DAC is
This INL is measured in volts; one can divide it by the ideal LSB voltage to get the measurement in LSBs: