8-bit clean


8-bit clean describes a computer system that correctly handles 8-bit character encodings, such as the ISO 8859 series and the UTF-8 encoding of Unicode.

History

Up to the early 1990s, many programs and data transmission channels assumed that all characters would be represented as numbers between 0 and 127 ; for example, the ASCII standard used only 7 bits per character, avoiding an 8-bit representation in order to save on data transmission costs. On computers and data links using 8-bit bytes this left the top bit of each byte free for use as a parity, flag bit, or meta data control bit. 7-bit systems and data links are unable to handle more complex character codes which are commonplace in non-English-speaking countries with larger alphabets.
Binary files cannot be transmitted through 7-bit data channels directly. To work around this, binary-to-text encodings have been devised which use only 7-bit ASCII characters. Some of these encodings are uuencoding, Ascii85, SREC, BinHex, kermit and MIME's Base64. EBCDIC-based systems cannot handle all characters used in UUencoded data. However, the base64 encoding does not have this problem.

SMTP and NNTP 8-bit cleanness

Historically, various media were used to transfer messages, some of them only supporting 7-bit data, so an 8-bit message had high chances to be garbled during transmission in the 20th century. But some implementations really did not care about formal discouraging of 8-bit data and allowed high bit set bytes to pass through.
Many early communications protocol standards, such as , ,, were designed to work over such "7-bit" communication links. They specifically mention the use of ASCII character set "transmitted as an 8-bit byte with the high-order bit cleared to zero" and some of these explicitly restrict all data to 7-bit characters.
For the first few decades of email networks, most email messages were plain text in the 7-bit US-ASCII character set.
According to, the original definition of SMTP limits Internet Mail to lines of 7-bit US-ASCII characters.
Later the format of email messages was re-defined in order to support messages that are not entirely US-ASCII text.
The Internet community generally adds features by "extension", allowing communication in both directions between upgraded machines and not-yet-upgraded machines, rather than declaring formerly standards-compliant legacy software to be "broken" and insisting that all software worldwide be upgraded to the latest standard. In the mid-1990s, people objected to "just send 8 bits ", perhaps because of a perception that "just send 8 bits" is an implicit declaration that ISO 8859-1 become the new "standard encoding", forcing everyone in the world to use the same character set. Instead, the recommended way to take advantage of 8-bit-clean links between machines is to use the ESMTP 8BITMIME extension. Despite this, some Mail Transfer Agents, notably Exim and qmail, relay mail to servers that do not advertise 8BITMIME without performing the conversion to 7-bit MIME required by. This "just-send-8" attitude does not in fact cause problems in practice, since virtually all modern email servers are 8-bit clean.