Timeline of information theory A timeline of events related to information theory , quantum information theory and statistical physics , data compression , error correcting codes and related subjects. 1872 – Ludwig Boltzmann presents his H-theorem , and with it the formula Σp i log p i for the entropy of a single gas particle 1878 – J. Willard Gibbs defines the Gibbs entropy: the probabilities in the entropy formula are now taken as probabilities of the state of the whole system 1924 – Harry Nyquist discusses quantifying "intelligence" and the speed at which it can be transmitted by a communication system 1927 – John von Neumann defines the von Neumann entropy , extending the Gibbs entropy to quantum mechanics 1928 – Ralph Hartley introduces Hartley information as the logarithm of the number of possible messages, with information being communicated when the receiver can distinguish one sequence of symbols from any other 1929 – Leó Szilárd analyses Maxwell's Demon , showing how a Szilard engine can sometimes transform information into the extraction of useful work 1940 – Alan Turing introduces the deciban as a measure of information inferred about the German Enigma machine cypher settings by the Banburismus process 1944 – Claude Shannon's theory of information is substantially complete 1947 – Richard W. Hamming invents Hamming codes for error detection and correction 1948 – Claude E. Shannon publishes A Mathematical Theory of Communication 1949 – Claude E. Shannon publishes Communication in the Presence of Noise – Nyquist–Shannon sampling theorem and Shannon–Hartley law 1949 – Claude E. Shannon's Communication Theory of Secrecy Systems is declassified 1949 – Robert M. Fano publishes Transmission of Information . M.I.T. Press, Cambridge, Massachusetts – Shannon–Fano coding 1949 – Leon G. Kraft discovers Kraft's inequality , which shows the limits of prefix codes 1949 – Marcel J. E. Golay introduces Golay codes for forward error correction 1951 – Solomon Kullback and Richard Leibler introduce the Kullback–Leibler divergence 1951 – David A. Huffman invents Huffman encoding , a method of finding optimal prefix codes for lossless data compression 1953 – August Albert Sardinas and George W . Patterson devise the Sardinas–Patterson algorithm , a procedure to decide whether a given variable-length code is uniquely decodable 1954 – Irving S. Reed and David E. Muller propose Reed–Muller codes 1955 – Peter Elias introduces convolutional codes 1957 – Eugene Prange first discusses cyclic codes 1959 – Alexis Hocquenghem , and independently the next year Raj Chandra Bose and Dwijendra Kumar Ray-Chaudhuri , discover BCH codes 1960 – Irving S. Reed and Gustave Solomon propose Reed–Solomon codes 1962 – Robert G. Gallager proposes low-density parity-check codes ; they are unused for 30 years due to technical limitations 1965 – Dave Forney discusses concatenated codes 1966 – Fumitada Itakura and Shuzo Saito develop linear predictive coding , a form of speech coding 1967 – Andrew Viterbi reveals the Viterbi algorithm , making decoding of convolutional codes practicable 1968 – Elwyn Berlekamp invents the Berlekamp–Massey algorithm ; its application to decoding BCH and Reed–Solomon codes is pointed out by James L. Massey the following year 1968 – Chris Wallace and David M. Boulton publish the first of many papers on Minimum Message Length statistical and inductive inference 1970 – Valerii Denisovich Goppa introduces Goppa codes 1972 – Jørn Justesen proposes Justesen codes, an improvement of Reed–Solomon codes 1972 – Nasir Ahmed proposes the discrete cosine transform , which he develops with T. Natarajan and K. R. Rao in 1973; the DCT later became the most widely used lossy compression algorithm , the basis for multimedia formats such as JPEG , MPEG and MP3 1973 – David Slepian and Jack Wolf discover and prove the Slepian–Wolf coding limits for distributed source coding 1976 – Gottfried Ungerboeck gives the first paper on trellis modulation ; a more detailed exposition in 1982 leads to a raising of analogue modem POTS speeds from 9.6 kbit/s to 33.6 kbit/s 1976 – Richard Pasco and Jorma J. Rissanen develop effective arithmetic coding techniques 1977 – Abraham Lempel and Jacob Ziv develop Lempel–Ziv compression 1989 – Phil Katz publishes the .zip
format including DEFLATE ; later to become the most widely used archive container 1993 – Claude Berrou , Alain Glavieux and Punya Thitimajshima introduce Turbo codes 1994 – Michael Burrows and David Wheeler publish the Burrows–Wheeler transform , later to find use in bzip2 1995 – Benjamin Schumacher coins the term qubit and proves the quantum noiseless coding theorem 2006 – first Asymmetric numeral systems entropy coding: since 2014 popular replacement of Huffman and arithmetic coding in compressors like Facebook Zstandard or Apple LZFSE 2008 – Erdal Arıkan introduces polar codes , the first practical construction of codes that achieves capacity for a wide array of channels
Popular articles Javier Milei - Argentine libertarian economist, author, radio conductor and public speaker sympathetic to the Austrian School of economic thought. He became widely known for his regular ...Jimmy Carter - American politician, philanthropist, and former farmer who served as the 39th president of the United States from 1977 to 1981. A member of the Democratic Party, he previ...UEFA Euro 2024 - The 2024 UEFA European Football Championship , commonly referred to as UEFA Euro 2024 or simply Euro 2024 , will be the 17th edition of the UEFA European Championship, the quadrennial internationa...Argentina - country located mostly in the southern half of South America. Sharing the bulk of the Southern Cone with Chile to the west, the country is also b...Sam Altman - American entrepreneur, investor, programmer, and blogger. He is the former president of Y Combinator and now the CEO of OpenAI. Early life and education. ...Rosalynn Carter - American who served as First Lady of the United States from 1977 to 1981 as the wife of President Jimmy Carter. For decades, she has been a leading advocate for numerou...Next Argentine presidential election - Next Argentine presidential election - presidential election in Argentina....Popular movies The Hunger Games (film) - 2012 American dystopian action thriller science fiction-adventure film directed by Gary Ross and based on Suzanne Collins’s 2008 novel of the same name. It is the first insta...untitled Captain Marvel sequel - part of Marvel Cinematic Universe....Killers of the Flower Moon (film project) - Killers of the Flower Moon - film project in United States of America. It was presented as drama, detective fiction, thriller. The film project starred Leonardo Dicaprio, Robert De Niro. Director of...Five Nights at Freddy's (film) - Five Nights at Freddy's - film published in 2017 in United States of America. Scenarist of the film - Scott Cawthon....Popular video games Minecraft - sandbox video game developed by Mojang Studios. Created by Markus "Notch" Persson in the Java programming language and released as a public alpha for personal computers in 2...Grand Theft Auto V - 2013 action-adventure game developed by Rockstar North and published by Rockstar Games. It is the first main entry in the Grand Theft Auto series since 2008's Grand Theft ...Roblox - online game platform and game creation system that allows users to program games and play games created by other users. Founded by David Baszucki and Erik Cassel in 2004 and released in...Baldur's Gate III - upcoming role-playing video game developed and published by Larian Studios for Microsoft Windows and the Stadia streaming service. It is the third main game in the Baldur's ...Alan Wake - action-adventure video game developed by Remedy Entertainment and published by Microsoft Studios, released for the Xbox 360 and Microsoft Windows. The story follows best-selling thri...Fortnite - online video game developed by Epic Games and released in 2017. It is available in three distinct game mode versions that otherwise share the same general gameplay and game engine: ...Super Mario RPG - is a role-playing video game developed by Square and published by Nintendo for the Super Nintendo Entertainment System in 1996. It was directed by Yoshihiko Maekawa and Chihiro Fujioka and produced by...Popular books Book of Revelation - The Book of Revelation is the final book of the New Testament, and consequently is also the final book of the Christian Bible. Its title is derived from the first word of the Koine Greek text: apok...Book of Genesis - account of the creation of the world, the early history of humanity, Israel's ancestors and the origins...Gospel of Matthew - The Gospel According to Matthew is the first book of the New Testament and one of the three synoptic gospels. It tells how Israel's Messiah, rejected and executed in Israel, pronounces judgement on ...Michelin Guide - Michelin Guides are a series of guide books published by the French tyre company Michelin for more than a century. The term normally refers to the annually published Michelin Red Guide , the oldest...Psalms - The Book of Psalms , commonly referred to simply as Psalms , the Psalter or "the Psalms", is the first book of the Ketuvim , the third section of the Hebrew Bible, and thus a book of th...Ecclesiastes - Ecclesiastes is one of 24 books of the Tanakh , where it is classified as one of the Ketuvim . Originally written c. 450–200 BCE, it is also among the canonical Wisdom literature of the Old Tes...The 48 Laws of Power - non-fiction book by American author Robert Greene. The book...Popular television series The Crown (TV series) - historical drama web television series about the reign of Queen Elizabeth II, created and principally written by Peter Morgan, and produced by Left Bank Pictures and Sony Pictures Tel...Friends - American sitcom television series, created by David Crane and Marta Kauffman, which aired on NBC from September 22, 1994, to May 6, 2004, lasting ten seasons. With an ensemble cast sta...Young Sheldon - spin-off prequel to The Big Bang Theory and begins with the character Sheldon...Modern Family - American television mockumentary family sitcom created by Christopher Lloyd and Steven Levitan for the American Broadcasting Company. It ran for eleven seasons, from September 23...Loki (TV series) - upcoming American web television miniseries created for Disney+ by Michael Waldron, based on the Marvel Comics character of the same name. It is set in the Marvel Cinematic Universe, shar...Game of Thrones - American fantasy drama television series created by David Benioff and D. B. Weiss for HBO. It...Shameless (American TV series) - American comedy-drama television series developed by John Wells which debuted on Showtime on January 9, 2011. It...
OWIKI.org . Text is available under the Creative Commons Attribution-ShareAlike License.