Index of information theory articles
This is a list of information theory topics.
- A Mathematical Theory of Communication
- algorithmic information theory
- arithmetic coding
- channel capacity
- Communication Theory of Secrecy Systems
- conditional entropy
- conditional quantum entropy
- confusion and diffusion
- cross-entropy
- data compression
- entropic uncertainty (Hirchman uncertainty)
- entropy encoding
- entropy (information theory)
- Fisher information
- Hick's law
- Huffman coding
- information bottleneck method
- information theoretic security
- information theory
- joint entropy
- Kullback–Leibler divergence
- lossless compression
- negentropy
- noisy-channel coding theorem (Shannon's theorem)
- principle of maximum entropy
- quantum information science
- range encoding
- redundancy (information theory)
- Rényi entropy
- self-information
- Shannon–Hartley theorem