Advertisement
Information Theory Lecture Notes
This is a graduate-level introduction to mathematics of information theory. This note will cover both classical and modern topics, including information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression.
Author(s): Prof. Yury Polyanski
NA Pages 
An Introduction to Information Theory and Applications
This note explains the following topics: uncertainty and information, Efficient coding of information, Stationary processes and markov chains, Coding for noisy transmission, Complements to efficient coding of Information, Error correcting codes and cryptography.
Author(s): F Bavaud, J C Chappelier and J Kohlas
293 Pages
Applied Digital Information theory
This note serves as a comprehensive guide to fundamental concepts in information theory and coding. This pdf provides discrete probability theory, information theory, and coding principles. Beginning with Shannon's measure of information, then delves into the efficient coding of information, the methodology of typical sequences is introduced, emphasizing the distinction between lossy and lossless source encoding. The text also discusses coding for noisy digital channels, block coding principles and tree and trellis coding principles.
Author(s): James L.Massey
153 Pages
Advanced Information Theory notes
This book contains following contents: Information Theory for Discrete Variables, Information Theory for Continuous Variables, Channel Coding, Typical Sequences and Sets, Lossy Source Coding, Distributed Source Coding, Multiaccess Channels.
Author(s): Prof Dr. sc. techn. Gerhard Kramer
180 Pages
Information Theory Lecture Notes
This PDF covers the following topics related to Information Theory : Introduction, Entropy, Relative Entropy, and Mutual Information, Asymptotic Equipartition Properties, Communication and Channel Capacity, Method of Types, Conditional and Joint Typicality, Lossy Compression & Rate Distortion Theory, Joint Source Channel Coding.
Author(s): Prof. Tsachy Weissman
75 Pages
Information Theory and its applications in theory of computation
This note covers the following topics: Entropy, Kraft's inequality, Source coding theorem, conditional entropy, mutual information, KL-divergence and connections, KL-divergence and Chernoff bounds, Data processing and Fano's inequalities, Asymptotic Equipartition Property, Universal source coding: Lempel-Ziv algorithm and proof of its optimality, Source coding via typical sets and universality, joint typicality and joint AEP, discrete channels and channel capacity, Proof of Noisy channel coding theorem, Constructing capacity-achieving codes via concatenation, Polarization, Arikan's recursive construction of a polarizing invertible transformation, Polar codes construction, Bregman's theorem, Shearer's Lemma and applications, Source coding and Graph entropy, Monotone formula lower bounds via graph entropy, Optimal set Disjointness lower bound and applications, Compression of arbitrary communication protocols, Parallel repetition of 2-prover 1-round games.
Author(s): Venkatesan Guruswami and Mahdi Cheraghchi
NA Pages
Information Theory in Computer Science
This note explains the following topics: Shearer's Lemma, Entropy, Relative Entropy, Hypothesis testing, total variation distance and Pinsker's lemma, Stability in Shearer's Lemma, Communication Complexity, Set Disjointness, Direct Sum in Communication Complexity and Internal Information Complexity, Data Structure Lower Bounds via Communication Complexity, Algorithmic Lovasz Local Lemma, Parallel Repetition Theorem, Graph Entropy and Sorting.
Author(s): Madhu Sudan
NA PagesAdvertisement
