Basics of information theory
This book explains basics of thermodynamics, including thermodynamic potentials, microcanonical and canonical distributions, and evolution in the phase space, The inevitability of irreversibility, basics of information theory, applications of information theory, new second law of thermodynamics and quantum information.
Author(s): Gregory Falkovich
165 Pages 
An introduction to information Theory and Entropy
This note covers Measuring complexity, Some probability ideas, Basics of information theory, Some entropy theory, The Gibbs inequality, A simple physical example Shannon’s communication theory, Application to Biology, Examples using Bayes Theorem, Analog channels, A Maximum Entropy Principle, Application to Physics(lasers), Kullback-Leibler information measure.
Author(s): Tom Carter
139 Pages
Advanced Information Theory notes
This book contains following contents: Information Theory for Discrete Variables, Information Theory for Continuous Variables, Channel Coding, Typical Sequences and Sets, Lossy Source Coding, Distributed Source Coding, Multiaccess Channels.
Author(s): Prof Dr. sc. techn. Gerhard Kramer
180 Pages
Information Theory for Data Communications and Processing
The PDF covers the following topics related to Information Theory : Information Theory for Data Communications and Processing, On the Information Bottleneck Problems: Models, Connections,Applications and Information Theoretic Views, Variational Information Bottleneck for Unsupervised Clustering: Deep Gaussian Mixture Embedding, Asymptotic Rate-Distortion Analysis of Symmetric Remote Gaussian Source Coding: Centralized Encoding vs. Distributed Encoding, Non-Orthogonal eMBB-URLLC Radio Access for Cloud Radio Access Networks with Analog Fronthauling, Robust Baseband Compression Against Congestion in Packet-Based Fronthaul Networks Using Multiple Description Coding, Amplitude Constrained MIMO Channels: Properties of Optimal Input Distributions and Bounds on the Capacity, Quasi-Concavity for Gaussian Multicast Relay Channels, Gaussian Multiple Access Channels with One-Bit Quantizer at the Receiver, Efficient Algorithms for Coded Multicasting in Heterogeneous Caching Networks, Cross-Entropy Method for Content Placement and User Association in Cache-Enabled Coordinated Ultra-Dense Networks, Symmetry, Outer Bounds, and Code Constructions: A Computer-Aided Investigation on the Fundamental Limits of Caching.
Author(s): Shlomo Shamai, Abdellatif Zaidi
296 Pages
Information Theory Lecture Notes
This is a graduate-level introduction to mathematics of information theory. This note will cover both classical and modern topics, including information entropy, lossless data compression, binary hypothesis testing, channel coding, and lossy data compression.
Author(s): Prof. Yury Polyanski
NA Pages
Information Theory, Inference, and Learning Algorithms (David J.C. MacKay)
Currently this section contains no detailed description for the page, will update this page soon.
Author(s):
Pages
A Short Course in Information Theory (D. MacKay)
Currently this section contains no detailed description for the page, will update this page soon.
Author(s):
Pages
