Advertisement
Lecture notes on Information Theory and Coding
This note explains the following topics: Measuring Information, Joint Entropy, Relative Entropy and Mutual Information, Sources with Memory, Asymptotic Equipartition Property and Source Coding, Channel Capacity and Coding, Continuous Sources and Gaussian Channel, Rate Distortion Theory.
Author(s): University of Siena
NA Pages 
Lecture Notes on statistics and information Theory
This lecture note navigates through information theory, statistics and measure theory. It covers fundamental concepts such as definitions, chain rules, data processing inequalities, and divergences and extends to optimal procedures, LeCam’s and Fano’s inequalities, and operational results like entropy and source coding. It also focus on exponential families and statistical modeling, fitting procedures, and lower bounds on testing parameters, sub-Gaussian and sub-exponential random variables, martingale methods, uniformity covering topics such as Kullback-Leibler divergence, PAC-Bayes bounds, interactive data analysis, and error bounds.
Author(s): John Duchi
464 Pages
Advanced Information Theory notes
This book contains following contents: Information Theory for Discrete Variables, Information Theory for Continuous Variables, Channel Coding, Typical Sequences and Sets, Lossy Source Coding, Distributed Source Coding, Multiaccess Channels.
Author(s): Prof Dr. sc. techn. Gerhard Kramer
180 Pages
This book explains basics of thermodynamics, including thermodynamic potentials, microcanonical and canonical distributions, and evolution in the phase space, The inevitability of irreversibility, basics of information theory, applications of information theory, new second law of thermodynamics and quantum information.
Author(s): Gregory Falkovich
165 Pages
Information Theory Lecture Notes
This PDF covers the following topics related to Information Theory : Introduction, Entropy, Relative Entropy, and Mutual Information, Asymptotic Equipartition Properties, Communication and Channel Capacity, Method of Types, Conditional and Joint Typicality, Lossy Compression & Rate Distortion Theory, Joint Source Channel Coding.
Author(s): Prof. Tsachy Weissman
75 Pages
Information Theory, Inference, and Learning Algorithms (David J.C. MacKay)
Currently this section contains no detailed description for the page, will update this page soon.
Author(s):
Pages
A Short Course in Information Theory (D. MacKay)
Currently this section contains no detailed description for the page, will update this page soon.
Author(s):
PagesAdvertisement
