ELEMENTS OF INFORMATION THEORY
Second Edition
THOMAS M. COVER
JOY A. THOMAS
and
solution
1 Introduction
2 Entropy, Relative Entropy and Mutual Information
3 The Asymptotic Equipartition Property
4 Entropy Rates of a Stochastic Process
5 Data Compression
6 Gambling and Data Compression
7 Channel Capacity
8 Dierential Entropy
9 Gaussian channel
10 Rate Distortion Theory
11 Information Theory and Statistics
12 Maximum Entropy
13 Universal Source Coding
14 Kolmogorov Complexity
15 Network Information Theory
16 Information Theory and Portfolio Theory
17 Inequalities in Information Theory