阅读作业有必读的教科书，Cover，T. M and J. A. Thomas，Elements of Information Theory, ，John Wiley & Sons，2001. 补充读物同时列在必读物下面。
| 1 |
简介，随机变量复习，熵，互信息，链式法则 |
第一章，2.1－2.5节 |
| 2 |
Jensen不等式，数据处理定理，Fanos不等式 |
2.6－2.8节和2.11节 |
| 3 |
马尔可夫链，随机过程的熵速率 |
第四章 |
| 4 |
不同类型的收敛，渐进均分性质（AEP），典型集合，联合典型 |
3.1－3.3节和8.6节 |
| 5 |
数据压缩，克拉夫特不等式，最优编码 |
5.1－5.5节 |
| 6 |
霍夫曼（Huffman）编码，分布的灵敏度，埃利斯（Elias）编码 |
5.6－5.9节 |
| 7 |
博弈 |
第六章 |
| 8 |
信道容量，删除信道 |
8.1－8.3节 |
| 9 |
编码定理 |
8.4－8.9节 |
| 10 |
强编码定理 |
|
| 11 |
强编码定理（续） |
|
| 12 |
反馈容量 |
8.12节 |
| 13 |
联合信源信道编码 |
8.13节 |
| 14 |
微分熵 |
第九章 |
| 15 |
高斯信道 |
10.1－10.3节 |
| 16 |
高斯信道：并行，有色噪声，码间串扰 |
10.4－10.5节 |
| 17 |
熵的最大化 |
11.1－11.6节 |
| 18 |
有反馈的高斯信道 |
10.6节 |
| 19 |
衰落信道 |
|
| 20 |
类型，通用信源编码，香农定理 |
12.1－12.6节 |
| 21 |
多址接入信道 |
14.1－14.3节 |
| 22 |
Slepian-Wolf编码 |
14.4－14.5节 |
| 23 |
广播信道 |
14.6节 |
| 24 |
信道边信息，宽带信道 |
|
|
补充读物
本部分为这门课程提供可选的补充读物。并对各读物的难度进行了注明：
一星（*）：容易的
两星（**）：需要大量的数学基础
三星（***）：专家级
Shannon，Claude. “A Mathematical Theory of Communication.” Bell System Technical Journal 27 （July and October, 1948）：379-423和623-656.
***Vembu，Sridhar，Sergio Verdu and Yossef Steinberg. “The Source-Channel Separation Theorem Revisited.” IEEE Trans. on Info. Theory 41, no. 1 (January 1995).
***Biglieri，Ezio，John Proakis and Shlomo Shamai. “Fading Channels: Information-Theoretic and Communications Aspects.”IEEE Trans. on Info. Theory 44，no. 6 (October, 1998).
*Rimoldi，Bixio， and Rudiger Urbanke. “A Rate-Splitting Approach to the Gaussian Multiple-Access Channel.”IEEE Trans. on Info. Theory 42, no. 2 (March, 1996).
*Bergmans，Patrick. “A Simple Converse for Broadcast Channels with Additive White Gaussian Noise.” IEEE Trans. on Info. Theory 20，no. 2 (March, 1974).
*———. “Random Coding Theorem for Broadcast Channels with Degraded Components.”"Random Coding Theorem for Broadcast Channels with Degraded Components" IEEE Trans. on Info. Theory 19，no. 2 (March, 1973).
**Cover, Thomas. "Comments on Broadcast Channels." IEEE Trans. on Info. Theory 44, no. 6 (October, 1998).
**Mushkin, Mordechai, and Israel Bar-David. "Capacity and Coding for the Gilbert-Elliott Channels." IEEE Trans. on Info. Theory 35, no. 6 (November, 1989).
***Feder, Meir, and Neri Merhav. "Hierarchical Universal Coding." IEEE Trans. on Info. Theory 42, no. 5 (September, 1986).
***Verdu, Sergio, and Te Sun Han. "A General Formula for Channel Capacity." IEEE Trans. on Info. Theory 40, no. 4 (July, 1994).
*Gallager, Robert. "Variations on a Theme by Huffman." IEEE Trans. on Info. Theory 24, no. 6 (November, 1978).
*Chomsky, Noam. "Three Models for the Description on Language." IEEE Trans. on Info. Theory 2, no. 3 (November, 1956).
**Thomas, Joy. "Feedback Can at Most Double Gaussian Multiple Access Channel Capacity." IEEE Trans. on Info. Theory 33, no. 5 (September, 1987).
**Cheng, Roger, and Sergio Verdu. "Gaussian Multiaccess Channel with ISI: Capacity Region and Multiuser Water-Filling." IEEE Trans. on Info. Theory 39, no. 3 (May, 1993).
***Caire, Giuseppe, and Shlomo Shamai. "On the Capacity of Some Channels with Channel State Information." IEEE Trans. on Info. Theory 45, no. 6 (September, 1999).
*Gray, Robert, Mari Dunham, and R. Gobbi. "Eogodicity of Markov Channels." IEEE Trans. on Info. Theory 33, no. 5 (September, 1987).
***Goldsmith, Andrea, and Pravin Varaiya. "Capacity, Mutual Information, and Coding for Finite-State Markov Channels." IEEE Trans. on Info. Theory 42, no. 3 (May, 1993).
*Gallager, Robert. "A Perspective on Multiaccess Channels." IEEE Trans. on Info. Theory 31, no. 2 (March, 1985).
***Hirt, Walter, and James Massey. "Capacity of the Discrete-Time Gaussian Channel with Inter-symbol Interference." IEEE Trans. on Info. Theory 34, no. 3 (May, 1988).
**Shamai, Shlomo, and Aaron Wyner. "Information-Theoretic Considerations for Symmetric Cellular, Multiple-Access Fading Channels, Part I and II." IEEE Trans. on Info. Theory 43, no. 6 (May, 1997).
***Ozarow, Lawrence. "Random Coding for Additive Gaussian Channels with Feedback." IEEE Trans. on Info. Theory 36, no. 1 (January, 1990).
***Hughes, Brian, and Tony Thomas. "On Error Exponents for Arbitrarily Varying Channels." IEEE Trans. on Info. Theory 42, no. 1 (May, 1996).
***Medard, Muriel, and Robert Gallager. "Bandwidth Scaling for Fading Multipath Channels." IEEE Trans. on Info. Theory 48, no. 4 (April, 2002).
***Gallager, Robert. "A Simple Derivation of the Coding Theorem and Some Applications." IEEE Trans. on Info. Theory 11, no. 1 (January, 1965).
***Telatar, Emre, and David Tse. "Capacity and Mutual Information of Wideband Multipath Fading Channels." IEEE Trans. on Info. Theory 46, no. 4 (July, 2000).
**Telatar, I., "Capacity of Multi-antenna Gaussian Channels." European Transactions on Telecommunications 10 (Nov/Dec 1999): 585-595.
Verdu, Sergio. "On Channel Capacity per Unit Cost." EEE Trans. on Info. Theory 36, no. 5 (September 1990).
———. "Spectral Efficiency in the Wideband Regime." EEE Trans. on Info. Theory 48, no. 6 (June 2002).
Forney, David. "On Exponential Error Bounds for Random Codes on the BSC."
Jindal, Nihar, Sriram Vishwanath, and Andrea Goldsmith. "On The Duality of Gaussian Multiple-Access and Broadcast Channels." Preprint 2002.